-- Logs begin at Thu 2022-03-03 01:45:13 UTC, end at Thu 2022-03-03 03:17:04 UTC. -- Mar 03 02:22:06.822877 dv-cinder-819778-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Mar 03 02:22:06.831530 dv-cinder-819778-7-iscsi devstack@n-api.service[102258]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Mar 03 02:22:06.833582 dv-cinder-819778-7-iscsi devstack@n-api.service[102258]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Mar 3 02:22:06 2022] *** Mar 03 02:22:06.833582 dv-cinder-819778-7-iscsi devstack@n-api.service[102258]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 03 02:22:06.833582 dv-cinder-819778-7-iscsi devstack@n-api.service[102258]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 03 02:22:06.833582 dv-cinder-819778-7-iscsi devstack@n-api.service[102258]: nodename: dv-cinder-819778-7-iscsi Mar 03 02:22:06.833582 dv-cinder-819778-7-iscsi devstack@n-api.service[102258]: machine: x86_64 Mar 03 02:22:06.833582 dv-cinder-819778-7-iscsi devstack@n-api.service[102258]: clock source: unix Mar 03 02:22:06.833582 dv-cinder-819778-7-iscsi devstack@n-api.service[102258]: pcre jit disabled Mar 03 02:22:06.833582 dv-cinder-819778-7-iscsi devstack@n-api.service[102258]: detected number of CPU cores: 4 Mar 03 02:22:06.833582 dv-cinder-819778-7-iscsi devstack@n-api.service[102258]: current working directory: / Mar 03 02:22:06.833582 dv-cinder-819778-7-iscsi devstack@n-api.service[102258]: detected binary path: /usr/bin/uwsgi-core Mar 03 02:22:06.834280 dv-cinder-819778-7-iscsi devstack@n-api.service[102258]: your processes number limit is 47680 Mar 03 02:22:06.834280 dv-cinder-819778-7-iscsi devstack@n-api.service[102258]: your memory page size is 4096 bytes Mar 03 02:22:06.834280 dv-cinder-819778-7-iscsi devstack@n-api.service[102258]: detected max file descriptor number: 2048 Mar 03 02:22:06.834280 dv-cinder-819778-7-iscsi devstack@n-api.service[102258]: lock engine: pthread robust mutexes Mar 03 02:22:06.834280 dv-cinder-819778-7-iscsi devstack@n-api.service[102258]: thunder lock: enabled Mar 03 02:22:06.834280 dv-cinder-819778-7-iscsi devstack@n-api.service[102258]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Mar 03 02:22:06.834280 dv-cinder-819778-7-iscsi devstack@n-api.service[102258]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Mar 03 02:22:06.879095 dv-cinder-819778-7-iscsi devstack@n-api.service[102258]: Python main interpreter initialized at 0x55af364799c0 Mar 03 02:22:06.879095 dv-cinder-819778-7-iscsi devstack@n-api.service[102258]: python threads support enabled Mar 03 02:22:06.879095 dv-cinder-819778-7-iscsi devstack@n-api.service[102258]: your server socket listen backlog is limited to 100 connections Mar 03 02:22:06.879095 dv-cinder-819778-7-iscsi devstack@n-api.service[102258]: your mercy for graceful operations on workers is 90 seconds Mar 03 02:22:06.879427 dv-cinder-819778-7-iscsi devstack@n-api.service[102258]: mapped 403077 bytes (393 KB) for 2 cores Mar 03 02:22:06.879504 dv-cinder-819778-7-iscsi devstack@n-api.service[102258]: *** Operational MODE: preforking *** Mar 03 02:22:06.879760 dv-cinder-819778-7-iscsi devstack@n-api.service[102258]: *** uWSGI is running in multiple interpreter mode *** Mar 03 02:22:06.879760 dv-cinder-819778-7-iscsi devstack@n-api.service[102258]: spawned uWSGI master process (pid: 102258) Mar 03 02:22:06.879946 dv-cinder-819778-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Mar 03 02:22:06.880464 dv-cinder-819778-7-iscsi devstack@n-api.service[102258]: spawned uWSGI worker 1 (pid: 102259, cores: 1) Mar 03 02:22:06.880790 dv-cinder-819778-7-iscsi devstack@n-api.service[102258]: spawned uWSGI worker 2 (pid: 102260, cores: 1) Mar 03 02:22:06.880947 dv-cinder-819778-7-iscsi devstack@n-api.service[102258]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 03 02:22:08.718594 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 03 02:22:08.718594 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: from cryptography.utils import int_from_bytes Mar 03 02:22:08.719320 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 03 02:22:08.719320 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: from cryptography.utils import int_from_bytes Mar 03 02:22:08.720667 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 03 02:22:08.720667 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: from cryptography.utils import int_from_bytes Mar 03 02:22:08.721167 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 03 02:22:08.721167 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: from cryptography.utils import int_from_bytes Mar 03 02:22:11.274055 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 03 02:22:11.274676 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 03 02:22:11.275037 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 03 02:22:11.275149 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 03 02:22:11.275235 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 03 02:22:11.275322 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 03 02:22:11.275404 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 03 02:22:11.275498 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 03 02:22:11.275579 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 03 02:22:11.275701 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 03 02:22:11.276172 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.276268 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.276507 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.276645 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.276832 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.276977 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.277153 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.277304 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.277493 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.277641 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.277816 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.277951 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.278135 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.278278 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.278454 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.278603 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.278783 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.278935 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.279029 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.279201 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.279345 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.279522 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.279692 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819778-7-iscsi {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.279881 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819778-7-iscsi {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.280017 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.280209 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.280308 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.280524 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.280616 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.280842 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.280947 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.281168 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.281253 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.281480 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.281572 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.281810 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.281907 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.282123 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.282308 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.282636 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.282778 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.282952 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.283066 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.283263 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.283385 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.283578 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.283778 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.283940 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.284060 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.284260 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.284365 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.284575 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.284678 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.284879 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.284969 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.285199 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.285288 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.285505 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.285596 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.285827 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.285913 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819778-7-iscsi {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.286206 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.286298 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819778-7-iscsi {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.286519 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.286605 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.286834 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.286928 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.287153 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.287247 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.287545 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.287680 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.287885 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.287982 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.288207 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.288327 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.288528 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.288623 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.288836 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.288942 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.289150 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.289243 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.289475 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.289569 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.289795 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.289900 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.290119 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.290222 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.290417 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.290509 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.290726 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.290812 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.291040 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.291148 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.291922 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.292045 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.292284 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.292382 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.292682 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.292778 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.292934 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.293021 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.293236 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.293323 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.293551 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.293692 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.293871 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.293958 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.294194 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.294292 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.294448 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.294540 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.294702 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.294817 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.295002 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.295090 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.295329 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.295431 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.295662 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.295759 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.295971 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.296072 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.296279 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.296366 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.296586 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.296672 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.296892 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.296989 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.297200 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.297295 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.297508 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.297603 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.297815 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.297927 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.298121 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.298213 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.298431 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.298523 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.298751 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.298839 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.299057 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.299142 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.299375 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.299461 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.299735 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.299826 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.300028 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.300159 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.300335 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.300432 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.300671 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.300767 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.300992 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.301085 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.301300 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.301387 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.301665 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.301759 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.301940 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.302025 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.302257 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.302403 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.302553 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.302642 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.302860 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.302946 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.303167 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.303262 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.303494 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.303582 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.303822 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.303936 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.304076 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.304400 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.304400 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.304642 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.304774 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.304913 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.305001 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.305246 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.305383 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.305586 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.305676 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.305896 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.305984 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.306205 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.306293 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.306506 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.306592 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.306815 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.306945 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.307877 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.308089 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.308174 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.308265 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.308478 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.308589 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.308784 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.308871 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.309092 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.309179 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.309401 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.309495 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.309710 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.309799 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.310018 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.310104 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.310338 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.310437 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.310663 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.310756 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.310972 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.311057 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.311282 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.311377 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.311590 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.311705 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.311931 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.312033 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.312251 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.312346 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.312562 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.312651 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.312869 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.312957 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.313193 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.313288 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.313498 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.313584 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.313808 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.313901 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.314134 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.314307 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.314448 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.314543 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.314760 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.314847 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.315086 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.315175 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.315395 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.315488 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.315733 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.315836 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.316052 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.316143 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.316362 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.316450 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.316666 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.316754 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.316972 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.317060 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.317278 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.317371 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.317584 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.317671 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.317889 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.317983 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.318192 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.318285 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.318494 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.318590 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.318795 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.318882 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.319115 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.319211 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.319434 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.319533 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.319770 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.319858 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.320080 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.320167 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.320386 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.320490 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.320707 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.320796 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:22:11.321042 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.321129 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.321378 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.321477 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.321728 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.321815 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.322045 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.322133 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.322379 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.322468 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.322762 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.323043 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.323157 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.323252 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.323396 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.323554 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.323745 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.323912 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.324001 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.324250 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.324351 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.324573 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.324661 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.324892 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.324980 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.325211 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.325299 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.325525 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.325618 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.325847 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.325941 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.326162 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.326265 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.326480 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.326568 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.326800 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.326895 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.327110 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.327205 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.327429 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.327517 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.327776 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.327868 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.328098 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.328187 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.328412 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.328499 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.328730 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.328818 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.329079 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.329175 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.329393 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.329484 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.329720 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.329811 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.330046 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.330142 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.330359 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.330505 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.330673 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.330763 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.330985 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.331080 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.331297 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.331384 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.331645 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.331772 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.331951 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.332040 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.332276 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.332403 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.332588 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.332776 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.332912 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.333035 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.333198 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.333324 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.333504 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.333604 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.333815 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.333911 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.334131 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.334218 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.334452 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.334548 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.334771 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.334898 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.335081 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.335216 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.335396 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.335523 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.335733 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.335824 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.336045 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.336181 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.336354 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.336443 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.336661 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.336748 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.336970 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.337101 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.337333 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.337461 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.337584 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.337705 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.337848 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.337946 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.338209 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.338333 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.338579 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.338704 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.338890 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.339040 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.339224 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.339363 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.339535 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.339698 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.339871 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.340012 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.340180 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.340308 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.340490 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.340625 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.340796 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.340942 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.341109 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.341254 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.341419 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.341571 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.341753 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.341894 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.342049 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.342206 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.342359 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.342535 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.342672 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.342855 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.342995 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.343165 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.343303 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.343494 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.343634 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.343833 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.343932 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.344147 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.344235 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.344467 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.344563 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.344783 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.344877 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.345099 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.345186 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.345416 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.345511 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.345730 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.345818 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.346040 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.346124 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.346364 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.346460 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.346679 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.346773 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.346982 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.347067 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.347308 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.347396 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.347650 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.347751 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.347970 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.348056 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.348280 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.348379 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.348588 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.348676 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.348892 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.348978 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.349199 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.349286 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.349501 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.349595 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.349811 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.349904 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.350113 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.350197 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.350418 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.350510 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.350724 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.350830 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.351027 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.351114 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.351328 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.351412 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.351659 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.351758 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.351973 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.352068 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.352277 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.352362 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.352583 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.352677 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.352892 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.353048 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.353190 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.353326 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.353472 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.353608 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.354350 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.354568 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.354674 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.354910 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.355008 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.355235 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.355321 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.355566 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.355674 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.355906 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.356007 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.356225 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.356311 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.356541 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.356635 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.356856 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.356964 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.357170 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.357264 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.357481 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.357573 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.357795 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.357896 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.358104 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.358203 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.358420 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.358513 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.358728 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.358820 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.359045 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.359139 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.359352 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.359452 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.359691 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.359798 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.359999 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.360095 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.360314 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.360400 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.360635 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.360737 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.360973 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.361105 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.361288 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.361375 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.361612 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.361699 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.361924 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.362009 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.362237 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.362330 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.362544 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.362635 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.362855 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.362954 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.363168 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.363277 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.363477 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.363587 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.363819 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.363904 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.364129 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.364227 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.364440 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.364526 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.364747 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.364842 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.365060 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.365154 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.365370 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.365461 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.365688 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.365810 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.365993 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.366087 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.366308 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.366400 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.366627 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.366716 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.366954 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.367041 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.367267 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.367352 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.367580 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.367762 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.367920 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.368008 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.368234 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.368326 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.368545 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.368639 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.368855 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.368942 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.369161 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.369248 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.370027 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.370181 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.370370 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.370521 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.370657 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.370746 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.370983 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.371112 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.371289 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.371388 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.371597 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.371714 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.371931 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.372032 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.372245 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.372357 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.372552 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.372640 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.372857 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.372954 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.373163 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.373247 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.373481 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.373578 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.373787 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.373883 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.374108 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.374195 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.374427 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.374516 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.374735 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.374831 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.375042 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.375147 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.375348 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.375435 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.375681 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.375773 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.375988 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.376087 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.376293 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.376389 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.376602 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.376708 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.376910 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.377006 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.377242 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.377336 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.377547 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.377636 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.377852 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.377941 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.378168 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.378263 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.378735 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.378886 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.379045 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.379183 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.379355 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.379499 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.379671 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.379809 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.379995 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.380124 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.380304 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.380446 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.380613 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.380742 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.380924 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.381072 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.381229 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.381365 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.381538 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.381673 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.381846 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.381988 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.382158 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.382292 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.382465 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.382598 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.382773 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.382906 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.383082 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.383219 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.383399 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.383488 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.383713 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.383803 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.384030 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.384118 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.384352 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.384628 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.384923 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.385010 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.385288 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.385385 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.385609 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.385695 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.385927 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.386021 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.386249 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.386337 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.386570 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.386656 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.386898 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.386998 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.387228 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.387314 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.387535 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.387651 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.387875 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.387963 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.388184 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.388279 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.388493 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.388580 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.388803 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.388935 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.389109 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.389204 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.389415 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.389502 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.389722 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.389816 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.390028 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.390127 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.390330 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.390414 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.390632 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.390719 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.390935 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.391028 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.391241 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.391327 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.391550 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.391656 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.391882 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.392051 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.392191 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.392283 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.392492 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.392578 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.392801 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.392895 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.393108 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.393193 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.393411 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.393497 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.393714 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.393801 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.394020 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.394106 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.394327 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.394414 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.394668 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.394796 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.394972 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.395073 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.395303 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.395409 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.395647 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.395743 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.395957 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.396064 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.396262 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.396360 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.396585 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.396672 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.396891 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.396992 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.397194 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.397291 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.397497 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.397585 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.397803 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.397890 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.398106 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.398200 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.398409 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.398497 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.398713 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.398808 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.399023 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.399164 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.399329 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.399662 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.399980 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.400289 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.401135 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.401463 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.401788 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.402104 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.402413 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.402721 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.403035 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.403350 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.403911 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.404284 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.404625 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.404963 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.405311 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.405635 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.405964 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.406287 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.406611 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.406939 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.407259 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.407568 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.407731 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.407911 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.408004 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.408224 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.408315 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.408549 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.408645 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.408864 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.408952 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.409179 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.409281 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.409487 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.409583 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.409799 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.409887 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.410116 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.410205 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.410426 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.410516 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.410758 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.410853 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.411076 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.411164 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.411388 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.411476 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.411722 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.411827 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.412038 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.412126 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.412349 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.412435 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.412659 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.412755 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.412975 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.413072 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.413301 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.413390 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.413631 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.413791 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.413930 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.414076 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.414255 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.414385 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.414572 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.414759 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.414899 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.415078 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.415215 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.415388 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.415551 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.415715 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.415854 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.416019 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.416149 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.416475 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.416686 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.416832 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.416962 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.417179 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.417322 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.417459 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.417603 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.417738 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.417872 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.418006 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.418140 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.418308 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.418446 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.418623 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.418754 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.418946 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.419090 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.419272 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.419402 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.419590 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.420251 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.420484 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.420622 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.420796 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.420927 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.421116 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.421241 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.421432 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.421518 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.421751 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.421837 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.422069 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.422155 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.422381 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.422467 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.422689 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.422775 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.423010 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.423101 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.423322 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.423406 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.423653 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.423753 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.423965 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.424058 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.424272 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.424367 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.424596 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.424682 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.424908 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.424993 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.425223 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.425318 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.425547 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.425634 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.425873 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.425960 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.426183 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.426351 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.426496 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.426585 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.426807 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.426893 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.427122 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.427231 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.427435 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.427533 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.427769 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.427868 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.428086 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.428173 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.428401 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.428486 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.428713 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.428798 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.429029 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.429123 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.429342 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.429436 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.429655 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.429739 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.429962 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.430047 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.430275 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.430360 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.430587 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.430679 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.430897 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.430992 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.431220 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.431312 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.431532 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.431660 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.431895 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.431991 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.432218 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.432387 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.432531 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.432635 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.432818 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.432905 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.433124 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.433252 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.433552 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.433652 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.433868 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.433955 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.434179 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.434264 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.434486 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.434584 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.434802 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.434887 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.435112 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.435203 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.435431 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.435518 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.435765 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.435854 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.436072 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.436189 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.436490 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.436578 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.436805 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.436891 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.437120 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.437207 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.437437 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.437573 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.437734 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.437819 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.438041 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.438127 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.438353 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.438440 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.438667 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.438752 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.438973 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.439065 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.439281 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.439382 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.439583 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.439693 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.439927 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.440026 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.440235 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.440327 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.440558 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.440643 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.440968 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.441062 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.441284 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.441370 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.441592 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.441730 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.442014 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.442127 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.442325 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.442415 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.442636 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.442724 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.442961 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.443051 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.443285 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.443373 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.443595 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.443712 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.443930 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.444077 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.444243 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.444340 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.444551 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.444636 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.444876 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.444961 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.445198 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.445291 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.445509 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.445595 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.445817 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.445902 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.446124 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.446209 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.446450 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.446536 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.446765 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.446850 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.447079 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.447166 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.447403 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.447511 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.447908 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.448021 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.448232 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.448326 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.448546 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.448631 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.448870 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.448970 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.449179 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.449266 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.449502 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.449591 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.449795 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.449888 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.450108 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.450195 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.450414 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.450499 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.450727 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.450821 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.451041 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.451140 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.451354 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.451446 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.451689 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.451796 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.452002 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.452087 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.452312 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.452404 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.452617 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.452704 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.452924 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.453010 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.453238 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.453324 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.453541 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.453674 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.453866 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.453961 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.454181 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.454267 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.454501 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.454589 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.454812 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.454899 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.455116 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.455213 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.455441 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.455528 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.455773 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.455860 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.456080 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.456182 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.456384 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.456478 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.456687 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.456779 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.457024 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.457122 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.457328 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.457421 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.457650 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.457783 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.457984 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.458080 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.458299 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.458385 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.458613 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.458706 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.458950 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.459038 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.459270 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.459363 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.459586 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.459690 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.459925 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.460014 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.460237 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.460330 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.460544 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.460635 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.460850 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.460937 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.461157 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.461249 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.461466 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.461562 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.461773 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.461861 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.462080 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.462166 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.462386 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.462480 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.462688 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.462774 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.462989 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.463082 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.463875 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.463987 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.464248 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.464347 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.464514 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.464600 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.464827 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.464923 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.465135 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.465227 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.465442 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.465528 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.465748 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.465861 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.466054 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.466142 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.466390 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.466475 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.466693 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.466779 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.467031 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.467118 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.467349 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.467435 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.467694 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.467785 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.468010 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.468104 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.468326 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.468415 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.468647 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.468735 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.468964 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.469049 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.469281 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.469366 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.469597 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.469690 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.469913 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.469999 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.470227 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.470321 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.470542 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.470628 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.470856 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.470941 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.471170 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.471265 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.471485 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.471579 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.471828 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.471915 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.472152 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.472355 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.472677 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.472763 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.472993 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.473079 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.473312 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.473408 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.473624 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.473709 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.473939 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.474040 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.474251 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.474389 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.474565 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.474659 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.474878 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.474973 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.475185 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.475273 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.475497 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.475590 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.475833 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.475931 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.476160 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.476248 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.476484 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.476571 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.476811 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.476906 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.477130 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.477216 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.477451 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.477544 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.477768 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.477866 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.478086 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.478183 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.478400 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.478494 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.478768 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.479508 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.479711 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.479975 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.480068 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.480301 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.480402 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.480620 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.480714 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.480937 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.481030 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.481252 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.481346 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.481569 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.481663 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.481882 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.481968 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.482196 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.482297 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.482510 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.482596 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.482826 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.482912 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.483134 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.483221 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.483451 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.483539 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.483796 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.483895 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.484125 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.484226 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.484440 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.484533 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.484761 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.484861 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.485073 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.485188 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.485390 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.485595 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.485706 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.485914 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.486224 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.486317 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.486541 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.486634 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.486876 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.486971 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.487192 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.487284 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.487514 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.487628 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.487853 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.487947 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.488173 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.488270 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.488481 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.488567 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.488796 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.488883 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.489105 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.489192 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.489410 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.489503 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.489720 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.489807 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.490029 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.490115 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.490334 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.490420 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.490655 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.490741 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.490962 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.491051 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.491283 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.491553 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.491721 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.491855 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.492130 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.492218 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.492480 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.492585 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.492802 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.492890 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.493122 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.493209 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.493437 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.493532 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.493751 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.493836 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.494059 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.494145 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.494514 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.494606 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.494987 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.495124 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.495310 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.495397 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.495649 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.495757 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.495967 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.496074 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.496276 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.496404 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.496584 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.496679 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.496899 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.496986 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.497211 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.497298 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.497519 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.497606 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.497830 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.497949 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.498137 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.498279 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.498466 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.498604 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.498774 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.498926 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.499080 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.499240 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.499388 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.499560 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.499724 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.499906 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.500031 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.500226 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.500337 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.500546 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.500635 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.500873 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.500960 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.501192 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.501280 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.501514 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.501601 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.501819 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.501911 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.502126 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.502213 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.502437 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.502524 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.502742 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.502838 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.503055 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.503142 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.503407 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.503794 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.504017 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.504115 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.504324 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.504418 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.504630 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.504717 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.504949 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.505049 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.505259 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.505347 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.505581 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.505676 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.505895 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.505993 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.506206 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.506294 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.506552 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.506646 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.506870 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.507104 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.507398 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.507485 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.507766 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.507856 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.508089 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.508189 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.508424 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.508526 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.508756 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.508843 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.509065 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.509153 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.509375 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.509461 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.509681 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.509768 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.510013 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.510195 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.510336 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.510522 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.510635 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.510837 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.510957 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.511150 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.511277 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.511462 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.511627 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.511799 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.511942 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.512110 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.512264 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.512419 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.512583 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.512730 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.512902 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.513046 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.513223 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.513355 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.513542 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.513664 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.513865 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.513960 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.514221 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.514309 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.514558 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.514647 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.514889 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.514979 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.515218 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.515314 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.515533 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.515639 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.515897 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.515983 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.516220 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.516320 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.516544 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.516632 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.516854 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.516939 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.517169 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.517264 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.517490 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.517577 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.517820 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.517906 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.518134 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.518228 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.518444 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.518563 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.518861 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.518949 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.519175 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.519270 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.519499 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.519587 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.519846 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.519934 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.520158 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.520246 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.520484 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.520571 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.520802 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.520899 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.521113 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.521199 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.521436 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.521522 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.521750 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.521849 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.522083 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.522171 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.522426 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.522514 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.522759 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.522853 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.523078 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.523170 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.523384 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.523470 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.523721 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.523825 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.524035 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.524131 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.524351 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.524438 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.524672 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.524760 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.524987 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.525087 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.525294 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.525388 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.526121 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.526219 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.526462 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.526556 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.526773 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.526875 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.527082 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.527179 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.527389 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.527477 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.527724 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.527814 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.528036 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.528131 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.528341 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.528429 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.528649 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.528756 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.528955 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.529041 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.529260 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.529347 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.529567 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.529666 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.529873 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.529968 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.530183 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.530270 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.530487 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.530586 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.530794 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.530880 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.531097 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.531184 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.531401 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.531503 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.531732 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.531822 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.532068 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.532155 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.532403 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.532501 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.532720 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.532807 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.533042 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.533129 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.533352 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.533439 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.533679 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.533765 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.533987 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.534072 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.534311 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.534398 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.534634 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.534728 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.534951 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.535037 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.535260 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.535346 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.535593 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.535701 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.535930 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.536034 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.536245 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.536337 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.536559 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.536654 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.536871 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.537039 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.537181 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.537276 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.537492 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.537580 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.537817 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.537917 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.538131 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.538218 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.538436 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.538522 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.538763 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.538858 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.539078 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.539165 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.539402 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.539488 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.539741 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.539832 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.540054 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.540152 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.540384 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.540471 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.540698 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.540786 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.541010 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.541102 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.541928 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.542115 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.542231 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.542319 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.542547 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.542642 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.542864 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.542960 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.543179 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.543266 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.543507 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.543594 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.543868 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.543964 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.544195 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.544283 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.544522 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.544656 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.544872 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.544973 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.545188 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.545288 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.545531 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.545625 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.545862 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.545950 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.546179 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.546266 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.546494 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.546581 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.546743 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 03 02:22:11.546830 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:22:11.547037 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 03 02:22:11.569468 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG oslo_db.sqlalchemy.engines [None req-1314deac-32fe-4d84-98ea-0fd6a9a5ff7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102259) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 03 02:22:11.570774 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG oslo_db.sqlalchemy.engines [None req-4b022346-5abb-47fe-8242-a0620307816c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102260) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 03 02:22:11.633180 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.context [None req-1314deac-32fe-4d84-98ea-0fd6a9a5ff7e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),056eea21-8cd3-453b-8bc6-a26b173c51c8(cell1) {{(pid=102259) load_cells /opt/stack/nova/nova/context.py:464}} Mar 03 02:22:11.633890 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.context [None req-4b022346-5abb-47fe-8242-a0620307816c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),056eea21-8cd3-453b-8bc6-a26b173c51c8(cell1) {{(pid=102260) load_cells /opt/stack/nova/nova/context.py:464}} Mar 03 02:22:11.637439 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG oslo_concurrency.lockutils [None req-1314deac-32fe-4d84-98ea-0fd6a9a5ff7e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:22:11.638050 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG oslo_concurrency.lockutils [None req-4b022346-5abb-47fe-8242-a0620307816c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:22:11.639026 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG oslo_concurrency.lockutils [None req-1314deac-32fe-4d84-98ea-0fd6a9a5ff7e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:22:11.639658 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG oslo_concurrency.lockutils [None req-4b022346-5abb-47fe-8242-a0620307816c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:22:11.639883 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG oslo_concurrency.lockutils [None req-1314deac-32fe-4d84-98ea-0fd6a9a5ff7e None None] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:22:11.640464 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG oslo_concurrency.lockutils [None req-4b022346-5abb-47fe-8242-a0620307816c None None] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:22:11.641846 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG oslo_concurrency.lockutils [None req-1314deac-32fe-4d84-98ea-0fd6a9a5ff7e None None] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:22:11.642391 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG oslo_concurrency.lockutils [None req-4b022346-5abb-47fe-8242-a0620307816c None None] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:22:11.656627 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG oslo_db.sqlalchemy.engines [None req-1314deac-32fe-4d84-98ea-0fd6a9a5ff7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102259) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 03 02:22:11.659695 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG oslo_db.sqlalchemy.engines [None req-4b022346-5abb-47fe-8242-a0620307816c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102260) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 03 02:22:11.660192 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG oslo_db.sqlalchemy.engines [None req-1314deac-32fe-4d84-98ea-0fd6a9a5ff7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102259) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 03 02:22:11.663194 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG oslo_db.sqlalchemy.engines [None req-4b022346-5abb-47fe-8242-a0620307816c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102260) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 03 02:22:11.817334 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG oslo_db.sqlalchemy.engines [None req-1314deac-32fe-4d84-98ea-0fd6a9a5ff7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102259) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 03 02:22:11.820369 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG oslo_db.sqlalchemy.engines [None req-4b022346-5abb-47fe-8242-a0620307816c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102260) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 03 02:22:12.158895 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: WARNING keystonemiddleware.auth_token [None req-4b022346-5abb-47fe-8242-a0620307816c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 03 02:22:12.159543 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: WARNING keystonemiddleware.auth_token [None req-1314deac-32fe-4d84-98ea-0fd6a9a5ff7e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 03 02:22:12.165527 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: WARNING keystonemiddleware.auth_token [None req-4b022346-5abb-47fe-8242-a0620307816c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 03 02:22:12.166184 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: WARNING keystonemiddleware.auth_token [None req-1314deac-32fe-4d84-98ea-0fd6a9a5ff7e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 03 02:22:12.506404 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: WARNING keystonemiddleware.auth_token [None req-1314deac-32fe-4d84-98ea-0fd6a9a5ff7e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 03 02:22:12.509923 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: WARNING keystonemiddleware.auth_token [None req-4b022346-5abb-47fe-8242-a0620307816c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 03 02:22:12.512201 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: WARNING keystonemiddleware.auth_token [None req-1314deac-32fe-4d84-98ea-0fd6a9a5ff7e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 03 02:22:12.515848 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: WARNING keystonemiddleware.auth_token [None req-4b022346-5abb-47fe-8242-a0620307816c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 03 02:22:12.517337 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55af364799c0 pid: 102259 (default app) Mar 03 02:22:12.519402 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi [None req-1314deac-32fe-4d84-98ea-0fd6a9a5ff7e None None] Calling method '>' {{(pid=102259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:22:12.520619 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: INFO nova.api.openstack.requestlog [None req-1314deac-32fe-4d84-98ea-0fd6a9a5ff7e None None] 10.222.0.30 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001765 Mar 03 02:22:12.521032 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: [pid: 102259|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 788 bytes} [Thu Mar 3 02:22:12 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:22:12.521156 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55af364799c0 pid: 102260 (default app) Mar 03 02:23:33.691527 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi [None req-1314deac-32fe-4d84-98ea-0fd6a9a5ff7e None None] Calling method '>' {{(pid=102259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:23:33.692555 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: INFO nova.api.openstack.requestlog [None req-1314deac-32fe-4d84-98ea-0fd6a9a5ff7e None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Mar 03 02:23:33.692949 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: [pid: 102259|app: 0|req: 2/2] 10.222.0.30 () {54 vars in 930 bytes} [Thu Mar 3 02:23:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:23:34.144137 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi [None req-3e5565fc-0738-490e-8cb3-043b0aeade6b admin admin] Calling method '>' {{(pid=102260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:23:34.173161 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: INFO nova.api.openstack.requestlog [None req-3e5565fc-0738-490e-8cb3-043b0aeade6b admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.473014 Mar 03 02:23:34.174228 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: [pid: 102260|app: 0|req: 1/3] 10.222.0.30 () {60 vars in 1291 bytes} [Thu Mar 3 02:23:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:23:36.536941 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi [None req-1314deac-32fe-4d84-98ea-0fd6a9a5ff7e None None] Calling method '>' {{(pid=102259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:23:36.537936 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: INFO nova.api.openstack.requestlog [None req-1314deac-32fe-4d84-98ea-0fd6a9a5ff7e None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Mar 03 02:23:36.538379 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: [pid: 102259|app: 0|req: 3/4] 10.222.0.30 () {54 vars in 930 bytes} [Thu Mar 3 02:23:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:23:36.599289 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi [None req-82a1f6d1-9b3d-4191-82dc-b24e352bec51 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "name": "cirros256", "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "ram": 256, "os-flavor-access:is_public": true, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:23:36.619957 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 03 02:23:36.619957 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: warnings.warn(msg) Mar 03 02:23:36.649144 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: INFO nova.api.openstack.requestlog [None req-82a1f6d1-9b3d-4191-82dc-b24e352bec51 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.103993 Mar 03 02:23:36.649716 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: [pid: 102260|app: 0|req: 2/5] 10.222.0.30 () {64 vars in 1282 bytes} [Thu Mar 3 02:23:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:23:36.873578 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi [None req-2a7cc2f0-7e78-4462-b22b-c64a368ab155 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:23:36.875911 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 03 02:23:36.875911 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: warnings.warn(msg) Mar 03 02:23:36.923655 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: INFO nova.api.openstack.requestlog [None req-2a7cc2f0-7e78-4462-b22b-c64a368ab155 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.265931 Mar 03 02:23:36.924510 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: [pid: 102259|app: 0|req: 4/6] 10.222.0.30 () {64 vars in 1335 bytes} [Thu Mar 3 02:23:36 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:23:39.284586 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi [None req-82a1f6d1-9b3d-4191-82dc-b24e352bec51 admin admin] Calling method '>' {{(pid=102260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:23:39.285613 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: INFO nova.api.openstack.requestlog [None req-82a1f6d1-9b3d-4191-82dc-b24e352bec51 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Mar 03 02:23:39.286056 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: [pid: 102260|app: 0|req: 3/7] 10.222.0.30 () {54 vars in 930 bytes} [Thu Mar 3 02:23:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:23:39.393930 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi [None req-597feb28-4d89-482e-8bcc-f5b75fe9c29d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 5, "rxtx_factor": 1.0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "swap": 0, "id": "d1", "os-flavor-access:is_public": true}} {{(pid=102259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:23:39.414734 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 03 02:23:39.414734 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: warnings.warn(msg) Mar 03 02:23:39.438490 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: INFO nova.api.openstack.requestlog [None req-597feb28-4d89-482e-8bcc-f5b75fe9c29d admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.146163 Mar 03 02:23:39.439054 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: [pid: 102259|app: 0|req: 5/8] 10.222.0.30 () {64 vars in 1282 bytes} [Thu Mar 3 02:23:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:23:39.451558 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi [None req-272fe6ef-6d7c-40fc-bc30-064096e7daf0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:23:39.453188 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 03 02:23:39.453188 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: warnings.warn(msg) Mar 03 02:23:39.488822 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: INFO nova.api.openstack.requestlog [None req-272fe6ef-6d7c-40fc-bc30-064096e7daf0 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040965 Mar 03 02:23:39.490815 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: [pid: 102260|app: 0|req: 4/9] 10.222.0.30 () {64 vars in 1335 bytes} [Thu Mar 3 02:23:39 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:23:41.836697 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi [None req-597feb28-4d89-482e-8bcc-f5b75fe9c29d admin admin] Calling method '>' {{(pid=102259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:23:41.837724 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: INFO nova.api.openstack.requestlog [None req-597feb28-4d89-482e-8bcc-f5b75fe9c29d admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Mar 03 02:23:41.838128 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: [pid: 102259|app: 0|req: 6/10] 10.222.0.30 () {54 vars in 930 bytes} [Thu Mar 3 02:23:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:23:41.899552 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi [None req-57a6bfad-b4b8-49d2-98ed-2681ead1bb00 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d2", "disk": 10, "ram": 1024, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=102260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:23:41.919915 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: INFO nova.api.openstack.requestlog [None req-57a6bfad-b4b8-49d2-98ed-2681ead1bb00 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075710 Mar 03 02:23:41.926910 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: [pid: 102260|app: 0|req: 5/11] 10.222.0.30 () {64 vars in 1282 bytes} [Thu Mar 3 02:23:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:23:41.933373 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi [None req-7d7bdf26-53d4-4fd1-8175-419ab0392f70 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:23:41.956871 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: INFO nova.api.openstack.requestlog [None req-7d7bdf26-53d4-4fd1-8175-419ab0392f70 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027824 Mar 03 02:23:41.957885 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: [pid: 102259|app: 0|req: 7/12] 10.222.0.30 () {64 vars in 1335 bytes} [Thu Mar 3 02:23:41 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:23:44.324234 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi [None req-57a6bfad-b4b8-49d2-98ed-2681ead1bb00 admin admin] Calling method '>' {{(pid=102260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:23:44.325465 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: INFO nova.api.openstack.requestlog [None req-57a6bfad-b4b8-49d2-98ed-2681ead1bb00 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001704 Mar 03 02:23:44.325953 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: [pid: 102260|app: 0|req: 6/13] 10.222.0.30 () {54 vars in 930 bytes} [Thu Mar 3 02:23:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:23:44.387387 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi [None req-828547c5-dc1e-4ec3-bdbb-b7783b0277ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "swap": 0, "id": "d3", "os-flavor-access:is_public": true, "vcpus": 2, "disk": 10, "rxtx_factor": 1.0, "ram": 2048}} {{(pid=102259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:23:44.406818 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: INFO nova.api.openstack.requestlog [None req-828547c5-dc1e-4ec3-bdbb-b7783b0277ad admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074455 Mar 03 02:23:44.407391 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: [pid: 102259|app: 0|req: 8/14] 10.222.0.30 () {64 vars in 1282 bytes} [Thu Mar 3 02:23:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:23:44.419928 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi [None req-e0e72241-a566-48d6-9088-958bfe6c2421 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:23:44.441811 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: INFO nova.api.openstack.requestlog [None req-e0e72241-a566-48d6-9088-958bfe6c2421 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025588 Mar 03 02:23:44.442395 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: [pid: 102260|app: 0|req: 7/15] 10.222.0.30 () {64 vars in 1335 bytes} [Thu Mar 3 02:23:44 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:23:46.809254 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi [None req-828547c5-dc1e-4ec3-bdbb-b7783b0277ad admin admin] Calling method '>' {{(pid=102259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:23:46.810265 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: INFO nova.api.openstack.requestlog [None req-828547c5-dc1e-4ec3-bdbb-b7783b0277ad admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Mar 03 02:23:46.810664 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: [pid: 102259|app: 0|req: 9/16] 10.222.0.30 () {54 vars in 930 bytes} [Thu Mar 3 02:23:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:23:46.869463 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi [None req-81d4d4bc-aaa8-435d-a900-9878dbec0f46 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "swap": 0, "os-flavor-access:is_public": true, "disk": 20, "vcpus": 4, "id": "d4"}} {{(pid=102260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:23:46.886998 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: INFO nova.api.openstack.requestlog [None req-81d4d4bc-aaa8-435d-a900-9878dbec0f46 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070644 Mar 03 02:23:46.887775 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: [pid: 102260|app: 0|req: 8/17] 10.222.0.30 () {64 vars in 1282 bytes} [Thu Mar 3 02:23:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:23:46.899435 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi [None req-316beeba-2eae-486a-bccf-5c50935e0466 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:23:46.921498 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: INFO nova.api.openstack.requestlog [None req-316beeba-2eae-486a-bccf-5c50935e0466 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026203 Mar 03 02:23:46.922046 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: [pid: 102259|app: 0|req: 10/18] 10.222.0.30 () {64 vars in 1335 bytes} [Thu Mar 3 02:23:46 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:23:49.275396 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi [None req-81d4d4bc-aaa8-435d-a900-9878dbec0f46 admin admin] Calling method '>' {{(pid=102260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:23:49.277065 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: INFO nova.api.openstack.requestlog [None req-81d4d4bc-aaa8-435d-a900-9878dbec0f46 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002079 Mar 03 02:23:49.277473 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: [pid: 102260|app: 0|req: 9/19] 10.222.0.30 () {54 vars in 930 bytes} [Thu Mar 3 02:23:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:23:49.343774 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi [None req-61c4097f-6073-4c6c-80e9-2a5a81bb3b1c admin admin] Calling method '>' {{(pid=102259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:23:49.368391 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: INFO nova.api.openstack.requestlog [None req-61c4097f-6073-4c6c-80e9-2a5a81bb3b1c admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.085119 Mar 03 02:23:49.368951 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: [pid: 102259|app: 0|req: 11/20] 10.222.0.30 () {60 vars in 1291 bytes} [Thu Mar 3 02:23:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:23:51.782240 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi [None req-81d4d4bc-aaa8-435d-a900-9878dbec0f46 admin admin] Calling method '>' {{(pid=102260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:23:51.783301 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: INFO nova.api.openstack.requestlog [None req-81d4d4bc-aaa8-435d-a900-9878dbec0f46 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Mar 03 02:23:51.783785 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: [pid: 102260|app: 0|req: 10/21] 10.222.0.30 () {54 vars in 930 bytes} [Thu Mar 3 02:23:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:23:51.862445 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi [None req-f33e38d2-879e-4f74-8bea-49825dbd7349 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "rxtx_factor": 1.0, "id": "1", "vcpus": 1, "os-flavor-access:is_public": true, "disk": 1, "ram": 512, "swap": 0}} {{(pid=102259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:23:51.880505 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: INFO nova.api.openstack.requestlog [None req-f33e38d2-879e-4f74-8bea-49825dbd7349 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.089662 Mar 03 02:23:51.881050 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: [pid: 102259|app: 0|req: 12/22] 10.222.0.30 () {64 vars in 1282 bytes} [Thu Mar 3 02:23:51 2022] POST /compute/v2.1/flavors => generated 402 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:23:51.893865 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi [None req-dca602d3-d1a7-4c6c-bf61-eeca0cea749c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:23:51.916362 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: INFO nova.api.openstack.requestlog [None req-dca602d3-d1a7-4c6c-bf61-eeca0cea749c admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026320 Mar 03 02:23:51.916955 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: [pid: 102260|app: 0|req: 11/23] 10.222.0.30 () {64 vars in 1332 bytes} [Thu Mar 3 02:23:51 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:23:54.491540 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi [None req-f33e38d2-879e-4f74-8bea-49825dbd7349 admin admin] Calling method '>' {{(pid=102259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:23:54.492596 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: INFO nova.api.openstack.requestlog [None req-f33e38d2-879e-4f74-8bea-49825dbd7349 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001654 Mar 03 02:23:54.493030 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: [pid: 102259|app: 0|req: 13/24] 10.222.0.30 () {54 vars in 930 bytes} [Thu Mar 3 02:23:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:23:54.556586 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi [None req-cb3c4dd6-7c1b-460e-9b4c-0d84d1b64505 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "disk": 20, "rxtx_factor": 1.0, "id": "2", "ram": 2048, "os-flavor-access:is_public": true, "name": "m1.small"}} {{(pid=102260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:23:54.576316 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: INFO nova.api.openstack.requestlog [None req-cb3c4dd6-7c1b-460e-9b4c-0d84d1b64505 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.077200 Mar 03 02:23:54.576904 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: [pid: 102260|app: 0|req: 12/25] 10.222.0.30 () {64 vars in 1282 bytes} [Thu Mar 3 02:23:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:23:54.589107 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi [None req-50f832a4-9f26-4022-b42e-2dca016b1ff3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:23:54.611764 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: INFO nova.api.openstack.requestlog [None req-50f832a4-9f26-4022-b42e-2dca016b1ff3 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026564 Mar 03 02:23:54.612247 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: [pid: 102259|app: 0|req: 14/26] 10.222.0.30 () {64 vars in 1332 bytes} [Thu Mar 3 02:23:54 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:23:57.042953 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi [None req-cb3c4dd6-7c1b-460e-9b4c-0d84d1b64505 admin admin] Calling method '>' {{(pid=102260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:23:57.044049 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: INFO nova.api.openstack.requestlog [None req-cb3c4dd6-7c1b-460e-9b4c-0d84d1b64505 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Mar 03 02:23:57.044455 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: [pid: 102260|app: 0|req: 13/27] 10.222.0.30 () {54 vars in 930 bytes} [Thu Mar 3 02:23:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:23:57.102151 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi [None req-98b29bbe-620e-4a25-a7dd-3b50588f3ecc admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "disk": 40, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "vcpus": 2, "id": "3"}} {{(pid=102259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:23:57.119939 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: INFO nova.api.openstack.requestlog [None req-98b29bbe-620e-4a25-a7dd-3b50588f3ecc admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.069026 Mar 03 02:23:57.120797 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: [pid: 102259|app: 0|req: 15/28] 10.222.0.30 () {64 vars in 1282 bytes} [Thu Mar 3 02:23:57 2022] POST /compute/v2.1/flavors => generated 406 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 03 02:23:57.133035 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi [None req-3f214844-0905-48de-aaa5-ed986aa19f7d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:23:57.154261 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: INFO nova.api.openstack.requestlog [None req-3f214844-0905-48de-aaa5-ed986aa19f7d admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025673 Mar 03 02:23:57.154813 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: [pid: 102260|app: 0|req: 14/29] 10.222.0.30 () {64 vars in 1332 bytes} [Thu Mar 3 02:23:57 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:23:59.489537 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi [None req-98b29bbe-620e-4a25-a7dd-3b50588f3ecc admin admin] Calling method '>' {{(pid=102259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:23:59.490521 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: INFO nova.api.openstack.requestlog [None req-98b29bbe-620e-4a25-a7dd-3b50588f3ecc admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Mar 03 02:23:59.491874 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: [pid: 102259|app: 0|req: 16/30] 10.222.0.30 () {54 vars in 930 bytes} [Thu Mar 3 02:23:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:23:59.550699 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi [None req-cd5c9218-4cf2-48f5-b553-60f5dd49a578 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "4", "rxtx_factor": 1.0, "name": "m1.large", "disk": 80, "vcpus": 4, "ram": 8192}} {{(pid=102260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:23:59.568695 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: INFO nova.api.openstack.requestlog [None req-cd5c9218-4cf2-48f5-b553-60f5dd49a578 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071356 Mar 03 02:23:59.570487 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: [pid: 102260|app: 0|req: 15/31] 10.222.0.30 () {64 vars in 1282 bytes} [Thu Mar 3 02:23:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:23:59.581948 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi [None req-1fed2569-3d1f-478b-9be8-f82fc3d78b1c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:23:59.603798 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: INFO nova.api.openstack.requestlog [None req-1fed2569-3d1f-478b-9be8-f82fc3d78b1c admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025751 Mar 03 02:23:59.604578 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: [pid: 102259|app: 0|req: 17/32] 10.222.0.30 () {64 vars in 1332 bytes} [Thu Mar 3 02:23:59 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:24:01.983178 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi [None req-cd5c9218-4cf2-48f5-b553-60f5dd49a578 admin admin] Calling method '>' {{(pid=102260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:24:01.984235 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: INFO nova.api.openstack.requestlog [None req-cd5c9218-4cf2-48f5-b553-60f5dd49a578 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Mar 03 02:24:01.984639 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: [pid: 102260|app: 0|req: 16/33] 10.222.0.30 () {54 vars in 930 bytes} [Thu Mar 3 02:24:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:24:02.045661 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi [None req-11fff504-f3be-434f-a67c-ad6bb8f57583 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "ram": 16384, "vcpus": 8, "disk": 160, "rxtx_factor": 1.0, "name": "m1.xlarge"}} {{(pid=102259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:24:02.067782 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: INFO nova.api.openstack.requestlog [None req-11fff504-f3be-434f-a67c-ad6bb8f57583 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.077476 Mar 03 02:24:02.068568 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: [pid: 102259|app: 0|req: 18/34] 10.222.0.30 () {64 vars in 1282 bytes} [Thu Mar 3 02:24:01 2022] POST /compute/v2.1/flavors => generated 408 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:24:02.083817 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi [None req-40e0ce32-1d9e-450d-9896-316c925f3862 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:24:02.110939 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: INFO nova.api.openstack.requestlog [None req-40e0ce32-1d9e-450d-9896-316c925f3862 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030843 Mar 03 02:24:02.111642 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: [pid: 102260|app: 0|req: 17/35] 10.222.0.30 () {64 vars in 1332 bytes} [Thu Mar 3 02:24:02 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:24:25.913981 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi [None req-11fff504-f3be-434f-a67c-ad6bb8f57583 admin admin] Calling method '>' {{(pid=102259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:24:25.915011 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: INFO nova.api.openstack.requestlog [None req-11fff504-f3be-434f-a67c-ad6bb8f57583 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Mar 03 02:24:25.915399 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: [pid: 102259|app: 0|req: 19/36] 10.222.0.30 () {54 vars in 930 bytes} [Thu Mar 3 02:24:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:24:25.970667 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi [None req-4bc870fd-18ca-4c12-88f3-b3ee9756f90b admin admin] Calling method '>' {{(pid=102260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:24:25.992129 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: INFO nova.api.openstack.requestlog [None req-4bc870fd-18ca-4c12-88f3-b3ee9756f90b admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.066695 Mar 03 02:24:25.992667 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: [pid: 102260|app: 0|req: 18/37] 10.222.0.30 () {60 vars in 1291 bytes} [Thu Mar 3 02:24:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:24:27.369028 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi [None req-11fff504-f3be-434f-a67c-ad6bb8f57583 admin admin] Calling method '>' {{(pid=102259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:24:27.370027 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: INFO nova.api.openstack.requestlog [None req-11fff504-f3be-434f-a67c-ad6bb8f57583 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Mar 03 02:24:27.370418 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: [pid: 102259|app: 0|req: 20/38] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Mar 3 02:24:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:24:27.583516 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi [None req-f00f30bb-11d2-4d70-a97c-7cf433925662 admin admin] Calling method '>' {{(pid=102260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:24:27.589676 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: INFO nova.api.openstack.wsgi [None req-f00f30bb-11d2-4d70-a97c-7cf433925662 admin admin] HTTP exception thrown: Flavor 42 could not be found. Mar 03 02:24:27.590246 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi [None req-f00f30bb-11d2-4d70-a97c-7cf433925662 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:24:27.591048 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: INFO nova.api.openstack.requestlog [None req-f00f30bb-11d2-4d70-a97c-7cf433925662 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.058672 Mar 03 02:24:27.591572 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: [pid: 102260|app: 0|req: 19/39] 10.222.0.30 () {60 vars in 1190 bytes} [Thu Mar 3 02:24:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 03 02:24:27.600953 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi [None req-8e359453-8cd5-4bd4-99e5-21d03d72b78a admin admin] Calling method '>' {{(pid=102259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:24:27.621005 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: INFO nova.api.openstack.requestlog [None req-8e359453-8cd5-4bd4-99e5-21d03d72b78a admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023731 Mar 03 02:24:27.621527 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: [pid: 102259|app: 0|req: 21/40] 10.222.0.30 () {60 vars in 1210 bytes} [Thu Mar 3 02:24:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:24:27.631779 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi [None req-3e162bad-20eb-4e52-b4bb-01aa2e256008 admin admin] Calling method '>' {{(pid=102260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:24:27.652980 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: INFO nova.api.openstack.requestlog [None req-3e162bad-20eb-4e52-b4bb-01aa2e256008 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025419 Mar 03 02:24:27.653514 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: [pid: 102260|app: 0|req: 20/41] 10.222.0.30 () {60 vars in 1210 bytes} [Thu Mar 3 02:24:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:24:27.662725 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi [None req-f48f8653-33e4-44ff-a98b-8a4ab8e3bf51 admin admin] Calling method '>' {{(pid=102259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:24:27.668113 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: INFO nova.api.openstack.wsgi [None req-f48f8653-33e4-44ff-a98b-8a4ab8e3bf51 admin admin] HTTP exception thrown: Flavor 42 could not be found. Mar 03 02:24:27.668670 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi [None req-f48f8653-33e4-44ff-a98b-8a4ab8e3bf51 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:24:27.669443 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: INFO nova.api.openstack.requestlog [None req-f48f8653-33e4-44ff-a98b-8a4ab8e3bf51 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010366 Mar 03 02:24:27.669927 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: [pid: 102259|app: 0|req: 22/42] 10.222.0.30 () {60 vars in 1190 bytes} [Thu Mar 3 02:24:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Mar 03 02:24:28.948541 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi [None req-3e162bad-20eb-4e52-b4bb-01aa2e256008 admin admin] Calling method '>' {{(pid=102260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:24:28.949562 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: INFO nova.api.openstack.requestlog [None req-3e162bad-20eb-4e52-b4bb-01aa2e256008 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Mar 03 02:24:28.949939 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: [pid: 102260|app: 0|req: 21/43] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Mar 3 02:24:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:24:29.138737 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi [None req-d4e424d5-0a4c-457e-9bbc-48bc4ed6d2a7 admin admin] Calling method '>' {{(pid=102259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:24:29.143831 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: INFO nova.api.openstack.wsgi [None req-d4e424d5-0a4c-457e-9bbc-48bc4ed6d2a7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Mar 03 02:24:29.144390 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi [None req-d4e424d5-0a4c-457e-9bbc-48bc4ed6d2a7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:24:29.145170 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: INFO nova.api.openstack.requestlog [None req-d4e424d5-0a4c-457e-9bbc-48bc4ed6d2a7 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.057116 Mar 03 02:24:29.145676 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: [pid: 102259|app: 0|req: 23/44] 10.222.0.30 () {60 vars in 1190 bytes} [Thu Mar 3 02:24:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 03 02:24:29.155462 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi [None req-2dd00d7a-a995-4d45-abaa-7b520d098b46 admin admin] Calling method '>' {{(pid=102260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:24:29.168826 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: INFO nova.api.openstack.requestlog [None req-2dd00d7a-a995-4d45-abaa-7b520d098b46 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016899 Mar 03 02:24:29.169282 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: [pid: 102260|app: 0|req: 22/45] 10.222.0.30 () {60 vars in 1210 bytes} [Thu Mar 3 02:24:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:24:29.178377 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi [None req-01bd8f36-7a66-4c6a-9610-f62ff31de4a7 admin admin] Calling method '>' {{(pid=102259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:24:29.191587 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: INFO nova.api.openstack.requestlog [None req-01bd8f36-7a66-4c6a-9610-f62ff31de4a7 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016715 Mar 03 02:24:29.192140 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: [pid: 102259|app: 0|req: 24/46] 10.222.0.30 () {60 vars in 1210 bytes} [Thu Mar 3 02:24:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:24:29.201868 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi [None req-d230cc6d-2c5b-4dc0-bd68-da98a8715024 admin admin] Calling method '>' {{(pid=102260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:24:29.207023 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: INFO nova.api.openstack.wsgi [None req-d230cc6d-2c5b-4dc0-bd68-da98a8715024 admin admin] HTTP exception thrown: Flavor 84 could not be found. Mar 03 02:24:29.207688 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi [None req-d230cc6d-2c5b-4dc0-bd68-da98a8715024 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:24:29.208501 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: INFO nova.api.openstack.requestlog [None req-d230cc6d-2c5b-4dc0-bd68-da98a8715024 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010256 Mar 03 02:24:29.209597 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: [pid: 102260|app: 0|req: 23/47] 10.222.0.30 () {60 vars in 1190 bytes} [Thu Mar 3 02:24:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Mar 03 02:24:30.469221 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi [None req-01bd8f36-7a66-4c6a-9610-f62ff31de4a7 admin admin] Calling method '>' {{(pid=102259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:24:30.470215 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: INFO nova.api.openstack.requestlog [None req-01bd8f36-7a66-4c6a-9610-f62ff31de4a7 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Mar 03 02:24:30.470609 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: [pid: 102259|app: 0|req: 25/48] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Mar 3 02:24:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:24:30.657973 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi [None req-9ad39b29-48cd-496b-9a50-e9962ba0430f admin admin] Calling method '>' {{(pid=102260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:24:30.663326 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: INFO nova.api.openstack.wsgi [None req-9ad39b29-48cd-496b-9a50-e9962ba0430f admin admin] HTTP exception thrown: Flavor 451 could not be found. Mar 03 02:24:30.663916 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi [None req-9ad39b29-48cd-496b-9a50-e9962ba0430f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:24:30.664694 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: INFO nova.api.openstack.requestlog [None req-9ad39b29-48cd-496b-9a50-e9962ba0430f admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057410 Mar 03 02:24:30.665197 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: [pid: 102260|app: 0|req: 24/49] 10.222.0.30 () {60 vars in 1193 bytes} [Thu Mar 3 02:24:30 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 03 02:24:30.674559 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi [None req-ad404cd0-3d82-4c36-8e33-2de5785b3f16 admin admin] Calling method '>' {{(pid=102259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:24:30.688405 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: INFO nova.api.openstack.requestlog [None req-ad404cd0-3d82-4c36-8e33-2de5785b3f16 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017398 Mar 03 02:24:30.688928 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: [pid: 102259|app: 0|req: 26/50] 10.222.0.30 () {60 vars in 1210 bytes} [Thu Mar 3 02:24:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:24:30.700387 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi [None req-6cdbb3f8-9c2a-49ed-81cc-c66f743cf0ac admin admin] Calling method '>' {{(pid=102260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:24:30.713796 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: INFO nova.api.openstack.requestlog [None req-6cdbb3f8-9c2a-49ed-81cc-c66f743cf0ac admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018663 Mar 03 02:24:30.714330 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: [pid: 102260|app: 0|req: 25/51] 10.222.0.30 () {60 vars in 1210 bytes} [Thu Mar 3 02:24:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:24:30.723389 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi [None req-66e7657a-6e3b-41a2-833a-d9b663db73c6 admin admin] Calling method '>' {{(pid=102259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:24:30.728694 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: INFO nova.api.openstack.wsgi [None req-66e7657a-6e3b-41a2-833a-d9b663db73c6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Mar 03 02:24:30.729248 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi [None req-66e7657a-6e3b-41a2-833a-d9b663db73c6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:24:30.730020 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: INFO nova.api.openstack.requestlog [None req-66e7657a-6e3b-41a2-833a-d9b663db73c6 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010206 Mar 03 02:24:30.730502 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: [pid: 102259|app: 0|req: 27/52] 10.222.0.30 () {60 vars in 1193 bytes} [Thu Mar 3 02:24:30 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 03 02:24:31.997145 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi [None req-6cdbb3f8-9c2a-49ed-81cc-c66f743cf0ac admin admin] Calling method '>' {{(pid=102260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:24:31.998235 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: INFO nova.api.openstack.requestlog [None req-6cdbb3f8-9c2a-49ed-81cc-c66f743cf0ac admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Mar 03 02:24:31.998732 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: [pid: 102260|app: 0|req: 26/53] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Mar 3 02:24:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:24:32.201683 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi [None req-82543b07-77bd-4fdb-9c78-151620e579f3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:24:32.220596 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: INFO nova.api.openstack.requestlog [None req-82543b07-77bd-4fdb-9c78-151620e579f3 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.074735 Mar 03 02:24:32.221052 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: [pid: 102259|app: 0|req: 28/54] 10.222.0.30 () {64 vars in 1235 bytes} [Thu Mar 3 02:24:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:24:33.478517 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi [None req-6cdbb3f8-9c2a-49ed-81cc-c66f743cf0ac admin admin] Calling method '>' {{(pid=102260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:24:33.479515 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: INFO nova.api.openstack.requestlog [None req-6cdbb3f8-9c2a-49ed-81cc-c66f743cf0ac admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Mar 03 02:24:33.479944 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: [pid: 102260|app: 0|req: 27/55] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Mar 3 02:24:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:24:33.670200 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi [None req-ef029ad7-dd9e-4d6b-b7ef-f7bfc40a82a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:24:33.687570 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: INFO nova.api.openstack.requestlog [None req-ef029ad7-dd9e-4d6b-b7ef-f7bfc40a82a4 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068217 Mar 03 02:24:33.688136 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: [pid: 102259|app: 0|req: 29/56] 10.222.0.30 () {64 vars in 1235 bytes} [Thu Mar 3 02:24:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:24:34.990939 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi [None req-6cdbb3f8-9c2a-49ed-81cc-c66f743cf0ac admin admin] Calling method '>' {{(pid=102260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:24:34.991931 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: INFO nova.api.openstack.requestlog [None req-6cdbb3f8-9c2a-49ed-81cc-c66f743cf0ac admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Mar 03 02:24:34.992333 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: [pid: 102260|app: 0|req: 28/57] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Mar 3 02:24:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:24:35.182615 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi [None req-f0d67fee-2c2a-4d12-971f-b248918e7454 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:24:35.199748 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: INFO nova.api.openstack.requestlog [None req-f0d67fee-2c2a-4d12-971f-b248918e7454 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068201 Mar 03 02:24:35.200279 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: [pid: 102259|app: 0|req: 30/58] 10.222.0.30 () {64 vars in 1235 bytes} [Thu Mar 3 02:24:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 03 02:24:36.473565 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi [None req-6cdbb3f8-9c2a-49ed-81cc-c66f743cf0ac admin admin] Calling method '>' {{(pid=102260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:24:36.475318 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: INFO nova.api.openstack.requestlog [None req-6cdbb3f8-9c2a-49ed-81cc-c66f743cf0ac admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002041 Mar 03 02:24:36.475740 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: [pid: 102260|app: 0|req: 29/59] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Mar 3 02:24:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:24:36.664243 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi [None req-8395657e-79fd-48d4-81fd-064269ddcc40 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:24:36.681826 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: INFO nova.api.openstack.requestlog [None req-8395657e-79fd-48d4-81fd-064269ddcc40 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068607 Mar 03 02:24:36.682366 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: [pid: 102259|app: 0|req: 31/60] 10.222.0.30 () {64 vars in 1235 bytes} [Thu Mar 3 02:24:36 2022] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:24:37.959098 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi [None req-6cdbb3f8-9c2a-49ed-81cc-c66f743cf0ac admin admin] Calling method '>' {{(pid=102260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:24:37.960126 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: INFO nova.api.openstack.requestlog [None req-6cdbb3f8-9c2a-49ed-81cc-c66f743cf0ac admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Mar 03 02:24:37.960521 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: [pid: 102260|app: 0|req: 30/61] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Mar 3 02:24:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:24:38.149158 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi [None req-f70e331b-a793-426a-923e-e6bd3d5c2ece admin admin] Calling method '>' {{(pid=102259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:24:38.168309 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: INFO nova.api.openstack.requestlog [None req-f70e331b-a793-426a-923e-e6bd3d5c2ece admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070100 Mar 03 02:24:38.168762 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: [pid: 102259|app: 0|req: 32/62] 10.222.0.30 () {60 vars in 1202 bytes} [Thu Mar 3 02:24:38 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:25:28.804143 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi [None req-6cdbb3f8-9c2a-49ed-81cc-c66f743cf0ac admin admin] Calling method '>' {{(pid=102260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:25:28.805199 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: INFO nova.api.openstack.requestlog [None req-6cdbb3f8-9c2a-49ed-81cc-c66f743cf0ac admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Mar 03 02:25:28.805602 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: [pid: 102260|app: 0|req: 31/63] 10.222.0.30 () {54 vars in 930 bytes} [Thu Mar 3 02:25:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:25:28.861539 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi [None req-7a2ebccc-a458-4d0b-8f5a-e91640c5d19b admin admin] Calling method '>' {{(pid=102259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:25:28.880503 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: INFO nova.api.openstack.requestlog [None req-7a2ebccc-a458-4d0b-8f5a-e91640c5d19b admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069441 Mar 03 02:25:28.881034 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: [pid: 102259|app: 0|req: 33/64] 10.222.0.30 () {60 vars in 1291 bytes} [Thu Mar 3 02:25:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:25:28.902816 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi [None req-c86a2e6e-ec58-4a46-8959-547158046a0d admin admin] Calling method '>' {{(pid=102260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:25:28.910828 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: INFO nova.api.openstack.requestlog [None req-c86a2e6e-ec58-4a46-8959-547158046a0d admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011668 Mar 03 02:25:28.911340 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: [pid: 102260|app: 0|req: 32/65] 10.222.0.30 () {60 vars in 1282 bytes} [Thu Mar 3 02:25:28 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:25:28.922258 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi [None req-a2370784-de0e-45e9-8897-33f0ac009d5f admin admin] Calling method '>' {{(pid=102259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:25:28.929598 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: INFO nova.api.openstack.requestlog [None req-a2370784-de0e-45e9-8897-33f0ac009d5f admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010890 Mar 03 02:25:28.930105 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: [pid: 102259|app: 0|req: 34/66] 10.222.0.30 () {60 vars in 1285 bytes} [Thu Mar 3 02:25:28 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:25:28.940690 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi [None req-9fbd7f7c-f31c-4ca0-a53e-4b25087e2bab admin admin] Calling method '>' {{(pid=102260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:25:28.948096 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: INFO nova.api.openstack.requestlog [None req-9fbd7f7c-f31c-4ca0-a53e-4b25087e2bab admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010912 Mar 03 02:25:28.948611 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: [pid: 102260|app: 0|req: 33/67] 10.222.0.30 () {60 vars in 1285 bytes} [Thu Mar 3 02:25:28 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:25:28.959525 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi [None req-0f0fa5c3-5d49-4680-b49a-70a99a6fefdd admin admin] Calling method '>' {{(pid=102259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:25:28.966604 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: INFO nova.api.openstack.requestlog [None req-0f0fa5c3-5d49-4680-b49a-70a99a6fefdd admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010971 Mar 03 02:25:28.967100 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: [pid: 102259|app: 0|req: 35/68] 10.222.0.30 () {60 vars in 1282 bytes} [Thu Mar 3 02:25:28 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:27:04.301694 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi [None req-d827c5c9-b872-4f05-b4ab-549ed6a50dfc tempest-verify_tempest_config-1635113107 tempest-verify_tempest_config-1635113107-project] Calling method '>' {{(pid=102260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:27:04.303673 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: INFO nova.api.openstack.requestlog [None req-d827c5c9-b872-4f05-b4ab-549ed6a50dfc tempest-verify_tempest_config-1635113107 tempest-verify_tempest_config-1635113107-project] 10.222.0.30 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.103970 Mar 03 02:27:04.304205 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: [pid: 102260|app: 0|req: 34/69] 10.222.0.30 () {58 vars in 1133 bytes} [Thu Mar 3 02:27:04 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:28:39.365568 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi [None req-0f0fa5c3-5d49-4680-b49a-70a99a6fefdd admin admin] Calling method '>' {{(pid=102259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:28:39.366704 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: INFO nova.api.openstack.requestlog [None req-0f0fa5c3-5d49-4680-b49a-70a99a6fefdd admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002596 Mar 03 02:28:39.367266 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: [pid: 102259|app: 0|req: 36/70] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Mar 3 02:28:39 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:28:39.620373 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi [None req-cf0b6a7a-0f59-4ff9-a7b3-e7ed5827aff4 admin admin] Calling method '>' {{(pid=102260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:28:39.621563 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 03 02:28:39.621563 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: warnings.warn(msg) Mar 03 02:28:39.623023 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG oslo_concurrency.lockutils [None req-cf0b6a7a-0f59-4ff9-a7b3-e7ed5827aff4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:28:39.623462 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG oslo_concurrency.lockutils [None req-cf0b6a7a-0f59-4ff9-a7b3-e7ed5827aff4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:28:39.624283 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG oslo_concurrency.lockutils [None req-cf0b6a7a-0f59-4ff9-a7b3-e7ed5827aff4 admin admin] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:28:39.624712 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG oslo_concurrency.lockutils [None req-cf0b6a7a-0f59-4ff9-a7b3-e7ed5827aff4 admin admin] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:28:39.656660 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: INFO nova.api.openstack.requestlog [None req-cf0b6a7a-0f59-4ff9-a7b3-e7ed5827aff4 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.146431 Mar 03 02:28:39.657208 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: [pid: 102260|app: 0|req: 35/71] 10.222.0.30 () {60 vars in 1193 bytes} [Thu Mar 3 02:28:39 2022] GET /compute/v2.1/os-services => generated 791 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:28:40.944044 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi [None req-0f0fa5c3-5d49-4680-b49a-70a99a6fefdd admin admin] Calling method '>' {{(pid=102259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:28:40.945076 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: INFO nova.api.openstack.requestlog [None req-0f0fa5c3-5d49-4680-b49a-70a99a6fefdd admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Mar 03 02:28:40.945470 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: [pid: 102259|app: 0|req: 37/72] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Mar 3 02:28:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:28:41.135868 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi [None req-8d4b137b-39a5-4247-9881-9cee5db3fad3 admin admin] Calling method '>' {{(pid=102260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:28:41.137034 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 03 02:28:41.137034 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: warnings.warn(msg) Mar 03 02:28:41.138225 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG oslo_concurrency.lockutils [None req-8d4b137b-39a5-4247-9881-9cee5db3fad3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:28:41.138670 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG oslo_concurrency.lockutils [None req-8d4b137b-39a5-4247-9881-9cee5db3fad3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:28:41.139466 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG oslo_concurrency.lockutils [None req-8d4b137b-39a5-4247-9881-9cee5db3fad3 admin admin] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:28:41.139927 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG oslo_concurrency.lockutils [None req-8d4b137b-39a5-4247-9881-9cee5db3fad3 admin admin] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:28:41.158980 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: INFO nova.api.openstack.requestlog [None req-8d4b137b-39a5-4247-9881-9cee5db3fad3 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074669 Mar 03 02:28:41.159455 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: [pid: 102260|app: 0|req: 36/73] 10.222.0.30 () {60 vars in 1193 bytes} [Thu Mar 3 02:28:41 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:28:52.881870 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi [None req-0f0fa5c3-5d49-4680-b49a-70a99a6fefdd admin admin] Calling method '>' {{(pid=102259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:28:52.882887 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: INFO nova.api.openstack.requestlog [None req-0f0fa5c3-5d49-4680-b49a-70a99a6fefdd admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Mar 03 02:28:52.883322 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: [pid: 102259|app: 0|req: 38/74] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Mar 3 02:28:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:28:53.076290 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi [None req-8e61ed1d-8795-49f0-823c-d461c92cdf1a admin admin] Calling method '>' {{(pid=102260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:28:53.077472 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 03 02:28:53.077472 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: warnings.warn(msg) Mar 03 02:28:53.078679 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG oslo_concurrency.lockutils [None req-8e61ed1d-8795-49f0-823c-d461c92cdf1a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:28:53.079119 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG oslo_concurrency.lockutils [None req-8e61ed1d-8795-49f0-823c-d461c92cdf1a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:28:53.080708 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG oslo_concurrency.lockutils [None req-8e61ed1d-8795-49f0-823c-d461c92cdf1a admin admin] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:28:53.081143 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG oslo_concurrency.lockutils [None req-8e61ed1d-8795-49f0-823c-d461c92cdf1a admin admin] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:28:53.104993 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: INFO nova.api.openstack.requestlog [None req-8e61ed1d-8795-49f0-823c-d461c92cdf1a admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080319 Mar 03 02:28:53.105483 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: [pid: 102260|app: 0|req: 37/75] 10.222.0.30 () {60 vars in 1193 bytes} [Thu Mar 3 02:28:53 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:28:54.393808 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: DEBUG nova.api.openstack.wsgi [None req-0f0fa5c3-5d49-4680-b49a-70a99a6fefdd admin admin] Calling method '>' {{(pid=102259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:28:54.394901 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: INFO nova.api.openstack.requestlog [None req-0f0fa5c3-5d49-4680-b49a-70a99a6fefdd admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Mar 03 02:28:54.395305 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: [pid: 102259|app: 0|req: 39/76] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Mar 3 02:28:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:28:54.586274 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG nova.api.openstack.wsgi [None req-42c113ac-bbd1-480e-837b-3572ed438114 admin admin] Calling method '>' {{(pid=102260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:28:54.587428 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 03 02:28:54.587428 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: warnings.warn(msg) Mar 03 02:28:54.588685 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG oslo_concurrency.lockutils [None req-42c113ac-bbd1-480e-837b-3572ed438114 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:28:54.589099 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG oslo_concurrency.lockutils [None req-42c113ac-bbd1-480e-837b-3572ed438114 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:28:54.589939 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG oslo_concurrency.lockutils [None req-42c113ac-bbd1-480e-837b-3572ed438114 admin admin] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:28:54.590363 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: DEBUG oslo_concurrency.lockutils [None req-42c113ac-bbd1-480e-837b-3572ed438114 admin admin] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:28:54.612014 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: INFO nova.api.openstack.requestlog [None req-42c113ac-bbd1-480e-837b-3572ed438114 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.075652 Mar 03 02:28:54.612489 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: [pid: 102260|app: 0|req: 38/77] 10.222.0.30 () {60 vars in 1193 bytes} [Thu Mar 3 02:28:54 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:29:53.017895 dv-cinder-819778-7-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Mar 03 02:29:53.018684 dv-cinder-819778-7-iscsi devstack@n-api.service[102258]: Thu Mar 3 02:29:53 2022 - graceful shutdown triggered... Mar 03 02:29:53.019475 dv-cinder-819778-7-iscsi devstack@n-api.service[102259]: Gracefully killing worker 1 (pid: 102259)... Mar 03 02:29:53.020208 dv-cinder-819778-7-iscsi devstack@n-api.service[102260]: Gracefully killing worker 2 (pid: 102260)... Mar 03 02:29:54.019742 dv-cinder-819778-7-iscsi devstack@n-api.service[102258]: worker 1 buried after 1 seconds Mar 03 02:29:54.019742 dv-cinder-819778-7-iscsi devstack@n-api.service[102258]: worker 2 buried after 1 seconds Mar 03 02:29:54.019742 dv-cinder-819778-7-iscsi devstack@n-api.service[102258]: goodbye to uWSGI. Mar 03 02:29:54.021251 dv-cinder-819778-7-iscsi systemd[1]: devstack@n-api.service: Succeeded. Mar 03 02:29:54.021814 dv-cinder-819778-7-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Mar 03 02:29:54.024555 dv-cinder-819778-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Mar 03 02:29:54.037483 dv-cinder-819778-7-iscsi devstack@n-api.service[116842]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Mar 03 02:29:54.040190 dv-cinder-819778-7-iscsi devstack@n-api.service[116842]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Mar 3 02:29:54 2022] *** Mar 03 02:29:54.040190 dv-cinder-819778-7-iscsi devstack@n-api.service[116842]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 03 02:29:54.040190 dv-cinder-819778-7-iscsi devstack@n-api.service[116842]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 03 02:29:54.040190 dv-cinder-819778-7-iscsi devstack@n-api.service[116842]: nodename: dv-cinder-819778-7-iscsi Mar 03 02:29:54.040190 dv-cinder-819778-7-iscsi devstack@n-api.service[116842]: machine: x86_64 Mar 03 02:29:54.040190 dv-cinder-819778-7-iscsi devstack@n-api.service[116842]: clock source: unix Mar 03 02:29:54.040190 dv-cinder-819778-7-iscsi devstack@n-api.service[116842]: pcre jit disabled Mar 03 02:29:54.040190 dv-cinder-819778-7-iscsi devstack@n-api.service[116842]: detected number of CPU cores: 4 Mar 03 02:29:54.040190 dv-cinder-819778-7-iscsi devstack@n-api.service[116842]: current working directory: / Mar 03 02:29:54.040190 dv-cinder-819778-7-iscsi devstack@n-api.service[116842]: detected binary path: /usr/bin/uwsgi-core Mar 03 02:29:54.041105 dv-cinder-819778-7-iscsi devstack@n-api.service[116842]: your processes number limit is 47680 Mar 03 02:29:54.041105 dv-cinder-819778-7-iscsi devstack@n-api.service[116842]: your memory page size is 4096 bytes Mar 03 02:29:54.041105 dv-cinder-819778-7-iscsi devstack@n-api.service[116842]: detected max file descriptor number: 2048 Mar 03 02:29:54.041105 dv-cinder-819778-7-iscsi devstack@n-api.service[116842]: lock engine: pthread robust mutexes Mar 03 02:29:54.041105 dv-cinder-819778-7-iscsi devstack@n-api.service[116842]: thunder lock: enabled Mar 03 02:29:54.041105 dv-cinder-819778-7-iscsi devstack@n-api.service[116842]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Mar 03 02:29:54.041105 dv-cinder-819778-7-iscsi devstack@n-api.service[116842]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Mar 03 02:29:54.091474 dv-cinder-819778-7-iscsi devstack@n-api.service[116842]: Python main interpreter initialized at 0x55d7924019c0 Mar 03 02:29:54.091474 dv-cinder-819778-7-iscsi devstack@n-api.service[116842]: python threads support enabled Mar 03 02:29:54.091474 dv-cinder-819778-7-iscsi devstack@n-api.service[116842]: your server socket listen backlog is limited to 100 connections Mar 03 02:29:54.091474 dv-cinder-819778-7-iscsi devstack@n-api.service[116842]: your mercy for graceful operations on workers is 90 seconds Mar 03 02:29:54.092213 dv-cinder-819778-7-iscsi devstack@n-api.service[116842]: mapped 403077 bytes (393 KB) for 2 cores Mar 03 02:29:54.092213 dv-cinder-819778-7-iscsi devstack@n-api.service[116842]: *** Operational MODE: preforking *** Mar 03 02:29:54.092213 dv-cinder-819778-7-iscsi devstack@n-api.service[116842]: *** uWSGI is running in multiple interpreter mode *** Mar 03 02:29:54.092213 dv-cinder-819778-7-iscsi devstack@n-api.service[116842]: spawned uWSGI master process (pid: 116842) Mar 03 02:29:54.092421 dv-cinder-819778-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Mar 03 02:29:54.093009 dv-cinder-819778-7-iscsi devstack@n-api.service[116842]: spawned uWSGI worker 1 (pid: 116858, cores: 1) Mar 03 02:29:54.094305 dv-cinder-819778-7-iscsi devstack@n-api.service[116842]: spawned uWSGI worker 2 (pid: 116859, cores: 1) Mar 03 02:29:54.094305 dv-cinder-819778-7-iscsi devstack@n-api.service[116842]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 03 02:29:56.013317 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 03 02:29:56.013317 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: from cryptography.utils import int_from_bytes Mar 03 02:29:56.014027 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 03 02:29:56.014027 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: from cryptography.utils import int_from_bytes Mar 03 02:29:56.014163 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 03 02:29:56.014163 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: from cryptography.utils import int_from_bytes Mar 03 02:29:56.014163 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 03 02:29:56.014163 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: from cryptography.utils import int_from_bytes Mar 03 02:29:58.459089 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 03 02:29:58.459888 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 03 02:29:58.459888 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 03 02:29:58.460243 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 03 02:29:58.460504 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 03 02:29:58.460895 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.461225 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.461547 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.461869 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.462203 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.462516 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.462842 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.463166 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.463496 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.463791 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.464113 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.464442 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819778-7-iscsi {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.464768 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.465084 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.465395 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.465714 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.466023 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.466353 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.466662 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.467161 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.468638 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.468638 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.468919 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.469029 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.469350 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.469719 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.470046 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.470373 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.470685 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.470995 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.471409 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819778-7-iscsi {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.471749 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.472091 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.472389 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.472803 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.473115 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.473429 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.473753 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.474077 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.474399 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.474721 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.475044 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.475246 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 03 02:29:58.475754 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.475915 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 03 02:29:58.476074 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.476220 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 03 02:29:58.476402 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.476402 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.476720 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 03 02:29:58.476720 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 03 02:29:58.477011 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.477011 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.477293 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.477438 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.477595 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.477779 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.477940 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.478103 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.478256 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.478411 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.478568 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.478715 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.478859 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.479003 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.479146 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.479307 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.479489 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.479696 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.479696 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.480008 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.480008 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.480307 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.480522 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.480677 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.480834 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819778-7-iscsi {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.480998 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.481154 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.481311 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.481311 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.481617 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.481776 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.481942 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.482114 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.482263 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.482416 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.482561 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.482712 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.482892 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.483048 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.483204 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.483360 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.483513 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.483717 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.483879 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.484531 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.484699 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.484877 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.485032 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.485191 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.485191 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.485191 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.485599 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.485821 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.485974 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.486134 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.486299 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.486445 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.486606 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.486752 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.486906 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.487060 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.487212 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.487364 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.487524 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.487711 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.487867 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819778-7-iscsi {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.488022 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.488195 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.488356 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.488509 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.488663 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.488663 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.488954 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.489100 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.489244 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.489397 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.489550 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.489695 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.489845 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.489989 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.490151 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.490314 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.490472 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.490619 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.490770 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.490921 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.491066 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.491209 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.491363 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.491507 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.491680 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.491841 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.491986 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.492149 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.492298 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.492451 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.492451 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.492735 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.492885 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.493039 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.493192 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.493337 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.493488 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.493647 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.493804 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.493957 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.494138 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.494863 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.495014 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.495173 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.495327 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.495483 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.495698 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.495941 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.496100 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.496253 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.496417 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.496574 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.496574 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.497134 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.497281 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.497505 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.497661 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.497808 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.497808 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.498092 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.498092 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.498375 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.498526 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.498685 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.498685 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.498991 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.498991 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.499277 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.499421 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.499571 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.500341 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.500509 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.500662 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.500809 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.500809 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.501091 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.501245 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.501484 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.501637 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.501971 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.502153 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.502322 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.502485 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.502485 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.502769 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.502922 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.502922 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.503209 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.503367 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.503520 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.503714 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.503875 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.504029 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.504186 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.504357 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.505083 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.505250 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.505405 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.505562 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.505717 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.505871 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.505871 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.506254 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.506408 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.506582 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.506739 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.506893 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.507046 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.507201 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.507354 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.507512 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.507711 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.507873 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.508020 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.508163 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.508163 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.508466 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.508613 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.508766 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.508911 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.509063 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.509223 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.509369 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.509513 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.509663 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.509816 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.509968 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.510122 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.510278 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.510505 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.510660 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.510812 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.510964 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.511123 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.511275 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.511428 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.511573 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.511759 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.511906 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.512058 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.512222 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.512368 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.512511 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.512662 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.512816 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.512961 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.513112 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.513265 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.513416 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.513561 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.513713 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.513858 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.514010 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.514175 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.514322 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.514466 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.514641 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.516007 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.516254 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.516409 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.516570 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.516734 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.516965 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.517114 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.517266 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.517429 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.517598 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.517744 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.517896 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.518049 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.518193 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.518347 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.518500 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.518645 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.518796 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.518948 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.519102 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.519102 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.519391 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.519560 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.519779 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.519933 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.520092 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.520237 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.520380 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.520524 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.520668 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.520811 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.520967 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.521119 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.521264 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.521418 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.521576 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.521732 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.521889 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.522115 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.522264 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.522417 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.522570 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.522723 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.522868 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.523024 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.523170 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.523336 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.523588 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.523774 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.523932 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.524092 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.524245 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.524398 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.524550 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.524695 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.524883 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.525548 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.525817 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.525977 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.526125 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 03 02:29:58.526374 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.526543 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.526709 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.526862 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.527020 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.527166 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.527318 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.527473 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.527686 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.527686 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.527983 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.528137 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.528308 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.528462 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.528615 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.528760 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.528913 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.529066 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.529224 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.529370 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.529522 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.529667 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.529811 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.529962 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.530122 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.530278 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.530423 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.530574 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.530719 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.530888 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.531053 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.531209 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.531362 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.531508 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.531669 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.531833 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.531979 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.532124 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.532286 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.532432 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.532577 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.532733 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.532887 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.533032 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.533178 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.533338 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.533482 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.533642 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.533788 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.533941 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.534103 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.534258 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.534409 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.534569 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.534569 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.534853 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.535005 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.535005 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.535985 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.536285 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.536533 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.536692 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.536838 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.536995 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.537150 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.537304 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.537458 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.537603 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.537754 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.537898 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.538059 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.538205 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.538349 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.538493 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.538644 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.538789 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.538953 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.539099 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.539099 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.539372 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.539372 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.539678 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.539829 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.539974 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.539974 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.540256 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.540400 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.540554 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.540707 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.540863 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.541007 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.541152 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.541302 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.541456 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.541602 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.541899 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.542075 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.542230 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.542376 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.542530 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.542530 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.542807 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.542969 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.543122 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.543275 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.543434 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.543580 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.543749 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.543749 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.544038 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.544196 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.544342 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.544486 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.544630 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.544802 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.544955 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.545114 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.545277 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.545878 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.546135 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.546304 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.547060 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.547299 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.547450 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.547630 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.548367 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.548535 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.548703 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.548870 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.549025 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.549171 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.549316 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.549474 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.549628 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.549773 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.549925 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.552419 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.552604 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.552772 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.552937 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.553108 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.553263 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.553409 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.553562 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.553709 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.553863 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.554008 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.554160 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.554381 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.554541 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.554705 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.554868 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.555033 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.555208 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.561064 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.562262 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.563021 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.563189 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.563349 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.563583 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.563776 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.564346 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.564672 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.564833 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.564991 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.565145 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.565290 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.565443 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.565589 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.565787 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.565989 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.566473 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.566672 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.566835 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.566982 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.567142 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.567548 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.567771 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.567919 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.568075 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.568229 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.568385 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.568539 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.568684 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.568848 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.568848 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.568848 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.569281 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.569993 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.570149 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.570297 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.570442 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.570610 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.570758 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.570903 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.571048 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.571192 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.571349 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.571509 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.571674 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.571836 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.571983 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.572134 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.572279 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.572437 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.572591 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.572744 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.572889 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.573042 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.573187 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.573350 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.573496 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.573647 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.573793 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.573938 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.574095 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.574242 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.574393 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.574552 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.574704 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.574861 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.575021 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.575181 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.575350 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.576028 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.576214 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.576711 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.576894 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.577057 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.577230 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.577391 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.577700 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.577891 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.578072 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.578319 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.578478 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.578641 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.578793 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.578953 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.579121 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.579282 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.579442 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.579593 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.579782 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.579946 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.580212 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.580378 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.580531 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.580694 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.580854 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.581015 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.581015 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.581015 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.581384 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.581474 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.581474 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.581714 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.581811 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.581907 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.582001 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.582096 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.582183 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.582278 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.582373 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.582468 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.582563 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.582658 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.582758 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.582853 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.582941 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.583026 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.583111 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.583203 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.583203 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.583382 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.583470 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.583564 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.583669 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.583768 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.583866 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.583962 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.584056 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.584142 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.584236 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.584329 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.584429 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.584524 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.584619 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.584781 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.584871 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.584971 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.585066 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.585161 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.585249 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.585347 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.585435 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.585528 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.585616 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.585709 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.585795 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.585889 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.585977 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.586070 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.586163 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.586256 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.586351 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.586462 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.586462 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.586994 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.587084 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.587174 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.587274 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.587362 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.587454 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.587541 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.587816 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.587917 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.588019 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.588110 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.588195 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.588287 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.588471 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.588570 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.588667 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.588763 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.588851 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.588944 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.589032 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.589032 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.589032 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.589263 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.589356 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.589451 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.589537 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.589694 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.589791 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.589878 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.589970 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.590065 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.590158 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.590459 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.590552 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.590552 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.590721 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.590808 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.590808 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.590986 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.591075 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.591161 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.591253 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.591341 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.591435 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.591523 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.591631 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.591805 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.591898 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.591984 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.592083 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.592172 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.592257 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.592257 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.592257 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.592257 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.592257 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.592257 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.592257 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.592807 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.592896 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.592896 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.592896 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.592896 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.592896 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.593298 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.593445 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.593445 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.593445 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.593445 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.593445 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.593445 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.593914 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.594010 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.594265 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.594368 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.594368 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.594368 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.594368 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.594684 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.594842 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.594842 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.594842 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.594842 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.594842 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.595252 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.595340 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.595340 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.595340 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.595576 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.595676 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.595676 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.595676 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.595676 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.595676 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.596116 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.596217 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.596217 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.596217 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.596217 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.596217 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.596608 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.597122 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.597122 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.597122 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.597122 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.597445 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.597540 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.597540 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.597540 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.597540 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.597540 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.597540 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.598217 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.598314 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.598401 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.598494 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.598494 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.598494 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.598494 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.598806 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.598894 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.598894 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.598894 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.599134 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.599397 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.599505 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.599738 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.600018 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.600112 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.600537 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.600663 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.600757 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.600969 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.601283 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.601508 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.601659 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.601915 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.602033 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.602264 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.602544 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.602651 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.602855 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.603137 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.603231 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.603462 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.603760 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.603873 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.604096 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.604357 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.604451 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.604709 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.604951 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.605056 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.605323 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.605636 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.605907 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.606009 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.606240 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.606535 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.606639 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.606843 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.607226 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.607338 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.607464 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.607732 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.607844 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.608110 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.608334 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.608439 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.608723 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.608943 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.609589 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.610024 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.610128 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.610410 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.610714 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.610841 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.611024 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.611236 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.611339 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.611665 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.611848 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.611985 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.612303 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.612441 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.612613 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.612947 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.613042 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.613339 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.613522 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.613653 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.613968 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.614100 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.614278 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.614583 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.614676 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.614895 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.615179 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.615281 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.615513 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.615778 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.615914 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.616222 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.616351 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.616546 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.616933 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.617038 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.617410 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.617525 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.617622 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.617889 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.617983 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.618220 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.618480 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.618607 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.618923 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.619068 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.619237 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.619562 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.619738 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.619916 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.620187 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.620290 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.620539 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.620888 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.621011 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.621157 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.621359 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.621482 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.622090 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.622200 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.622387 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.622692 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.622786 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.623001 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.623280 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.623381 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.623662 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.623889 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.623996 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.624282 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.624509 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.624773 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.625107 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.625203 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.625528 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.625758 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.625851 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.626178 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.626361 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.626489 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.626799 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.627042 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.627159 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.627534 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.627688 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.627788 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.628054 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.628146 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.628386 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.628666 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.628762 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.628975 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.629244 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.629338 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.629580 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.629818 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.629912 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.630200 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.630392 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.630508 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.630833 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.630947 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.631156 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.631475 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.631581 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.631834 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.632075 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.632177 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.632455 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.632660 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.632760 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.633060 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.633243 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.633368 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.633675 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.633848 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.634018 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.634326 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.634429 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.634647 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.634912 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.635006 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.635290 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.636023 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.636120 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.636209 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.636310 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.636310 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.636570 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.636704 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.636889 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.637217 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.637332 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.637932 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.638032 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.638129 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.638129 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.638558 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.638685 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.638783 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.638912 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.639042 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.639352 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.639462 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.639689 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.639986 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.640080 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.640822 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.641091 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.641342 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.641622 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.641779 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.642076 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.642183 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.642380 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.642668 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.642767 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.642984 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.643247 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.643350 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.643640 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.643849 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.643953 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.644275 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.644448 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.644602 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.644929 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.645027 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.645259 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.645514 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.645608 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.645885 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.646111 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.646213 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.646513 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.646696 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.646832 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.647151 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.647267 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.647474 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.648038 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.648164 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.648164 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.648342 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.648438 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.648730 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.648903 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.649049 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.649368 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.649715 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.649860 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.649957 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.650260 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.650459 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.650562 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.650885 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.651025 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.651198 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.651419 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.651540 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.651875 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.651984 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.652200 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.652304 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.652523 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.652641 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.652847 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.652949 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.653173 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.653276 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.653492 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.653614 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.653814 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.653925 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.654133 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.654225 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.654450 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.654553 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.654771 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.654875 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.655085 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.655193 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.655406 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.655509 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.655744 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.656048 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.656327 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.656861 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.656965 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.657053 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.657147 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.657234 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.657319 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.657412 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.657508 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.657598 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.657765 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.657860 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.658113 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.658224 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.658391 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.658529 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.658728 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.658850 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.659021 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.659135 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.659335 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.659432 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.659669 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.659767 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.659986 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.660093 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.660305 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.660408 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.660626 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.660719 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.660942 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.661044 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.661259 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.661362 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.661573 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.661665 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.661891 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.662006 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.662207 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.662300 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.662540 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.662727 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.662873 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.663048 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.663211 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.663384 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.663525 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.663750 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.663868 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.664079 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.664172 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.664402 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.664495 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.664724 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.664835 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.665054 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.665148 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.665363 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.665454 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.665672 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.665756 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.666047 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.666150 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.666293 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.666395 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.666599 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.666701 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.666920 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.667012 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.667231 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.667332 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.667537 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.667758 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.667885 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.667995 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.668203 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.668476 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.668582 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.668737 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.668856 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.669095 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.669186 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.669457 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.669615 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.669762 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.669900 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.670073 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.670174 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.670524 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.670847 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.671170 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.671262 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.672202 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.672384 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.672549 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.672888 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.673110 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.673275 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.673436 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.673600 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.673764 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.673938 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.674100 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.674261 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.674423 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.674586 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.674741 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.674895 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.675056 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.675056 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.675381 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.675381 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.675697 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.675867 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.676039 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.676201 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.676320 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.676413 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.676499 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.676593 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.676688 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.676783 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.676880 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.676975 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.677063 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.677235 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.677338 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.677567 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.677672 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.677886 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.677994 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.678288 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.678399 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.678514 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.678651 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.678839 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.679017 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.679257 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.679417 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.679680 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.679788 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.679876 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.680010 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.680157 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.680331 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.680467 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.680665 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.681097 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.681202 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.681280 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.681372 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.681461 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.681678 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.681839 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.682004 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.682169 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.682324 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.682491 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.682658 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.682806 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.682991 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.683132 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.683312 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.683450 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.683670 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.683782 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.683988 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.684136 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.684319 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.684457 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.684652 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.684975 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.685067 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.685306 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.685409 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.685630 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.685722 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.685967 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.686068 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.686303 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.686398 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.686612 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.686706 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.686920 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.687020 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.688277 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.688411 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.688491 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.688609 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.688609 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.688766 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.688939 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.689053 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.689203 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.689321 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.689515 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.689617 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.689828 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.689924 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.690142 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.690235 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.690456 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.690565 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.690769 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.690871 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.691080 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.691180 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.691389 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.691502 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.691726 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.691839 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.692038 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.692133 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.692359 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.692467 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.692683 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.692783 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.693011 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.693115 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.693332 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.693437 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.693642 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.693743 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.693959 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.694059 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.694272 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.694379 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.694580 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.694672 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.694886 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.694979 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.695194 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.695295 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.695509 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.695719 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.695866 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.695981 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.696181 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.696283 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.696489 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.696593 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.696834 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.696942 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.697153 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.697248 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.697496 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.697598 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.697831 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.697938 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.698144 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.698238 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.698467 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.698560 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.698791 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.698894 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.699102 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.699207 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.699411 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.699513 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.699744 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.699858 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.700055 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.700156 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.700368 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.700475 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.700681 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.700775 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.700997 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.701092 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.701308 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.701401 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.701619 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.701720 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.701926 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.702019 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.702235 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.702336 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.702553 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.702653 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.702917 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.703059 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.703229 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.703471 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.703744 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.704067 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.704177 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.704382 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.704479 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.704690 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.704785 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.705004 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.705098 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.705314 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.705409 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.705624 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.705719 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.705940 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.706033 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.706245 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.706356 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.706555 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.706659 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.706863 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.706958 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.707170 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.707280 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.707476 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.707580 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.707809 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.707917 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.708122 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.708246 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.708429 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.708524 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.708738 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.708863 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.709051 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.709209 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.709357 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.709469 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.709664 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.709771 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.709995 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.710100 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.710331 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.710436 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.710649 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.710891 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.710997 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.711228 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.711331 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.711552 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.711742 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.711901 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.712009 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.712225 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.712328 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.712551 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.712665 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.712869 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.712982 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.713181 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.713282 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.713512 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.713617 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.714143 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.714255 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.714335 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.714416 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.714492 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.714574 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.714720 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.714807 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.715041 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.715143 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.715340 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.715425 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.716089 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.716210 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.716297 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.716380 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.716456 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.716539 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.716624 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.716701 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.716936 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.717022 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.717259 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.717427 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.717580 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.717664 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.717896 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.717988 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.718228 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.718319 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.718616 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.718708 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.719200 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.719309 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.719402 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.719485 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.719567 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.719761 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.719900 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.720074 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.720220 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.720900 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.721027 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.721128 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.721219 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.721316 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.721414 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.721503 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.721598 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.721687 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.721832 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.721944 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.722159 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.722268 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.722481 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.722575 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.722896 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.723016 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.723129 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.723232 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.723878 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.724008 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.724108 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.724215 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.724305 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.724400 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.724498 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 03 02:29:58.724638 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.725009 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.725292 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.725615 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.725949 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.726434 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.726569 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.726886 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.727203 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.727518 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.728280 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.728280 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.728860 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.728860 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.729101 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.729652 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.730610 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.730610 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.730610 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.730968 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.731281 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.731615 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.732243 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.732243 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.732243 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.732906 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.733200 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.733510 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.734978 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.734978 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.734978 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.735508 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.735650 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.735880 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.736214 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.736607 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.736926 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.737150 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.737470 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.737784 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.738096 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.738410 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.738724 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.739049 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.739366 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.739718 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.740033 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.740354 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.740667 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.740986 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.741346 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.741675 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.741987 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.742298 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.742624 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.743035 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.743375 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.743885 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.744207 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.744567 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.744904 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.745464 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.745812 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.746147 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.746499 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.747108 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.747410 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.747751 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.748070 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.748345 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_db.sqlalchemy.engines [None req-bb06a693-74c7-4e38-a4f8-e81a27644fc3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116859) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 03 02:29:58.748708 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.748708 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.749025 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.749346 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.749716 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.750552 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.751052 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.751548 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.751896 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.752217 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.752539 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.752859 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.753179 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.753509 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.753858 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.754187 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.754514 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.754840 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.755166 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.755485 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.755828 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.756145 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.756462 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.756785 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.757123 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.757445 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.757758 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.758190 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.758509 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.758840 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.759167 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.759485 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.759844 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.760173 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.760491 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.760819 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.761136 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.761486 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.761839 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.762162 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.762464 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.762840 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.763090 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.763744 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.763916 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.764191 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.764536 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.764840 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.765227 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.765550 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.765867 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.766201 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.766551 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.766869 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.767208 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.767519 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.767885 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.768200 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.768510 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.768828 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.769141 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.769455 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.769805 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.770074 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.770382 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.770695 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.771002 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.771343 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.771709 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.772031 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.772361 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.772678 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.773028 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.773346 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.773675 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.774002 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.774331 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.774647 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.774983 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.775299 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.775638 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.775960 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.776278 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.776596 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.776913 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.777257 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.777581 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.777894 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.778228 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.778553 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.778888 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.779214 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.779533 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.779906 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.780227 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.780544 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.780892 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.781478 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.781585 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.781856 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.782177 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.782512 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.782844 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.783174 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.783510 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.783892 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.784215 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.784567 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.784904 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.785227 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.785548 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.785865 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 03 02:29:58.786117 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 03 02:29:58.808970 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_db.sqlalchemy.engines [None req-ced63724-d980-43ad-9b65-e11844729c73 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116858) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 03 02:29:58.813334 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.context [None req-bb06a693-74c7-4e38-a4f8-e81a27644fc3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),056eea21-8cd3-453b-8bc6-a26b173c51c8(cell1) {{(pid=116859) load_cells /opt/stack/nova/nova/context.py:464}} Mar 03 02:29:58.817715 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bb06a693-74c7-4e38-a4f8-e81a27644fc3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:29:58.819304 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bb06a693-74c7-4e38-a4f8-e81a27644fc3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:29:58.820167 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bb06a693-74c7-4e38-a4f8-e81a27644fc3 None None] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:29:58.822112 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bb06a693-74c7-4e38-a4f8-e81a27644fc3 None None] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:29:58.832944 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_db.sqlalchemy.engines [None req-bb06a693-74c7-4e38-a4f8-e81a27644fc3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116859) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 03 02:29:58.833813 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_db.sqlalchemy.engines [None req-bb06a693-74c7-4e38-a4f8-e81a27644fc3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116859) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 03 02:29:58.873290 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.context [None req-ced63724-d980-43ad-9b65-e11844729c73 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),056eea21-8cd3-453b-8bc6-a26b173c51c8(cell1) {{(pid=116858) load_cells /opt/stack/nova/nova/context.py:464}} Mar 03 02:29:58.878183 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ced63724-d980-43ad-9b65-e11844729c73 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:29:58.879814 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ced63724-d980-43ad-9b65-e11844729c73 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:29:58.880663 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ced63724-d980-43ad-9b65-e11844729c73 None None] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:29:58.882635 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ced63724-d980-43ad-9b65-e11844729c73 None None] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:29:58.893479 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_db.sqlalchemy.engines [None req-ced63724-d980-43ad-9b65-e11844729c73 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116858) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 03 02:29:58.894779 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_db.sqlalchemy.engines [None req-ced63724-d980-43ad-9b65-e11844729c73 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116858) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 03 02:29:59.000426 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_db.sqlalchemy.engines [None req-bb06a693-74c7-4e38-a4f8-e81a27644fc3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116859) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 03 02:29:59.055673 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_db.sqlalchemy.engines [None req-ced63724-d980-43ad-9b65-e11844729c73 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116858) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 03 02:29:59.325851 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: WARNING keystonemiddleware.auth_token [None req-bb06a693-74c7-4e38-a4f8-e81a27644fc3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 03 02:29:59.450340 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: WARNING keystonemiddleware.auth_token [None req-bb06a693-74c7-4e38-a4f8-e81a27644fc3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 03 02:29:59.487405 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: WARNING keystonemiddleware.auth_token [None req-ced63724-d980-43ad-9b65-e11844729c73 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 03 02:29:59.494026 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: WARNING keystonemiddleware.auth_token [None req-ced63724-d980-43ad-9b65-e11844729c73 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 03 02:29:59.679390 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: WARNING keystonemiddleware.auth_token [None req-bb06a693-74c7-4e38-a4f8-e81a27644fc3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 03 02:29:59.684539 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: WARNING keystonemiddleware.auth_token [None req-bb06a693-74c7-4e38-a4f8-e81a27644fc3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 03 02:29:59.691774 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d7924019c0 pid: 116859 (default app) Mar 03 02:29:59.721292 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: WARNING keystonemiddleware.auth_token [None req-ced63724-d980-43ad-9b65-e11844729c73 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 03 02:29:59.726489 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: WARNING keystonemiddleware.auth_token [None req-ced63724-d980-43ad-9b65-e11844729c73 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 03 02:29:59.731830 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d7924019c0 pid: 116858 (default app) Mar 03 02:30:39.067177 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0f59f643-7b73-40d9-b7df-6665e28e81fe tempest-VolumesGetTestJSON-1123595227 tempest-VolumesGetTestJSON-1123595227-project] Action: 'create', calling method: .version_select at 0x7fb3c8fde4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-631166526", "metadata": {"Type": "work"}}} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:30:40.781196 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a151df35-a256-4d73-924a-1658e126ea8e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1754643506", "imageRef": "1fe11a1a-b4d0-46f5-89cd-501ceff49317", "flavorRef": "452", "networks": [{"uuid": "d9d2edb4-611d-4e02-94de-0b7e65f130ad"}]}} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:30:41.285207 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0f59f643-7b73-40d9-b7df-6665e28e81fe tempest-VolumesGetTestJSON-1123595227 tempest-VolumesGetTestJSON-1123595227-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.300947 Mar 03 02:30:41.285852 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1/1] 10.222.0.30 () {60 vars in 1155 bytes} [Thu Mar 3 02:30:37 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3304 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Mar 03 02:30:41.363914 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.network.neutron [None req-a151df35-a256-4d73-924a-1658e126ea8e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] validate_networks() for [('d9d2edb4-611d-4e02-94de-0b7e65f130ad', None, None, None, None, None)] {{(pid=116858) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 03 02:30:41.543535 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f62b9b95-9feb-4fcc-9657-1c2cf295748b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1865179999", "imageRef": "1fe11a1a-b4d0-46f5-89cd-501ceff49317", "flavorRef": "452", "networks": [{"uuid": "085c7101-81cb-4983-9061-6b8c28d78e14"}]}} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:30:41.760185 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.network.neutron [None req-f62b9b95-9feb-4fcc-9657-1c2cf295748b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] validate_networks() for [('085c7101-81cb-4983-9061-6b8c28d78e14', None, None, None, None, None)] {{(pid=116859) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 03 02:30:42.631436 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-a151df35-a256-4d73-924a-1658e126ea8e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Flavor limits 0:0:0 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 03 02:30:42.632533 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-a151df35-a256-4d73-924a-1658e126ea8e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Image limits 0:0:0 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 03 02:30:42.633585 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-a151df35-a256-4d73-924a-1658e126ea8e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Flavor pref 0:0:0 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 03 02:30:42.634167 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-a151df35-a256-4d73-924a-1658e126ea8e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Image pref 0:0:0 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 03 02:30:42.634949 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-a151df35-a256-4d73-924a-1658e126ea8e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 03 02:30:42.667458 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a151df35-a256-4d73-924a-1658e126ea8e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:30:42.668327 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a151df35-a256-4d73-924a-1658e126ea8e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:30:42.668959 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a151df35-a256-4d73-924a-1658e126ea8e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:30:42.669386 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a151df35-a256-4d73-924a-1658e126ea8e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:30:42.743778 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.quota [None req-a151df35-a256-4d73-924a-1658e126ea8e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Getting quotas for project 2e235fd949e6494eb47967914074be06. Resources: {'instances', 'ram', 'cores'} {{(pid=116858) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 03 02:30:42.761337 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.quota [None req-a151df35-a256-4d73-924a-1658e126ea8e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Getting quotas for user 76da7e26281640968c429d04efb3dd3e and project 2e235fd949e6494eb47967914074be06. Resources: {'instances', 'ram', 'cores'} {{(pid=116858) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 03 02:30:42.783407 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a151df35-a256-4d73-924a-1658e126ea8e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Going to run 1 instances... {{(pid=116858) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 03 02:30:42.801161 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a151df35-a256-4d73-924a-1658e126ea8e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: dd292525-cb8e-4520-a771-d22e2d3d6619] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1fe11a1a-b4d0-46f5-89cd-501ceff49317',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116858) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 03 02:30:42.948259 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a151df35-a256-4d73-924a-1658e126ea8e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.345415 Mar 03 02:30:42.948917 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1/2] 10.222.0.30 () {60 vars in 1146 bytes} [Thu Mar 3 02:30:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 3347 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 03 02:30:42.964528 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-de3baf60-9602-4335-a862-c5e4e96970bb tempest-VolumesGetTestJSON-1123595227 tempest-VolumesGetTestJSON-1123595227-project] Calling method '.version_select at 0x7fb3c8e45dc0>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:30:43.045455 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-de3baf60-9602-4335-a862-c5e4e96970bb tempest-VolumesGetTestJSON-1123595227 tempest-VolumesGetTestJSON-1123595227-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/c5d3b57d-b8da-44bf-a738-d099cd218550" status: 200 len: 353 microversion: 2.1 time: 0.095284 Mar 03 02:30:43.053198 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 2/3] 10.222.0.30 () {58 vars in 1244 bytes} [Thu Mar 3 02:30:42 2022] GET /compute/v2.1/os-volumes/c5d3b57d-b8da-44bf-a738-d099cd218550 => generated 353 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:30:43.058270 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9a06636d-a08e-47ec-a9ae-21b5ed3fc358 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:30:43.062069 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9a06636d-a08e-47ec-a9ae-21b5ed3fc358 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: dd292525-cb8e-4520-a771-d22e2d3d6619] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:30:43.242046 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9a06636d-a08e-47ec-a9ae-21b5ed3fc358 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:30:43.267354 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9a06636d-a08e-47ec-a9ae-21b5ed3fc358 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619" status: 200 len: 1218 microversion: 2.1 time: 0.212603 Mar 03 02:30:43.268392 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 3/4] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:30:43 2022] GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619 => generated 1218 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:30:43.274052 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-94502343-fb7e-492e-9658-ca679e41c8c9 tempest-VolumesGetTestJSON-1123595227 tempest-VolumesGetTestJSON-1123595227-project] Calling method '.version_select at 0x7fb3c85bef70>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:30:43.389779 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-94502343-fb7e-492e-9658-ca679e41c8c9 tempest-VolumesGetTestJSON-1123595227 tempest-VolumesGetTestJSON-1123595227-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/c5d3b57d-b8da-44bf-a738-d099cd218550" status: 200 len: 353 microversion: 2.1 time: 0.119961 Mar 03 02:30:43.390789 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 4/5] 10.222.0.30 () {58 vars in 1244 bytes} [Thu Mar 3 02:30:43 2022] GET /compute/v2.1/os-volumes/c5d3b57d-b8da-44bf-a738-d099cd218550 => generated 353 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:30:43.417051 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ea7d3c4e-afb0-4659-9683-9865a6f4d902 tempest-VolumesGetTestJSON-1123595227 tempest-VolumesGetTestJSON-1123595227-project] Calling method '.version_select at 0x7fb3c856d430>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:30:43.537031 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-f62b9b95-9feb-4fcc-9657-1c2cf295748b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Flavor limits 0:0:0 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 03 02:30:43.537031 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-f62b9b95-9feb-4fcc-9657-1c2cf295748b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Image limits 0:0:0 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 03 02:30:43.537031 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-f62b9b95-9feb-4fcc-9657-1c2cf295748b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Flavor pref 0:0:0 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 03 02:30:43.537031 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-f62b9b95-9feb-4fcc-9657-1c2cf295748b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Image pref 0:0:0 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 03 02:30:43.537031 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-f62b9b95-9feb-4fcc-9657-1c2cf295748b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 03 02:30:43.595350 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f62b9b95-9feb-4fcc-9657-1c2cf295748b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:30:43.603758 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f62b9b95-9feb-4fcc-9657-1c2cf295748b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:30:43.605109 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f62b9b95-9feb-4fcc-9657-1c2cf295748b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:30:43.609047 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f62b9b95-9feb-4fcc-9657-1c2cf295748b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:30:43.645246 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ea7d3c4e-afb0-4659-9683-9865a6f4d902 tempest-VolumesGetTestJSON-1123595227 tempest-VolumesGetTestJSON-1123595227-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/c5d3b57d-b8da-44bf-a738-d099cd218550" status: 202 len: 0 microversion: 2.1 time: 0.242512 Mar 03 02:30:43.646772 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 5/6] 10.222.0.30 () {58 vars in 1247 bytes} [Thu Mar 3 02:30:43 2022] DELETE /compute/v2.1/os-volumes/c5d3b57d-b8da-44bf-a738-d099cd218550 => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 03 02:30:43.655846 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-86c53800-ec60-4007-97ac-afac2d586e45 tempest-VolumesGetTestJSON-1123595227 tempest-VolumesGetTestJSON-1123595227-project] Calling method '.version_select at 0x7fb3c856daf0>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:30:43.769966 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.quota [None req-f62b9b95-9feb-4fcc-9657-1c2cf295748b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Getting quotas for project 391f419b7b114f10a01c5a7cdc200770. Resources: {'instances', 'ram', 'cores'} {{(pid=116859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 03 02:30:43.815993 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.quota [None req-f62b9b95-9feb-4fcc-9657-1c2cf295748b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Getting quotas for user dfc43d1c3ceb4bc88fc588ef91f25dad and project 391f419b7b114f10a01c5a7cdc200770. Resources: {'instances', 'ram', 'cores'} {{(pid=116859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 03 02:30:43.889124 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f62b9b95-9feb-4fcc-9657-1c2cf295748b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Going to run 1 instances... {{(pid=116859) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 03 02:30:43.895596 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-86c53800-ec60-4007-97ac-afac2d586e45 tempest-VolumesGetTestJSON-1123595227 tempest-VolumesGetTestJSON-1123595227-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/c5d3b57d-b8da-44bf-a738-d099cd218550" status: 200 len: 352 microversion: 2.1 time: 0.243898 Mar 03 02:30:43.897345 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 6/7] 10.222.0.30 () {58 vars in 1244 bytes} [Thu Mar 3 02:30:43 2022] GET /compute/v2.1/os-volumes/c5d3b57d-b8da-44bf-a738-d099cd218550 => generated 352 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:30:43.913517 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f62b9b95-9feb-4fcc-9657-1c2cf295748b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] [instance: ef11fe69-5cf1-46cc-afdd-57b330c977d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1fe11a1a-b4d0-46f5-89cd-501ceff49317',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 03 02:30:44.125205 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f62b9b95-9feb-4fcc-9657-1c2cf295748b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.837635 Mar 03 02:30:44.130542 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 2/8] 10.222.0.30 () {60 vars in 1146 bytes} [Thu Mar 3 02:30:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 03 02:30:44.144813 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0daf01eb-9c55-4c2c-bcd8-e3b65321106b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:30:44.146503 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0daf01eb-9c55-4c2c-bcd8-e3b65321106b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] [instance: ef11fe69-5cf1-46cc-afdd-57b330c977d6] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:30:44.289498 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2a02b4af-4ac3-4eeb-a06d-00ba1ca88e96 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:30:44.290129 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2a02b4af-4ac3-4eeb-a06d-00ba1ca88e96 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: dd292525-cb8e-4520-a771-d22e2d3d6619] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:30:44.350545 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0daf01eb-9c55-4c2c-bcd8-e3b65321106b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc43d1c3ceb4bc88fc588ef91f25dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391f419b7b114f10a01c5a7cdc200770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:30:44.360481 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0daf01eb-9c55-4c2c-bcd8-e3b65321106b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] 10.222.0.30 "GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6" status: 200 len: 1215 microversion: 2.1 time: 0.228366 Mar 03 02:30:44.365561 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 7/9] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:30:44 2022] GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6 => generated 1215 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:30:44.910157 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-bb06e331-74e7-477e-b6f9-2a0a6520cafa tempest-VolumesGetTestJSON-1123595227 tempest-VolumesGetTestJSON-1123595227-project] Calling method '.version_select at 0x7fb3c856d670>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:30:45.004421 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.wsgi [None req-bb06e331-74e7-477e-b6f9-2a0a6520cafa tempest-VolumesGetTestJSON-1123595227 tempest-VolumesGetTestJSON-1123595227-project] HTTP exception thrown: Volume c5d3b57d-b8da-44bf-a738-d099cd218550 could not be found. Mar 03 02:30:45.005422 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-bb06e331-74e7-477e-b6f9-2a0a6520cafa tempest-VolumesGetTestJSON-1123595227 tempest-VolumesGetTestJSON-1123595227-project] Returning 404 to user: Volume c5d3b57d-b8da-44bf-a738-d099cd218550 could not be found. {{(pid=116858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:30:45.009851 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-bb06e331-74e7-477e-b6f9-2a0a6520cafa tempest-VolumesGetTestJSON-1123595227 tempest-VolumesGetTestJSON-1123595227-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/c5d3b57d-b8da-44bf-a738-d099cd218550" status: 404 len: 109 microversion: 2.1 time: 0.104775 Mar 03 02:30:45.013961 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 8/10] 10.222.0.30 () {58 vars in 1244 bytes} [Thu Mar 3 02:30:44 2022] GET /compute/v2.1/os-volumes/c5d3b57d-b8da-44bf-a738-d099cd218550 => generated 109 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 03 02:30:45.145190 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2a02b4af-4ac3-4eeb-a06d-00ba1ca88e96 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:30:45.184922 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2a02b4af-4ac3-4eeb-a06d-00ba1ca88e96 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619" status: 200 len: 1218 microversion: 2.1 time: 0.903020 Mar 03 02:30:45.196458 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 3/11] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:30:44 2022] GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619 => generated 1218 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:30:45.383052 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-25c1676f-a2d0-47a8-a72c-1714cd2b2edb tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:30:45.384078 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-25c1676f-a2d0-47a8-a72c-1714cd2b2edb tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] [instance: ef11fe69-5cf1-46cc-afdd-57b330c977d6] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:30:45.769380 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-25c1676f-a2d0-47a8-a72c-1714cd2b2edb tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc43d1c3ceb4bc88fc588ef91f25dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391f419b7b114f10a01c5a7cdc200770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:30:45.797128 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-25c1676f-a2d0-47a8-a72c-1714cd2b2edb tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] 10.222.0.30 "GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6" status: 200 len: 1215 microversion: 2.1 time: 0.416517 Mar 03 02:30:45.800303 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 9/12] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:30:45 2022] GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6 => generated 1215 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:30:46.206184 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-36567dda-12be-4fca-95ce-6cdfb2491445 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:30:46.207425 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-36567dda-12be-4fca-95ce-6cdfb2491445 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: dd292525-cb8e-4520-a771-d22e2d3d6619] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:30:46.222478 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-36567dda-12be-4fca-95ce-6cdfb2491445 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:30:46.224301 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-36567dda-12be-4fca-95ce-6cdfb2491445 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:30:46.225847 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-36567dda-12be-4fca-95ce-6cdfb2491445 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:30:46.226974 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-36567dda-12be-4fca-95ce-6cdfb2491445 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:30:46.749406 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-36567dda-12be-4fca-95ce-6cdfb2491445 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:30:46.785341 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-36567dda-12be-4fca-95ce-6cdfb2491445 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619" status: 200 len: 1270 microversion: 2.1 time: 0.576339 Mar 03 02:30:46.790768 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 4/13] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:30:46 2022] GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619 => generated 1270 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:30:46.816447 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-50893e82-c3bc-4a5a-9f83-92d2d0cc34cc tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:30:46.817710 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-50893e82-c3bc-4a5a-9f83-92d2d0cc34cc tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] [instance: ef11fe69-5cf1-46cc-afdd-57b330c977d6] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:30:46.843432 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-50893e82-c3bc-4a5a-9f83-92d2d0cc34cc tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:30:46.843931 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-50893e82-c3bc-4a5a-9f83-92d2d0cc34cc tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:30:46.863233 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-50893e82-c3bc-4a5a-9f83-92d2d0cc34cc tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:30:46.866288 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-50893e82-c3bc-4a5a-9f83-92d2d0cc34cc tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:30:47.574946 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-50893e82-c3bc-4a5a-9f83-92d2d0cc34cc tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc43d1c3ceb4bc88fc588ef91f25dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391f419b7b114f10a01c5a7cdc200770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:30:47.596944 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-50893e82-c3bc-4a5a-9f83-92d2d0cc34cc tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] 10.222.0.30 "GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6" status: 200 len: 1267 microversion: 2.1 time: 0.777838 Mar 03 02:30:47.608052 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 10/14] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:30:46 2022] GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6 => generated 1267 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:30:47.807357 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-effc7e5e-ac9e-402e-9ab0-f330fc792cd9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:30:47.808085 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-effc7e5e-ac9e-402e-9ab0-f330fc792cd9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: dd292525-cb8e-4520-a771-d22e2d3d6619] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:30:47.824858 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-effc7e5e-ac9e-402e-9ab0-f330fc792cd9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:30:47.825392 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-effc7e5e-ac9e-402e-9ab0-f330fc792cd9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:30:47.829436 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-effc7e5e-ac9e-402e-9ab0-f330fc792cd9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:30:47.834874 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-effc7e5e-ac9e-402e-9ab0-f330fc792cd9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:30:48.193005 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-effc7e5e-ac9e-402e-9ab0-f330fc792cd9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:30:48.207086 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-effc7e5e-ac9e-402e-9ab0-f330fc792cd9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619" status: 200 len: 1278 microversion: 2.1 time: 0.404285 Mar 03 02:30:48.213468 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 5/15] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:30:47 2022] GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619 => generated 1278 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:30:48.614883 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d723af5e-3fdd-48bb-9f6c-5ffe43e9f4ee tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:30:48.616241 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d723af5e-3fdd-48bb-9f6c-5ffe43e9f4ee tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] [instance: ef11fe69-5cf1-46cc-afdd-57b330c977d6] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:30:48.628312 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d723af5e-3fdd-48bb-9f6c-5ffe43e9f4ee tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:30:48.630595 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d723af5e-3fdd-48bb-9f6c-5ffe43e9f4ee tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:30:48.632311 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d723af5e-3fdd-48bb-9f6c-5ffe43e9f4ee tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:30:48.636231 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d723af5e-3fdd-48bb-9f6c-5ffe43e9f4ee tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:30:48.977116 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d723af5e-3fdd-48bb-9f6c-5ffe43e9f4ee tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc43d1c3ceb4bc88fc588ef91f25dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391f419b7b114f10a01c5a7cdc200770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:30:49.006508 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d723af5e-3fdd-48bb-9f6c-5ffe43e9f4ee tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] 10.222.0.30 "GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6" status: 200 len: 1267 microversion: 2.1 time: 0.395437 Mar 03 02:30:49.018348 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 11/16] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:30:48 2022] GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6 => generated 1267 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:30:49.238610 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9ae4ac72-37ad-4491-b216-79aabd7a2fed tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:30:49.239492 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9ae4ac72-37ad-4491-b216-79aabd7a2fed tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: dd292525-cb8e-4520-a771-d22e2d3d6619] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:30:49.252325 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9ae4ac72-37ad-4491-b216-79aabd7a2fed tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:30:49.252790 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9ae4ac72-37ad-4491-b216-79aabd7a2fed tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:30:49.253677 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9ae4ac72-37ad-4491-b216-79aabd7a2fed tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:30:49.254145 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9ae4ac72-37ad-4491-b216-79aabd7a2fed tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:30:49.529579 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9ae4ac72-37ad-4491-b216-79aabd7a2fed tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:30:49.538163 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9ae4ac72-37ad-4491-b216-79aabd7a2fed tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619" status: 200 len: 1278 microversion: 2.1 time: 0.309856 Mar 03 02:30:49.540829 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 6/17] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:30:49 2022] GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619 => generated 1278 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:30:50.031174 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-191cb64b-9f27-4901-a09d-286a65344f69 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:30:50.032624 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-191cb64b-9f27-4901-a09d-286a65344f69 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] [instance: ef11fe69-5cf1-46cc-afdd-57b330c977d6] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:30:50.086062 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-191cb64b-9f27-4901-a09d-286a65344f69 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:30:50.091313 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-191cb64b-9f27-4901-a09d-286a65344f69 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:30:50.095258 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-191cb64b-9f27-4901-a09d-286a65344f69 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:30:50.096786 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-191cb64b-9f27-4901-a09d-286a65344f69 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:30:50.360201 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-191cb64b-9f27-4901-a09d-286a65344f69 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc43d1c3ceb4bc88fc588ef91f25dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391f419b7b114f10a01c5a7cdc200770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:30:50.368390 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-191cb64b-9f27-4901-a09d-286a65344f69 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] 10.222.0.30 "GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6" status: 200 len: 1267 microversion: 2.1 time: 0.345405 Mar 03 02:30:50.374398 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 12/18] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:30:50 2022] GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6 => generated 1267 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:30:50.559938 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4b939652-3430-4d49-b6cb-7210d2b06c14 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:30:50.560528 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4b939652-3430-4d49-b6cb-7210d2b06c14 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: dd292525-cb8e-4520-a771-d22e2d3d6619] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:30:50.571940 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4b939652-3430-4d49-b6cb-7210d2b06c14 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:30:50.575832 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4b939652-3430-4d49-b6cb-7210d2b06c14 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:30:50.577419 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4b939652-3430-4d49-b6cb-7210d2b06c14 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:30:50.582658 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4b939652-3430-4d49-b6cb-7210d2b06c14 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:30:50.952848 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4b939652-3430-4d49-b6cb-7210d2b06c14 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:30:50.963347 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4b939652-3430-4d49-b6cb-7210d2b06c14 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619" status: 200 len: 1276 microversion: 2.1 time: 0.409174 Mar 03 02:30:50.969383 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 7/19] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:30:50 2022] GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619 => generated 1276 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:30:51.405473 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-48076220-2626-4132-9a20-6ce04374c4ba tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:30:51.411769 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-48076220-2626-4132-9a20-6ce04374c4ba tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] [instance: ef11fe69-5cf1-46cc-afdd-57b330c977d6] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:30:51.426254 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-48076220-2626-4132-9a20-6ce04374c4ba tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:30:51.426952 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-48076220-2626-4132-9a20-6ce04374c4ba tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:30:51.430458 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-48076220-2626-4132-9a20-6ce04374c4ba tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:30:51.431659 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-48076220-2626-4132-9a20-6ce04374c4ba tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:30:51.633484 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-48076220-2626-4132-9a20-6ce04374c4ba tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc43d1c3ceb4bc88fc588ef91f25dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391f419b7b114f10a01c5a7cdc200770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:30:51.651482 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-48076220-2626-4132-9a20-6ce04374c4ba tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] 10.222.0.30 "GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6" status: 200 len: 1273 microversion: 2.1 time: 0.267028 Mar 03 02:30:51.653882 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 13/20] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:30:51 2022] GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6 => generated 1273 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:30:51.991371 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ed0e6d64-70ab-4fe8-a09f-7a81d18b209b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:30:51.992323 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ed0e6d64-70ab-4fe8-a09f-7a81d18b209b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: dd292525-cb8e-4520-a771-d22e2d3d6619] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:30:52.021958 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ed0e6d64-70ab-4fe8-a09f-7a81d18b209b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:30:52.026126 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ed0e6d64-70ab-4fe8-a09f-7a81d18b209b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:30:52.027409 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ed0e6d64-70ab-4fe8-a09f-7a81d18b209b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:30:52.032202 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ed0e6d64-70ab-4fe8-a09f-7a81d18b209b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:30:52.289854 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8f6b8e4f-1265-453f-80ad-0fabfc5a1f58 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Action: 'create', calling method: .version_select at 0x7fb3c8576700>, body: {"keypair": {"name": "tempest-keypair-933584465"}} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:30:52.429270 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.quota [None req-8f6b8e4f-1265-453f-80ad-0fabfc5a1f58 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Getting quotas for project 09c4069c31144128952334c19272d2c6. Resources: {'key_pairs'} {{(pid=116859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 03 02:30:52.465738 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.quota [None req-8f6b8e4f-1265-453f-80ad-0fabfc5a1f58 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Getting quotas for user f2f87d12584b4465b93c30d79d1ba832 and project 09c4069c31144128952334c19272d2c6. Resources: {'key_pairs'} {{(pid=116859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 03 02:30:53.524864 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.quota [None req-8f6b8e4f-1265-453f-80ad-0fabfc5a1f58 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Getting quotas for project 09c4069c31144128952334c19272d2c6. Resources: {'key_pairs'} {{(pid=116859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 03 02:30:53.553175 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.quota [None req-8f6b8e4f-1265-453f-80ad-0fabfc5a1f58 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Getting quotas for user f2f87d12584b4465b93c30d79d1ba832 and project 09c4069c31144128952334c19272d2c6. Resources: {'key_pairs'} {{(pid=116859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 03 02:30:53.691233 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8f6b8e4f-1265-453f-80ad-0fabfc5a1f58 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 2.249683 Mar 03 02:30:53.701137 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 8/21] 10.222.0.30 () {62 vars in 1198 bytes} [Thu Mar 3 02:30:51 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 2260 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 03 02:30:53.739857 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a79af613-e98e-4637-94df-23048cdbe98d tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:30:53.745406 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a79af613-e98e-4637-94df-23048cdbe98d tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] [instance: ef11fe69-5cf1-46cc-afdd-57b330c977d6] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:30:53.810464 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a79af613-e98e-4637-94df-23048cdbe98d tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:30:53.810464 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a79af613-e98e-4637-94df-23048cdbe98d tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:30:53.811420 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a79af613-e98e-4637-94df-23048cdbe98d tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:30:53.811807 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a79af613-e98e-4637-94df-23048cdbe98d tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:30:54.180192 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ed0e6d64-70ab-4fe8-a09f-7a81d18b209b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:30:54.198602 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ed0e6d64-70ab-4fe8-a09f-7a81d18b209b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619" status: 200 len: 1276 microversion: 2.1 time: 2.216525 Mar 03 02:30:54.203239 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 14/22] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:30:51 2022] GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619 => generated 1276 bytes in 2222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:30:55.282319 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-092dc57c-3e70-4f13-92a1-2fee22f1c3f5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:30:55.290845 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-092dc57c-3e70-4f13-92a1-2fee22f1c3f5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: dd292525-cb8e-4520-a771-d22e2d3d6619] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:30:55.329088 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-092dc57c-3e70-4f13-92a1-2fee22f1c3f5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:30:55.330017 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-092dc57c-3e70-4f13-92a1-2fee22f1c3f5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:30:55.331253 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-092dc57c-3e70-4f13-92a1-2fee22f1c3f5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:30:55.332698 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-092dc57c-3e70-4f13-92a1-2fee22f1c3f5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:30:57.072619 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-092dc57c-3e70-4f13-92a1-2fee22f1c3f5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:30:57.086460 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-092dc57c-3e70-4f13-92a1-2fee22f1c3f5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619" status: 200 len: 1318 microversion: 2.1 time: 1.865081 Mar 03 02:30:57.102741 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 15/23] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:30:55 2022] GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619 => generated 1318 bytes in 1887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:30:58.109499 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3bd558d5-3e1a-45fc-8da2-05a00df89361 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:30:58.111244 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3bd558d5-3e1a-45fc-8da2-05a00df89361 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: dd292525-cb8e-4520-a771-d22e2d3d6619] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:30:58.128760 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3bd558d5-3e1a-45fc-8da2-05a00df89361 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:30:58.129652 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3bd558d5-3e1a-45fc-8da2-05a00df89361 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:30:58.131030 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3bd558d5-3e1a-45fc-8da2-05a00df89361 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:30:58.134074 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3bd558d5-3e1a-45fc-8da2-05a00df89361 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:30:58.817097 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-3bd558d5-3e1a-45fc-8da2-05a00df89361 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:30:58.829638 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3bd558d5-3e1a-45fc-8da2-05a00df89361 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619" status: 200 len: 1318 microversion: 2.1 time: 0.724101 Mar 03 02:30:58.834491 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 16/24] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:30:58 2022] GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619 => generated 1318 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:30:59.605513 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a79af613-e98e-4637-94df-23048cdbe98d tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc43d1c3ceb4bc88fc588ef91f25dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391f419b7b114f10a01c5a7cdc200770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:30:59.616506 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a79af613-e98e-4637-94df-23048cdbe98d tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] 10.222.0.30 "GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6" status: 200 len: 1315 microversion: 2.1 time: 5.909259 Mar 03 02:30:59.632922 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 9/25] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:30:53 2022] GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6 => generated 1315 bytes in 5926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:30:59.856788 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d5f3e9b1-7b4e-4408-add2-c949ebe54002 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:30:59.857421 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d5f3e9b1-7b4e-4408-add2-c949ebe54002 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: dd292525-cb8e-4520-a771-d22e2d3d6619] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:30:59.884263 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d5f3e9b1-7b4e-4408-add2-c949ebe54002 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:30:59.884803 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d5f3e9b1-7b4e-4408-add2-c949ebe54002 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:30:59.890164 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d5f3e9b1-7b4e-4408-add2-c949ebe54002 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:30:59.894211 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d5f3e9b1-7b4e-4408-add2-c949ebe54002 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:00.404311 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [req-99004d25-db61-4160-990a-bbf2e84e8605 req-95d68fb4-8d94-45b0-9053-693a9f3cc5a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef11fe69-5cf1-46cc-afdd-57b330c977d6", "tag": "9d1b4fb7-cbb1-4036-be2d-33ac3458786e"}]} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:31:00.417658 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-99004d25-db61-4160-990a-bbf2e84e8605 req-95d68fb4-8d94-45b0-9053-693a9f3cc5a1 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:00.419323 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-99004d25-db61-4160-990a-bbf2e84e8605 req-95d68fb4-8d94-45b0-9053-693a9f3cc5a1 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:00.455213 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.compute.server_external_events [req-99004d25-db61-4160-990a-bbf2e84e8605 req-95d68fb4-8d94-45b0-9053-693a9f3cc5a1 service nova] Creating event network-changed:9d1b4fb7-cbb1-4036-be2d-33ac3458786e for instance ef11fe69-5cf1-46cc-afdd-57b330c977d6 on hv-cinder-81977 Mar 03 02:31:00.456179 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-99004d25-db61-4160-990a-bbf2e84e8605 req-95d68fb4-8d94-45b0-9053-693a9f3cc5a1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116858) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 03 02:31:00.466518 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-81c39972-42cc-492f-b02f-1e63f6360bd2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:00.467529 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-81c39972-42cc-492f-b02f-1e63f6360bd2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:00.469808 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-81c39972-42cc-492f-b02f-1e63f6360bd2 None None] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:00.471371 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-81c39972-42cc-492f-b02f-1e63f6360bd2 None None] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:00.486001 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.compute.rpcapi [None req-81c39972-42cc-492f-b02f-1e63f6360bd2 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Mar 03 02:31:00.487152 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-81c39972-42cc-492f-b02f-1e63f6360bd2 None None] Releasing lock "compute-rpcapi-router" {{(pid=116858) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 03 02:31:00.551287 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-81c39972-42cc-492f-b02f-1e63f6360bd2 None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.763370 Mar 03 02:31:00.553455 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 17/26] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:31:00.643673 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-bd108bdc-2f58-48a5-b7c4-4f1bfa7cc634 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:00.644388 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-bd108bdc-2f58-48a5-b7c4-4f1bfa7cc634 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] [instance: ef11fe69-5cf1-46cc-afdd-57b330c977d6] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:00.660351 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bd108bdc-2f58-48a5-b7c4-4f1bfa7cc634 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:00.660805 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bd108bdc-2f58-48a5-b7c4-4f1bfa7cc634 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:00.661622 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bd108bdc-2f58-48a5-b7c4-4f1bfa7cc634 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:00.668925 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bd108bdc-2f58-48a5-b7c4-4f1bfa7cc634 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:01.355742 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d5f3e9b1-7b4e-4408-add2-c949ebe54002 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:01.378173 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d5f3e9b1-7b4e-4408-add2-c949ebe54002 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619" status: 200 len: 1318 microversion: 2.1 time: 1.531146 Mar 03 02:31:01.384972 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 10/27] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:30:59 2022] GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619 => generated 1318 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:01.570283 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-bd108bdc-2f58-48a5-b7c4-4f1bfa7cc634 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc43d1c3ceb4bc88fc588ef91f25dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391f419b7b114f10a01c5a7cdc200770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:01.587632 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-bd108bdc-2f58-48a5-b7c4-4f1bfa7cc634 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] 10.222.0.30 "GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6" status: 200 len: 1315 microversion: 2.1 time: 0.952853 Mar 03 02:31:01.588594 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 18/28] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:00 2022] GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6 => generated 1315 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:02.401524 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-fc9f1c4d-c638-4595-aeb2-13962644f842 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:02.402102 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-fc9f1c4d-c638-4595-aeb2-13962644f842 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: dd292525-cb8e-4520-a771-d22e2d3d6619] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:02.413767 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fc9f1c4d-c638-4595-aeb2-13962644f842 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:02.414258 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fc9f1c4d-c638-4595-aeb2-13962644f842 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:02.415078 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fc9f1c4d-c638-4595-aeb2-13962644f842 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:02.424085 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fc9f1c4d-c638-4595-aeb2-13962644f842 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:02.605645 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8ec17e44-fbf8-41ff-9423-2bc5287d6ad2 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:02.606316 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8ec17e44-fbf8-41ff-9423-2bc5287d6ad2 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] [instance: ef11fe69-5cf1-46cc-afdd-57b330c977d6] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:02.614175 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8ec17e44-fbf8-41ff-9423-2bc5287d6ad2 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:02.620000 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8ec17e44-fbf8-41ff-9423-2bc5287d6ad2 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:02.621274 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8ec17e44-fbf8-41ff-9423-2bc5287d6ad2 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:02.630916 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8ec17e44-fbf8-41ff-9423-2bc5287d6ad2 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:03.456332 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8ec17e44-fbf8-41ff-9423-2bc5287d6ad2 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc43d1c3ceb4bc88fc588ef91f25dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391f419b7b114f10a01c5a7cdc200770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:03.471382 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8ec17e44-fbf8-41ff-9423-2bc5287d6ad2 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] 10.222.0.30 "GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6" status: 200 len: 1315 microversion: 2.1 time: 0.868089 Mar 03 02:31:03.472640 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 19/29] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:02 2022] GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6 => generated 1315 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:03.858917 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [req-9d8657f7-b292-4c25-bf7e-befac0ffc8f2 req-f49dfae7-edcf-4e6b-800e-cd385d50881a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd292525-cb8e-4520-a771-d22e2d3d6619", "tag": "5424b4bf-994a-4ee5-b949-44d34e8975fc"}]} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:31:03.875862 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-9d8657f7-b292-4c25-bf7e-befac0ffc8f2 req-f49dfae7-edcf-4e6b-800e-cd385d50881a service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:03.877514 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-9d8657f7-b292-4c25-bf7e-befac0ffc8f2 req-f49dfae7-edcf-4e6b-800e-cd385d50881a service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:03.905305 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.compute.server_external_events [req-9d8657f7-b292-4c25-bf7e-befac0ffc8f2 req-f49dfae7-edcf-4e6b-800e-cd385d50881a service nova] Creating event network-changed:5424b4bf-994a-4ee5-b949-44d34e8975fc for instance dd292525-cb8e-4520-a771-d22e2d3d6619 on hv-cinder-81977 Mar 03 02:31:03.933616 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [req-9d8657f7-b292-4c25-bf7e-befac0ffc8f2 req-f49dfae7-edcf-4e6b-800e-cd385d50881a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.455640 Mar 03 02:31:03.935155 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 20/30] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:31:04.228764 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-fc9f1c4d-c638-4595-aeb2-13962644f842 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:04.239071 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-fc9f1c4d-c638-4595-aeb2-13962644f842 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619" status: 200 len: 1318 microversion: 2.1 time: 1.841774 Mar 03 02:31:04.243274 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 11/31] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:02 2022] GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619 => generated 1318 bytes in 1847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:04.491303 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-80754611-a0a3-4f07-bc52-152c97873159 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:04.492541 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-80754611-a0a3-4f07-bc52-152c97873159 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] [instance: ef11fe69-5cf1-46cc-afdd-57b330c977d6] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:04.511269 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-80754611-a0a3-4f07-bc52-152c97873159 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:04.516158 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-80754611-a0a3-4f07-bc52-152c97873159 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:04.519235 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-80754611-a0a3-4f07-bc52-152c97873159 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:04.528899 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-80754611-a0a3-4f07-bc52-152c97873159 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:05.263450 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-77971350-6b10-46f7-b614-9a6199038b84 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:05.264363 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-77971350-6b10-46f7-b614-9a6199038b84 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: dd292525-cb8e-4520-a771-d22e2d3d6619] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:05.284352 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-77971350-6b10-46f7-b614-9a6199038b84 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:05.284803 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-77971350-6b10-46f7-b614-9a6199038b84 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:05.292366 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-77971350-6b10-46f7-b614-9a6199038b84 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:05.292934 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-77971350-6b10-46f7-b614-9a6199038b84 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:05.627004 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-80754611-a0a3-4f07-bc52-152c97873159 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc43d1c3ceb4bc88fc588ef91f25dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391f419b7b114f10a01c5a7cdc200770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:05.642140 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-80754611-a0a3-4f07-bc52-152c97873159 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] 10.222.0.30 "GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6" status: 200 len: 1315 microversion: 2.1 time: 1.157036 Mar 03 02:31:05.652177 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 21/32] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:04 2022] GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6 => generated 1315 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:05.992881 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8b3fa507-e2ba-4239-a1b5-7758946028ba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-163160325", "imageRef": "1fe11a1a-b4d0-46f5-89cd-501ceff49317", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:31:06.107103 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.network.neutron [None req-8b3fa507-e2ba-4239-a1b5-7758946028ba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] validate_networks() for [('cd84e51a-5c8d-480c-9132-0e67f9bf5ce9', None, None, None, None, None)] {{(pid=116858) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 03 02:31:06.641591 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-77971350-6b10-46f7-b614-9a6199038b84 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:06.652899 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-77971350-6b10-46f7-b614-9a6199038b84 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619" status: 200 len: 1318 microversion: 2.1 time: 1.396694 Mar 03 02:31:06.653587 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 12/33] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:05 2022] GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619 => generated 1318 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:06.668307 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-58800faa-d629-42c0-8dba-55dd91866761 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:06.672455 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-58800faa-d629-42c0-8dba-55dd91866761 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] [instance: ef11fe69-5cf1-46cc-afdd-57b330c977d6] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:06.687485 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-58800faa-d629-42c0-8dba-55dd91866761 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:06.689342 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-58800faa-d629-42c0-8dba-55dd91866761 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:06.691733 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-58800faa-d629-42c0-8dba-55dd91866761 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:06.693282 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-58800faa-d629-42c0-8dba-55dd91866761 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:07.222455 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-8b3fa507-e2ba-4239-a1b5-7758946028ba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Flavor limits 0:0:0 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 03 02:31:07.223385 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-8b3fa507-e2ba-4239-a1b5-7758946028ba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Image limits 0:0:0 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 03 02:31:07.224296 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-8b3fa507-e2ba-4239-a1b5-7758946028ba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Flavor pref 0:0:0 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 03 02:31:07.225296 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-8b3fa507-e2ba-4239-a1b5-7758946028ba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Image pref 0:0:0 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 03 02:31:07.226240 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-8b3fa507-e2ba-4239-a1b5-7758946028ba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 03 02:31:07.241955 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b3fa507-e2ba-4239-a1b5-7758946028ba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:07.243042 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b3fa507-e2ba-4239-a1b5-7758946028ba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:07.245591 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b3fa507-e2ba-4239-a1b5-7758946028ba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:07.247482 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b3fa507-e2ba-4239-a1b5-7758946028ba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:07.266687 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-58800faa-d629-42c0-8dba-55dd91866761 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc43d1c3ceb4bc88fc588ef91f25dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391f419b7b114f10a01c5a7cdc200770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:07.280265 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-58800faa-d629-42c0-8dba-55dd91866761 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] 10.222.0.30 "GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6" status: 200 len: 1315 microversion: 2.1 time: 0.619449 Mar 03 02:31:07.280993 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 13/34] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:06 2022] GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6 => generated 1315 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:07.339111 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.quota [None req-8b3fa507-e2ba-4239-a1b5-7758946028ba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Getting quotas for project 4e7cef8f5ec6400c9fa6ebbacdb82241. Resources: {'instances', 'ram', 'cores'} {{(pid=116858) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 03 02:31:07.350725 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.quota [None req-8b3fa507-e2ba-4239-a1b5-7758946028ba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Getting quotas for user a361064e2d3041e1aee265c55537a5e6 and project 4e7cef8f5ec6400c9fa6ebbacdb82241. Resources: {'instances', 'ram', 'cores'} {{(pid=116858) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 03 02:31:07.377155 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8b3fa507-e2ba-4239-a1b5-7758946028ba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Going to run 1 instances... {{(pid=116858) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 03 02:31:07.379869 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8b3fa507-e2ba-4239-a1b5-7758946028ba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1fe11a1a-b4d0-46f5-89cd-501ceff49317',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116858) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 03 02:31:07.479748 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8b3fa507-e2ba-4239-a1b5-7758946028ba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.817765 Mar 03 02:31:07.480551 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 22/35] 10.222.0.30 () {60 vars in 1146 bytes} [Thu Mar 3 02:31:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 1828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 03 02:31:07.494738 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5888858f-0f45-4ddc-bf76-0e2c4f74e384 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1089696985", "imageRef": "1fe11a1a-b4d0-46f5-89cd-501ceff49317", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a158f3aa-e152-4a15-91ae-f9397ac00beb"}], "security_groups": [{"name": "tempest-securitygroup--1926224924"}], "key_name": "tempest-keypair-933584465", "user_data": "}} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:31:07.809422 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.network.neutron [None req-5888858f-0f45-4ddc-bf76-0e2c4f74e384 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] validate_networks() for [('a158f3aa-e152-4a15-91ae-f9397ac00beb', None, None, None, None, None)] {{(pid=116858) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 03 02:31:08.002882 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-43250fb7-0cbd-4d4b-acaa-6125055a877b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Action: 'create', calling method: .version_select at 0x7fb3c84868b0>, body: {"keypair": {"name": "tempest-keypair-504147627"}} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:31:08.049998 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.quota [None req-43250fb7-0cbd-4d4b-acaa-6125055a877b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Getting quotas for project 204a19c418b44e9fa1c46a1fd0a0294b. Resources: {'key_pairs'} {{(pid=116859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 03 02:31:08.066960 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.quota [None req-43250fb7-0cbd-4d4b-acaa-6125055a877b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Getting quotas for user 211640f2c9e54914a33b7cf26ebf4a51 and project 204a19c418b44e9fa1c46a1fd0a0294b. Resources: {'key_pairs'} {{(pid=116859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 03 02:31:08.599106 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.quota [None req-43250fb7-0cbd-4d4b-acaa-6125055a877b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Getting quotas for project 204a19c418b44e9fa1c46a1fd0a0294b. Resources: {'key_pairs'} {{(pid=116859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 03 02:31:08.612567 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.quota [None req-43250fb7-0cbd-4d4b-acaa-6125055a877b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Getting quotas for user 211640f2c9e54914a33b7cf26ebf4a51 and project 204a19c418b44e9fa1c46a1fd0a0294b. Resources: {'key_pairs'} {{(pid=116859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 03 02:31:08.653793 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-43250fb7-0cbd-4d4b-acaa-6125055a877b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 1.371640 Mar 03 02:31:08.664066 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 14/36] 10.222.0.30 () {60 vars in 1157 bytes} [Thu Mar 3 02:31:07 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:08.679533 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3903f0cc-3b25-4bb8-9557-35d95614a107 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:08.682538 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3903f0cc-3b25-4bb8-9557-35d95614a107 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:08.702865 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3903f0cc-3b25-4bb8-9557-35d95614a107 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:08.704285 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3903f0cc-3b25-4bb8-9557-35d95614a107 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:08.707830 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3903f0cc-3b25-4bb8-9557-35d95614a107 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:08.708446 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3903f0cc-3b25-4bb8-9557-35d95614a107 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:08.745015 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-5888858f-0f45-4ddc-bf76-0e2c4f74e384 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Flavor limits 0:0:0 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 03 02:31:08.745462 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-5888858f-0f45-4ddc-bf76-0e2c4f74e384 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Image limits 0:0:0 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 03 02:31:08.746003 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-5888858f-0f45-4ddc-bf76-0e2c4f74e384 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Flavor pref 0:0:0 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 03 02:31:08.746746 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-5888858f-0f45-4ddc-bf76-0e2c4f74e384 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Image pref 0:0:0 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 03 02:31:08.747233 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-5888858f-0f45-4ddc-bf76-0e2c4f74e384 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 03 02:31:08.775453 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5888858f-0f45-4ddc-bf76-0e2c4f74e384 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:08.783318 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5888858f-0f45-4ddc-bf76-0e2c4f74e384 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:08.785851 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5888858f-0f45-4ddc-bf76-0e2c4f74e384 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:08.791088 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5888858f-0f45-4ddc-bf76-0e2c4f74e384 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:08.844532 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3903f0cc-3b25-4bb8-9557-35d95614a107 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:08.852954 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3903f0cc-3b25-4bb8-9557-35d95614a107 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1273 microversion: 2.1 time: 0.185587 Mar 03 02:31:08.856774 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 15/37] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:08 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1273 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:08.864054 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3392e981-9bc3-45eb-a1f9-bd6a3493b183 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:08.864901 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3392e981-9bc3-45eb-a1f9-bd6a3493b183 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: dd292525-cb8e-4520-a771-d22e2d3d6619] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:08.883072 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.quota [None req-5888858f-0f45-4ddc-bf76-0e2c4f74e384 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Getting quotas for project 09c4069c31144128952334c19272d2c6. Resources: {'instances', 'ram', 'cores'} {{(pid=116858) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 03 02:31:08.890995 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3392e981-9bc3-45eb-a1f9-bd6a3493b183 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:08.892534 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.quota [None req-5888858f-0f45-4ddc-bf76-0e2c4f74e384 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Getting quotas for user f2f87d12584b4465b93c30d79d1ba832 and project 09c4069c31144128952334c19272d2c6. Resources: {'instances', 'ram', 'cores'} {{(pid=116858) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 03 02:31:08.892904 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3392e981-9bc3-45eb-a1f9-bd6a3493b183 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:08.910104 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3392e981-9bc3-45eb-a1f9-bd6a3493b183 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:08.922664 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3392e981-9bc3-45eb-a1f9-bd6a3493b183 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:08.940806 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5888858f-0f45-4ddc-bf76-0e2c4f74e384 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Going to run 1 instances... {{(pid=116858) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 03 02:31:08.943173 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5888858f-0f45-4ddc-bf76-0e2c4f74e384 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1fe11a1a-b4d0-46f5-89cd-501ceff49317',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116858) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 03 02:31:09.066896 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5888858f-0f45-4ddc-bf76-0e2c4f74e384 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.585081 Mar 03 02:31:09.089703 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 23/38] 10.222.0.30 () {62 vars in 1187 bytes} [Thu Mar 3 02:31:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 1608 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 03 02:31:09.109661 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ecf83722-6d6c-40f7-9465-0d70a97049b0 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:09.110724 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ecf83722-6d6c-40f7-9465-0d70a97049b0 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] [instance: ef11fe69-5cf1-46cc-afdd-57b330c977d6] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:09.118362 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ecf83722-6d6c-40f7-9465-0d70a97049b0 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:09.119198 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ecf83722-6d6c-40f7-9465-0d70a97049b0 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:09.120253 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ecf83722-6d6c-40f7-9465-0d70a97049b0 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:09.120884 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ecf83722-6d6c-40f7-9465-0d70a97049b0 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:09.443457 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ecf83722-6d6c-40f7-9465-0d70a97049b0 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc43d1c3ceb4bc88fc588ef91f25dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391f419b7b114f10a01c5a7cdc200770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:09.453599 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ecf83722-6d6c-40f7-9465-0d70a97049b0 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] 10.222.0.30 "GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6" status: 200 len: 1315 microversion: 2.1 time: 0.361515 Mar 03 02:31:09.467389 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 24/39] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:09 2022] GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6 => generated 1315 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:09.486643 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a4819647-e749-4440-99de-0f39d90f09a1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:09.487790 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a4819647-e749-4440-99de-0f39d90f09a1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:09.600445 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a4819647-e749-4440-99de-0f39d90f09a1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:09.613881 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a4819647-e749-4440-99de-0f39d90f09a1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:09.618516 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a4819647-e749-4440-99de-0f39d90f09a1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:09.621783 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a4819647-e749-4440-99de-0f39d90f09a1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1281 microversion: 2.20 time: 0.150059 Mar 03 02:31:09.634680 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 25/40] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:31:09 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1281 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:31:09.651801 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0fc76375-0985-44d2-ba4a-792ab4c7aab5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1799891206", "imageRef": "1fe11a1a-b4d0-46f5-89cd-501ceff49317", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:31:09.777632 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.network.neutron [None req-0fc76375-0985-44d2-ba4a-792ab4c7aab5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] validate_networks() for [('cd84e51a-5c8d-480c-9132-0e67f9bf5ce9', None, None, None, None, None)] {{(pid=116858) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 03 02:31:10.079247 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3392e981-9bc3-45eb-a1f9-bd6a3493b183 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:10.091840 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3392e981-9bc3-45eb-a1f9-bd6a3493b183 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619" status: 200 len: 1318 microversion: 2.1 time: 1.232758 Mar 03 02:31:10.097248 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 16/41] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:08 2022] GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619 => generated 1318 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:10.476099 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1fd94f6a-7a37-468c-b87d-d498fab9a22d tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:10.477052 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1fd94f6a-7a37-468c-b87d-d498fab9a22d tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] [instance: ef11fe69-5cf1-46cc-afdd-57b330c977d6] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:10.499839 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1fd94f6a-7a37-468c-b87d-d498fab9a22d tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:10.500307 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1fd94f6a-7a37-468c-b87d-d498fab9a22d tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:10.513510 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1fd94f6a-7a37-468c-b87d-d498fab9a22d tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:10.514213 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1fd94f6a-7a37-468c-b87d-d498fab9a22d tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:10.684675 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-0fc76375-0985-44d2-ba4a-792ab4c7aab5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Flavor limits 0:0:0 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 03 02:31:10.685086 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-0fc76375-0985-44d2-ba4a-792ab4c7aab5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Image limits 0:0:0 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 03 02:31:10.686907 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-0fc76375-0985-44d2-ba4a-792ab4c7aab5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Flavor pref 0:0:0 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 03 02:31:10.687539 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-0fc76375-0985-44d2-ba4a-792ab4c7aab5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Image pref 0:0:0 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 03 02:31:10.688148 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-0fc76375-0985-44d2-ba4a-792ab4c7aab5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 03 02:31:10.707099 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0fc76375-0985-44d2-ba4a-792ab4c7aab5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:10.707866 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0fc76375-0985-44d2-ba4a-792ab4c7aab5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:10.709099 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0fc76375-0985-44d2-ba4a-792ab4c7aab5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:10.709695 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0fc76375-0985-44d2-ba4a-792ab4c7aab5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:10.771368 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.quota [None req-0fc76375-0985-44d2-ba4a-792ab4c7aab5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Getting quotas for project 4e7cef8f5ec6400c9fa6ebbacdb82241. Resources: {'instances', 'ram', 'cores'} {{(pid=116858) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 03 02:31:10.778314 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.quota [None req-0fc76375-0985-44d2-ba4a-792ab4c7aab5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Getting quotas for user a361064e2d3041e1aee265c55537a5e6 and project 4e7cef8f5ec6400c9fa6ebbacdb82241. Resources: {'instances', 'ram', 'cores'} {{(pid=116858) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 03 02:31:10.802105 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0fc76375-0985-44d2-ba4a-792ab4c7aab5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Going to run 1 instances... {{(pid=116858) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 03 02:31:10.810961 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0fc76375-0985-44d2-ba4a-792ab4c7aab5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1fe11a1a-b4d0-46f5-89cd-501ceff49317',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116858) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 03 02:31:10.977851 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0fc76375-0985-44d2-ba4a-792ab4c7aab5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.341972 Mar 03 02:31:10.987470 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 26/42] 10.222.0.30 () {60 vars in 1146 bytes} [Thu Mar 3 02:31:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 1352 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 03 02:31:11.000316 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-04c3d793-9b1f-442a-b5fe-8b85ef5c9267 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:11.001838 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-04c3d793-9b1f-442a-b5fe-8b85ef5c9267 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:11.015345 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-04c3d793-9b1f-442a-b5fe-8b85ef5c9267 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:11.018107 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-04c3d793-9b1f-442a-b5fe-8b85ef5c9267 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:11.020274 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-04c3d793-9b1f-442a-b5fe-8b85ef5c9267 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:11.021080 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-04c3d793-9b1f-442a-b5fe-8b85ef5c9267 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:11.261480 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-04c3d793-9b1f-442a-b5fe-8b85ef5c9267 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:11.290258 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-04c3d793-9b1f-442a-b5fe-8b85ef5c9267 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:11.292864 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-04c3d793-9b1f-442a-b5fe-8b85ef5c9267 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:11.295355 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-04c3d793-9b1f-442a-b5fe-8b85ef5c9267 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1341 microversion: 2.20 time: 0.304425 Mar 03 02:31:11.298818 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 27/43] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:31:10 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1341 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:31:11.311551 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1fd94f6a-7a37-468c-b87d-d498fab9a22d tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc43d1c3ceb4bc88fc588ef91f25dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391f419b7b114f10a01c5a7cdc200770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:11.319191 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1fd94f6a-7a37-468c-b87d-d498fab9a22d tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] 10.222.0.30 "GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6" status: 200 len: 1315 microversion: 2.1 time: 0.848576 Mar 03 02:31:11.321108 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-37d255ef-b4d6-4b16-a54b-0febd1846a79 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:11.323588 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-37d255ef-b4d6-4b16-a54b-0febd1846a79 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:11.336771 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 17/44] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:10 2022] GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6 => generated 1315 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:11.342331 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f35bf4ce-76ca-4fd9-b707-7ce5b3c45a73 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:11.342954 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f35bf4ce-76ca-4fd9-b707-7ce5b3c45a73 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: dd292525-cb8e-4520-a771-d22e2d3d6619] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:11.368432 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f35bf4ce-76ca-4fd9-b707-7ce5b3c45a73 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:11.368950 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f35bf4ce-76ca-4fd9-b707-7ce5b3c45a73 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:11.369738 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f35bf4ce-76ca-4fd9-b707-7ce5b3c45a73 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:11.370179 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f35bf4ce-76ca-4fd9-b707-7ce5b3c45a73 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:11.544523 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-37d255ef-b4d6-4b16-a54b-0febd1846a79 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:11.552810 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-37d255ef-b4d6-4b16-a54b-0febd1846a79 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1222 microversion: 2.1 time: 0.252607 Mar 03 02:31:11.555093 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 28/45] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:11 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1222 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:11.849821 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f35bf4ce-76ca-4fd9-b707-7ce5b3c45a73 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:11.863832 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f35bf4ce-76ca-4fd9-b707-7ce5b3c45a73 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619" status: 200 len: 1318 microversion: 2.1 time: 0.525812 Mar 03 02:31:11.864678 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 18/46] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:11 2022] GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619 => generated 1318 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:12.317159 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c1f9c0e4-0af3-468e-ace0-460006e8a81f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:12.317919 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c1f9c0e4-0af3-468e-ace0-460006e8a81f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:12.326872 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c1f9c0e4-0af3-468e-ace0-460006e8a81f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:12.327323 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c1f9c0e4-0af3-468e-ace0-460006e8a81f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:12.328960 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c1f9c0e4-0af3-468e-ace0-460006e8a81f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:12.329862 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c1f9c0e4-0af3-468e-ace0-460006e8a81f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:12.347368 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-98467332-04e6-4eef-a33b-67908ae04339 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:12.348035 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-98467332-04e6-4eef-a33b-67908ae04339 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] [instance: ef11fe69-5cf1-46cc-afdd-57b330c977d6] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:12.361964 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-98467332-04e6-4eef-a33b-67908ae04339 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:12.365863 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-98467332-04e6-4eef-a33b-67908ae04339 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:12.368257 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-98467332-04e6-4eef-a33b-67908ae04339 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:12.369897 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-98467332-04e6-4eef-a33b-67908ae04339 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:12.464837 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c1f9c0e4-0af3-468e-ace0-460006e8a81f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:12.485925 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c1f9c0e4-0af3-468e-ace0-460006e8a81f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:12.491546 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c1f9c0e4-0af3-468e-ace0-460006e8a81f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:12.492755 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c1f9c0e4-0af3-468e-ace0-460006e8a81f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1339 microversion: 2.20 time: 0.182240 Mar 03 02:31:12.493339 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 29/47] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:31:12 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1339 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:31:12.580272 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9d312d1d-05f1-4d6c-944d-cc948c1b30f4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:12.580973 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9d312d1d-05f1-4d6c-944d-cc948c1b30f4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:12.609270 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9d312d1d-05f1-4d6c-944d-cc948c1b30f4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:12.610032 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9d312d1d-05f1-4d6c-944d-cc948c1b30f4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:12.626963 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9d312d1d-05f1-4d6c-944d-cc948c1b30f4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:12.627419 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9d312d1d-05f1-4d6c-944d-cc948c1b30f4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:12.819504 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9d312d1d-05f1-4d6c-944d-cc948c1b30f4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:12.833127 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9d312d1d-05f1-4d6c-944d-cc948c1b30f4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1282 microversion: 2.1 time: 0.259536 Mar 03 02:31:12.833730 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 30/48] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:12 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1282 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:31:12.882323 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c42ab209-e51b-43de-a687-d38ea3b70d8e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:12.883226 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c42ab209-e51b-43de-a687-d38ea3b70d8e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: dd292525-cb8e-4520-a771-d22e2d3d6619] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:12.901925 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c42ab209-e51b-43de-a687-d38ea3b70d8e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:12.902633 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c42ab209-e51b-43de-a687-d38ea3b70d8e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:12.909123 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c42ab209-e51b-43de-a687-d38ea3b70d8e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:12.909877 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c42ab209-e51b-43de-a687-d38ea3b70d8e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:13.637327 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-98467332-04e6-4eef-a33b-67908ae04339 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc43d1c3ceb4bc88fc588ef91f25dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391f419b7b114f10a01c5a7cdc200770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:13.653922 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-98467332-04e6-4eef-a33b-67908ae04339 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] 10.222.0.30 "GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6" status: 200 len: 1315 microversion: 2.1 time: 1.313079 Mar 03 02:31:13.654748 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 19/49] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:12 2022] GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6 => generated 1315 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:13.679006 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-96a8a07b-8edb-47e3-b44a-52db0bffeed8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:13.684428 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-96a8a07b-8edb-47e3-b44a-52db0bffeed8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:13.697224 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-96a8a07b-8edb-47e3-b44a-52db0bffeed8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:13.697571 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-96a8a07b-8edb-47e3-b44a-52db0bffeed8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:13.698376 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-96a8a07b-8edb-47e3-b44a-52db0bffeed8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:13.704350 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-96a8a07b-8edb-47e3-b44a-52db0bffeed8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:13.834467 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-96a8a07b-8edb-47e3-b44a-52db0bffeed8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:13.846706 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-96a8a07b-8edb-47e3-b44a-52db0bffeed8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:13.851331 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-96a8a07b-8edb-47e3-b44a-52db0bffeed8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:13.854981 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-96a8a07b-8edb-47e3-b44a-52db0bffeed8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1339 microversion: 2.20 time: 0.188985 Mar 03 02:31:13.855567 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 20/50] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:31:13 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1339 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:31:13.870485 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d3e0e3e2-3956-4d5e-8640-d33172f75249 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:13.871674 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d3e0e3e2-3956-4d5e-8640-d33172f75249 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:13.878550 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d3e0e3e2-3956-4d5e-8640-d33172f75249 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:13.879263 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d3e0e3e2-3956-4d5e-8640-d33172f75249 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:13.880278 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d3e0e3e2-3956-4d5e-8640-d33172f75249 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:13.880906 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d3e0e3e2-3956-4d5e-8640-d33172f75249 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:13.965040 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d3e0e3e2-3956-4d5e-8640-d33172f75249 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:13.982672 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d3e0e3e2-3956-4d5e-8640-d33172f75249 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1280 microversion: 2.1 time: 0.115797 Mar 03 02:31:13.984005 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 21/51] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:13 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1280 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:14.031683 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [req-562d0bef-abd0-47b7-a905-d12330c05246 req-89ab1005-35ae-4555-b002-4f1093455d32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b9116d7-0099-4dfe-b678-192ce74500eb", "tag": "b914fbeb-7aa5-47c8-9b2c-7bd96a54163e"}]} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:31:14.073724 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-562d0bef-abd0-47b7-a905-d12330c05246 req-89ab1005-35ae-4555-b002-4f1093455d32 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:14.074333 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-562d0bef-abd0-47b7-a905-d12330c05246 req-89ab1005-35ae-4555-b002-4f1093455d32 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:14.126893 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.compute.server_external_events [req-562d0bef-abd0-47b7-a905-d12330c05246 req-89ab1005-35ae-4555-b002-4f1093455d32 service nova] Creating event network-changed:b914fbeb-7aa5-47c8-9b2c-7bd96a54163e for instance 0b9116d7-0099-4dfe-b678-192ce74500eb on hv-cinder-81977 Mar 03 02:31:14.127650 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-562d0bef-abd0-47b7-a905-d12330c05246 req-89ab1005-35ae-4555-b002-4f1093455d32 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116859) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 03 02:31:14.129157 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eb5a70d5-2894-4a8f-b49f-dc9f586b093d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:14.129967 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eb5a70d5-2894-4a8f-b49f-dc9f586b093d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:14.131064 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eb5a70d5-2894-4a8f-b49f-dc9f586b093d None None] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:14.131728 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eb5a70d5-2894-4a8f-b49f-dc9f586b093d None None] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:14.143254 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.compute.rpcapi [None req-eb5a70d5-2894-4a8f-b49f-dc9f586b093d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Mar 03 02:31:14.144812 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eb5a70d5-2894-4a8f-b49f-dc9f586b093d None None] Releasing lock "compute-rpcapi-router" {{(pid=116859) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 03 02:31:14.174940 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-eb5a70d5-2894-4a8f-b49f-dc9f586b093d None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147633 Mar 03 02:31:14.175737 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 22/52] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:31:14.315062 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c42ab209-e51b-43de-a687-d38ea3b70d8e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:14.322315 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c42ab209-e51b-43de-a687-d38ea3b70d8e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619" status: 200 len: 1318 microversion: 2.1 time: 1.444839 Mar 03 02:31:14.339077 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 31/53] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:12 2022] GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619 => generated 1318 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:31:14.673494 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d28f3549-5b58-456b-9d1d-03aa9119e37b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:14.675981 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d28f3549-5b58-456b-9d1d-03aa9119e37b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] [instance: ef11fe69-5cf1-46cc-afdd-57b330c977d6] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:14.691948 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d28f3549-5b58-456b-9d1d-03aa9119e37b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:14.694567 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d28f3549-5b58-456b-9d1d-03aa9119e37b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:14.695543 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d28f3549-5b58-456b-9d1d-03aa9119e37b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:14.698130 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d28f3549-5b58-456b-9d1d-03aa9119e37b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:14.884380 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c3f6fc19-29b9-49b2-b698-707d51c97d1a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:14.885184 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c3f6fc19-29b9-49b2-b698-707d51c97d1a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:14.898825 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c3f6fc19-29b9-49b2-b698-707d51c97d1a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:14.899552 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c3f6fc19-29b9-49b2-b698-707d51c97d1a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:14.900423 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c3f6fc19-29b9-49b2-b698-707d51c97d1a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:14.900869 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c3f6fc19-29b9-49b2-b698-707d51c97d1a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:15.240726 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d28f3549-5b58-456b-9d1d-03aa9119e37b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc43d1c3ceb4bc88fc588ef91f25dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391f419b7b114f10a01c5a7cdc200770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:15.254029 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d28f3549-5b58-456b-9d1d-03aa9119e37b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] 10.222.0.30 "GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6" status: 200 len: 1315 microversion: 2.1 time: 0.586555 Mar 03 02:31:15.256527 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 23/54] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:14 2022] GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6 => generated 1315 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:15.364048 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [req-dc111d01-49d3-4a6f-a706-86b9df091717 req-6988c19f-fb1f-4c70-a05a-1f646f859551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef11fe69-5cf1-46cc-afdd-57b330c977d6", "name": "network-vif-plugged", "status": "completed", "tag": "9d1b4fb7-cbb1-4036-be2d-33ac3458786e"}]} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:31:15.377129 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-dc111d01-49d3-4a6f-a706-86b9df091717 req-6988c19f-fb1f-4c70-a05a-1f646f859551 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:15.381589 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-dc111d01-49d3-4a6f-a706-86b9df091717 req-6988c19f-fb1f-4c70-a05a-1f646f859551 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:15.394700 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.compute.server_external_events [req-dc111d01-49d3-4a6f-a706-86b9df091717 req-6988c19f-fb1f-4c70-a05a-1f646f859551 service nova] Creating event network-vif-plugged:9d1b4fb7-cbb1-4036-be2d-33ac3458786e for instance ef11fe69-5cf1-46cc-afdd-57b330c977d6 on hv-cinder-81977 Mar 03 02:31:15.399908 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [req-dc111d01-49d3-4a6f-a706-86b9df091717 req-6988c19f-fb1f-4c70-a05a-1f646f859551 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141327 Mar 03 02:31:15.401013 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 24/55] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:31:15.408817 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0c321944-1558-4876-b99e-2f879e082e56 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:15.409852 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0c321944-1558-4876-b99e-2f879e082e56 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:15.419008 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0c321944-1558-4876-b99e-2f879e082e56 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:15.419791 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0c321944-1558-4876-b99e-2f879e082e56 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:15.420801 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0c321944-1558-4876-b99e-2f879e082e56 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:15.421668 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0c321944-1558-4876-b99e-2f879e082e56 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:15.558713 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0c321944-1558-4876-b99e-2f879e082e56 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:15.567529 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0c321944-1558-4876-b99e-2f879e082e56 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1280 microversion: 2.1 time: 0.165051 Mar 03 02:31:15.581421 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 25/56] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:15 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1280 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:15.587187 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7417eb9c-b1cc-4b73-9586-595de3dd8976 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:15.588071 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7417eb9c-b1cc-4b73-9586-595de3dd8976 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: dd292525-cb8e-4520-a771-d22e2d3d6619] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:15.595199 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7417eb9c-b1cc-4b73-9586-595de3dd8976 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:15.596109 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7417eb9c-b1cc-4b73-9586-595de3dd8976 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:15.597207 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7417eb9c-b1cc-4b73-9586-595de3dd8976 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:15.598783 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7417eb9c-b1cc-4b73-9586-595de3dd8976 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:15.721121 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c3f6fc19-29b9-49b2-b698-707d51c97d1a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:15.731169 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c3f6fc19-29b9-49b2-b698-707d51c97d1a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:15.733651 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c3f6fc19-29b9-49b2-b698-707d51c97d1a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:15.736023 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c3f6fc19-29b9-49b2-b698-707d51c97d1a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1407 microversion: 2.20 time: 0.865613 Mar 03 02:31:15.737745 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 32/57] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:31:14 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1407 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:31:15.746111 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c57d21f2-f905-4c54-abda-972b45acef9f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-809285791", "imageRef": "1fe11a1a-b4d0-46f5-89cd-501ceff49317", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9c930170-270e-4188-a4ea-bd425f18a7f8"}], "security_groups": [{"name": "tempest-securitygroup--587703880"}], "key_name": "tempest-keypair-504147627", "user_data": "}} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:31:15.978725 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-7417eb9c-b1cc-4b73-9586-595de3dd8976 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:15.993830 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7417eb9c-b1cc-4b73-9586-595de3dd8976 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619" status: 200 len: 1318 microversion: 2.1 time: 0.410896 Mar 03 02:31:16.004158 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.network.neutron [None req-c57d21f2-f905-4c54-abda-972b45acef9f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] validate_networks() for [('9c930170-270e-4188-a4ea-bd425f18a7f8', None, None, None, None, None)] {{(pid=116858) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 03 02:31:16.005067 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 26/58] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:15 2022] GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619 => generated 1318 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:16.274632 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0c387eea-062f-40f7-a046-b5028f966c3e tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:16.275380 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0c387eea-062f-40f7-a046-b5028f966c3e tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] [instance: ef11fe69-5cf1-46cc-afdd-57b330c977d6] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:16.287846 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0c387eea-062f-40f7-a046-b5028f966c3e tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:16.288294 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0c387eea-062f-40f7-a046-b5028f966c3e tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:16.292116 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0c387eea-062f-40f7-a046-b5028f966c3e tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:16.294227 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0c387eea-062f-40f7-a046-b5028f966c3e tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:16.646528 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0c387eea-062f-40f7-a046-b5028f966c3e tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc43d1c3ceb4bc88fc588ef91f25dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391f419b7b114f10a01c5a7cdc200770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:16.654505 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0c387eea-062f-40f7-a046-b5028f966c3e tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] 10.222.0.30 "GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6" status: 200 len: 1315 microversion: 2.1 time: 0.383861 Mar 03 02:31:16.660062 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 27/59] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:16 2022] GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6 => generated 1315 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:31:16.667103 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8756ce67-1d88-4963-9c4f-15ce699b7ae4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:16.672205 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8756ce67-1d88-4963-9c4f-15ce699b7ae4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:16.679957 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8756ce67-1d88-4963-9c4f-15ce699b7ae4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:16.680971 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8756ce67-1d88-4963-9c4f-15ce699b7ae4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:16.681914 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8756ce67-1d88-4963-9c4f-15ce699b7ae4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:16.682624 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8756ce67-1d88-4963-9c4f-15ce699b7ae4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:16.861919 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8756ce67-1d88-4963-9c4f-15ce699b7ae4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:16.870163 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8756ce67-1d88-4963-9c4f-15ce699b7ae4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1322 microversion: 2.1 time: 0.208200 Mar 03 02:31:16.870764 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 28/60] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:16 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:16.876758 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-888ab317-dd56-40a2-bbd4-cd433de0167b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:16.877622 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-888ab317-dd56-40a2-bbd4-cd433de0167b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:16.884929 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-888ab317-dd56-40a2-bbd4-cd433de0167b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:16.885385 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-888ab317-dd56-40a2-bbd4-cd433de0167b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:16.886225 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-888ab317-dd56-40a2-bbd4-cd433de0167b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:16.886662 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-888ab317-dd56-40a2-bbd4-cd433de0167b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:17.044526 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-888ab317-dd56-40a2-bbd4-cd433de0167b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:17.061719 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-888ab317-dd56-40a2-bbd4-cd433de0167b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:17.064463 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-888ab317-dd56-40a2-bbd4-cd433de0167b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:17.066241 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-888ab317-dd56-40a2-bbd4-cd433de0167b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1407 microversion: 2.20 time: 0.193434 Mar 03 02:31:17.067469 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 29/61] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:31:16 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:31:17.072516 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0fb39f2f-8ac5-4b70-b8f3-088b3eeeb9a4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:17.072992 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0fb39f2f-8ac5-4b70-b8f3-088b3eeeb9a4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: dd292525-cb8e-4520-a771-d22e2d3d6619] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:17.081362 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0fb39f2f-8ac5-4b70-b8f3-088b3eeeb9a4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:17.082508 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0fb39f2f-8ac5-4b70-b8f3-088b3eeeb9a4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:17.083460 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0fb39f2f-8ac5-4b70-b8f3-088b3eeeb9a4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:17.084250 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0fb39f2f-8ac5-4b70-b8f3-088b3eeeb9a4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:17.260958 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0fb39f2f-8ac5-4b70-b8f3-088b3eeeb9a4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:17.292815 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0fb39f2f-8ac5-4b70-b8f3-088b3eeeb9a4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619" status: 200 len: 1318 microversion: 2.1 time: 0.222633 Mar 03 02:31:17.293922 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 30/62] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:17 2022] GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:17.299949 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [req-07c3ee98-37ce-4b0e-ba79-cbb32293bef7 req-f879a328-1413-495e-b56f-8fdbc27fda95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7a0db60-ea15-44e4-a1ca-41531a1aa5c3", "tag": "9d68d852-474d-4287-a7c4-83666d7f71d4"}]} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:31:17.310932 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-07c3ee98-37ce-4b0e-ba79-cbb32293bef7 req-f879a328-1413-495e-b56f-8fdbc27fda95 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:17.311789 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-07c3ee98-37ce-4b0e-ba79-cbb32293bef7 req-f879a328-1413-495e-b56f-8fdbc27fda95 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:17.325254 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.compute.server_external_events [req-07c3ee98-37ce-4b0e-ba79-cbb32293bef7 req-f879a328-1413-495e-b56f-8fdbc27fda95 service nova] Creating event network-changed:9d68d852-474d-4287-a7c4-83666d7f71d4 for instance f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 on hv-cinder-81977 Mar 03 02:31:17.333362 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [req-07c3ee98-37ce-4b0e-ba79-cbb32293bef7 req-f879a328-1413-495e-b56f-8fdbc27fda95 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038103 Mar 03 02:31:17.334493 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 31/63] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:31:17.420152 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [req-329ff29f-f03c-4b67-9820-cd2994e1f43d req-d3ce8512-4f59-4872-a628-55633c6574b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd292525-cb8e-4520-a771-d22e2d3d6619", "name": "network-vif-plugged", "status": "completed", "tag": "5424b4bf-994a-4ee5-b949-44d34e8975fc"}]} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:31:17.434703 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-c57d21f2-f905-4c54-abda-972b45acef9f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Flavor limits 0:0:0 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 03 02:31:17.435305 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-c57d21f2-f905-4c54-abda-972b45acef9f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Image limits 0:0:0 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 03 02:31:17.435732 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-c57d21f2-f905-4c54-abda-972b45acef9f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Flavor pref 0:0:0 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 03 02:31:17.436015 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-c57d21f2-f905-4c54-abda-972b45acef9f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Image pref 0:0:0 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 03 02:31:17.436426 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-c57d21f2-f905-4c54-abda-972b45acef9f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 03 02:31:17.438479 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-329ff29f-f03c-4b67-9820-cd2994e1f43d req-d3ce8512-4f59-4872-a628-55633c6574b2 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:17.439018 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-329ff29f-f03c-4b67-9820-cd2994e1f43d req-d3ce8512-4f59-4872-a628-55633c6574b2 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:17.454594 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c57d21f2-f905-4c54-abda-972b45acef9f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:17.455081 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c57d21f2-f905-4c54-abda-972b45acef9f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:17.455879 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c57d21f2-f905-4c54-abda-972b45acef9f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:17.456315 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c57d21f2-f905-4c54-abda-972b45acef9f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:17.459454 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.compute.server_external_events [req-329ff29f-f03c-4b67-9820-cd2994e1f43d req-d3ce8512-4f59-4872-a628-55633c6574b2 service nova] Creating event network-vif-plugged:5424b4bf-994a-4ee5-b949-44d34e8975fc for instance dd292525-cb8e-4520-a771-d22e2d3d6619 on hv-cinder-81977 Mar 03 02:31:17.468312 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [req-329ff29f-f03c-4b67-9820-cd2994e1f43d req-d3ce8512-4f59-4872-a628-55633c6574b2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052635 Mar 03 02:31:17.469392 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 32/64] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:31:17.497596 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.quota [None req-c57d21f2-f905-4c54-abda-972b45acef9f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Getting quotas for project 204a19c418b44e9fa1c46a1fd0a0294b. Resources: {'instances', 'ram', 'cores'} {{(pid=116858) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 03 02:31:17.507175 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.quota [None req-c57d21f2-f905-4c54-abda-972b45acef9f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Getting quotas for user 211640f2c9e54914a33b7cf26ebf4a51 and project 204a19c418b44e9fa1c46a1fd0a0294b. Resources: {'instances', 'ram', 'cores'} {{(pid=116858) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 03 02:31:17.532755 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c57d21f2-f905-4c54-abda-972b45acef9f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Going to run 1 instances... {{(pid=116858) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 03 02:31:17.534874 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c57d21f2-f905-4c54-abda-972b45acef9f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1fe11a1a-b4d0-46f5-89cd-501ceff49317',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116858) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 03 02:31:17.629581 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c57d21f2-f905-4c54-abda-972b45acef9f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.890416 Mar 03 02:31:17.630949 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 33/65] 10.222.0.30 () {60 vars in 1146 bytes} [Thu Mar 3 02:31:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 1892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 03 02:31:17.641471 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-295484d6-3328-4199-abf4-292b35dfcdba tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:17.647713 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-295484d6-3328-4199-abf4-292b35dfcdba tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:17.677019 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-fb5adc2f-9247-4c9b-8beb-446b25f66e4b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:17.678438 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-fb5adc2f-9247-4c9b-8beb-446b25f66e4b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] [instance: ef11fe69-5cf1-46cc-afdd-57b330c977d6] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:17.697586 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fb5adc2f-9247-4c9b-8beb-446b25f66e4b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:17.698252 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fb5adc2f-9247-4c9b-8beb-446b25f66e4b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:17.699200 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fb5adc2f-9247-4c9b-8beb-446b25f66e4b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:17.700643 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fb5adc2f-9247-4c9b-8beb-446b25f66e4b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:17.842110 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-295484d6-3328-4199-abf4-292b35dfcdba tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:17.853236 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-295484d6-3328-4199-abf4-292b35dfcdba tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1236 microversion: 2.1 time: 0.216332 Mar 03 02:31:17.854023 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 33/66] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:17 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1236 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:17.890298 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-99ede4c3-23f9-472f-beef-493527713875 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:17.891124 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-99ede4c3-23f9-472f-beef-493527713875 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:17.916564 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-99ede4c3-23f9-472f-beef-493527713875 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:17.917264 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-99ede4c3-23f9-472f-beef-493527713875 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:17.918125 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-99ede4c3-23f9-472f-beef-493527713875 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:17.918742 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-99ede4c3-23f9-472f-beef-493527713875 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:18.211842 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-99ede4c3-23f9-472f-beef-493527713875 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:18.220842 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-99ede4c3-23f9-472f-beef-493527713875 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1322 microversion: 2.1 time: 0.335564 Mar 03 02:31:18.223090 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 34/67] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:17 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1322 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:31:18.228791 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1be96f35-9cb8-42a8-bdfd-9f97934b70d9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:18.229474 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1be96f35-9cb8-42a8-bdfd-9f97934b70d9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:18.237369 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1be96f35-9cb8-42a8-bdfd-9f97934b70d9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:18.238077 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1be96f35-9cb8-42a8-bdfd-9f97934b70d9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:18.239178 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1be96f35-9cb8-42a8-bdfd-9f97934b70d9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:18.239985 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1be96f35-9cb8-42a8-bdfd-9f97934b70d9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:18.472823 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1be96f35-9cb8-42a8-bdfd-9f97934b70d9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:18.492596 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1be96f35-9cb8-42a8-bdfd-9f97934b70d9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:18.499200 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1be96f35-9cb8-42a8-bdfd-9f97934b70d9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:18.504882 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1be96f35-9cb8-42a8-bdfd-9f97934b70d9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1407 microversion: 2.20 time: 0.277208 Mar 03 02:31:18.505813 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 35/68] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:31:18 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1407 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:31:18.518140 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-07616021-ff5a-4310-aa9c-886505c6b274 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:18.518764 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-07616021-ff5a-4310-aa9c-886505c6b274 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: dd292525-cb8e-4520-a771-d22e2d3d6619] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:18.528844 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-07616021-ff5a-4310-aa9c-886505c6b274 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:18.530836 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-07616021-ff5a-4310-aa9c-886505c6b274 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:18.531863 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-07616021-ff5a-4310-aa9c-886505c6b274 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:18.532496 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-07616021-ff5a-4310-aa9c-886505c6b274 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:18.573454 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-fb5adc2f-9247-4c9b-8beb-446b25f66e4b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc43d1c3ceb4bc88fc588ef91f25dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391f419b7b114f10a01c5a7cdc200770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:18.581160 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-fb5adc2f-9247-4c9b-8beb-446b25f66e4b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] 10.222.0.30 "GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6" status: 200 len: 1315 microversion: 2.1 time: 0.908328 Mar 03 02:31:18.598132 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 34/69] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:17 2022] GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6 => generated 1315 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:31:18.718050 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-07616021-ff5a-4310-aa9c-886505c6b274 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:18.727730 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-07616021-ff5a-4310-aa9c-886505c6b274 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619" status: 200 len: 1318 microversion: 2.1 time: 0.220587 Mar 03 02:31:18.737675 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 36/70] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:18 2022] GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:18.870204 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5043beef-1550-4d31-97e3-a086a9f84ba3 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:18.871024 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5043beef-1550-4d31-97e3-a086a9f84ba3 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:18.880351 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5043beef-1550-4d31-97e3-a086a9f84ba3 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:18.883715 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5043beef-1550-4d31-97e3-a086a9f84ba3 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:18.884706 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5043beef-1550-4d31-97e3-a086a9f84ba3 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:18.885302 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5043beef-1550-4d31-97e3-a086a9f84ba3 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:19.083977 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5043beef-1550-4d31-97e3-a086a9f84ba3 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:19.093564 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5043beef-1550-4d31-97e3-a086a9f84ba3 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1288 microversion: 2.1 time: 0.227059 Mar 03 02:31:19.095895 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 35/71] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:18 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1288 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:31:19.242425 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-16d42f9d-e49f-4155-abab-7d3d348f3e42 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:19.243666 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-16d42f9d-e49f-4155-abab-7d3d348f3e42 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:19.254139 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-16d42f9d-e49f-4155-abab-7d3d348f3e42 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:19.257605 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-16d42f9d-e49f-4155-abab-7d3d348f3e42 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:19.258704 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-16d42f9d-e49f-4155-abab-7d3d348f3e42 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:19.259405 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-16d42f9d-e49f-4155-abab-7d3d348f3e42 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:19.354358 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [req-81bf3afc-b014-4650-84a7-ac345acd8b67 req-8a845199-6694-488e-82e3-85faea93b68b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d34e2006-f63a-4cb6-99d2-47d791fbefcf", "tag": "276ceb62-db32-4f9d-86c8-a5060ec08dd1"}]} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:31:19.364599 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-81bf3afc-b014-4650-84a7-ac345acd8b67 req-8a845199-6694-488e-82e3-85faea93b68b service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:19.365192 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-81bf3afc-b014-4650-84a7-ac345acd8b67 req-8a845199-6694-488e-82e3-85faea93b68b service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:19.406208 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.compute.server_external_events [req-81bf3afc-b014-4650-84a7-ac345acd8b67 req-8a845199-6694-488e-82e3-85faea93b68b service nova] Creating event network-changed:276ceb62-db32-4f9d-86c8-a5060ec08dd1 for instance d34e2006-f63a-4cb6-99d2-47d791fbefcf on hv-cinder-81977 Mar 03 02:31:19.419828 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [req-81bf3afc-b014-4650-84a7-ac345acd8b67 req-8a845199-6694-488e-82e3-85faea93b68b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067153 Mar 03 02:31:19.421629 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 36/72] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:31:19.523684 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8ef148e6-cf0a-4f03-ab55-9e2cc53c9b16 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:19.524398 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8ef148e6-cf0a-4f03-ab55-9e2cc53c9b16 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:19.539487 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8ef148e6-cf0a-4f03-ab55-9e2cc53c9b16 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:19.542136 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8ef148e6-cf0a-4f03-ab55-9e2cc53c9b16 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:19.545154 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8ef148e6-cf0a-4f03-ab55-9e2cc53c9b16 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:19.549881 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8ef148e6-cf0a-4f03-ab55-9e2cc53c9b16 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:19.640210 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-16d42f9d-e49f-4155-abab-7d3d348f3e42 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:19.650441 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-16d42f9d-e49f-4155-abab-7d3d348f3e42 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1322 microversion: 2.1 time: 0.413126 Mar 03 02:31:19.655664 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 37/73] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:19 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1322 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:19.666431 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ac566e73-aabe-48d7-b11e-fe6886645979 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:19.667125 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ac566e73-aabe-48d7-b11e-fe6886645979 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] [instance: ef11fe69-5cf1-46cc-afdd-57b330c977d6] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:19.675023 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ac566e73-aabe-48d7-b11e-fe6886645979 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:19.675568 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ac566e73-aabe-48d7-b11e-fe6886645979 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:19.676416 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ac566e73-aabe-48d7-b11e-fe6886645979 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:19.677038 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ac566e73-aabe-48d7-b11e-fe6886645979 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:19.936953 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ac566e73-aabe-48d7-b11e-fe6886645979 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc43d1c3ceb4bc88fc588ef91f25dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391f419b7b114f10a01c5a7cdc200770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:19.945226 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ac566e73-aabe-48d7-b11e-fe6886645979 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] 10.222.0.30 "GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6" status: 200 len: 1502 microversion: 2.1 time: 0.292294 Mar 03 02:31:19.945950 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 38/74] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:19 2022] GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6 => generated 1502 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:19.952080 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4a218db4-1d60-4331-ad03-cf3543dabc13 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:19.953004 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4a218db4-1d60-4331-ad03-cf3543dabc13 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: dd292525-cb8e-4520-a771-d22e2d3d6619] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:19.965913 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4a218db4-1d60-4331-ad03-cf3543dabc13 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:19.967000 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4a218db4-1d60-4331-ad03-cf3543dabc13 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:19.967858 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4a218db4-1d60-4331-ad03-cf3543dabc13 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:19.968416 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4a218db4-1d60-4331-ad03-cf3543dabc13 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:20.241129 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4a218db4-1d60-4331-ad03-cf3543dabc13 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:20.257277 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4a218db4-1d60-4331-ad03-cf3543dabc13 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619" status: 200 len: 1507 microversion: 2.1 time: 0.309940 Mar 03 02:31:20.259093 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 39/75] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:19 2022] GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619 => generated 1507 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:20.264201 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-dcf80b22-8a12-4910-9724-bd4a67dad2ee tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:20.265074 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-dcf80b22-8a12-4910-9724-bd4a67dad2ee tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:20.275565 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dcf80b22-8a12-4910-9724-bd4a67dad2ee tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:20.276068 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dcf80b22-8a12-4910-9724-bd4a67dad2ee tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:20.283918 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dcf80b22-8a12-4910-9724-bd4a67dad2ee tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:20.284449 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dcf80b22-8a12-4910-9724-bd4a67dad2ee tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:20.393464 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8ef148e6-cf0a-4f03-ab55-9e2cc53c9b16 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:20.413352 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8ef148e6-cf0a-4f03-ab55-9e2cc53c9b16 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:20.418162 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8ef148e6-cf0a-4f03-ab55-9e2cc53c9b16 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:20.423642 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8ef148e6-cf0a-4f03-ab55-9e2cc53c9b16 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1407 microversion: 2.20 time: 0.902220 Mar 03 02:31:20.424326 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 37/76] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:31:19 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1407 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:31:20.517435 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-dcf80b22-8a12-4910-9724-bd4a67dad2ee tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:20.524889 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-dcf80b22-8a12-4910-9724-bd4a67dad2ee tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1294 microversion: 2.1 time: 0.264408 Mar 03 02:31:20.525473 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 40/77] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:20 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1294 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:20.628248 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [req-946df09d-1182-4e71-bb23-0e1edfc3a39a req-267ef20a-b369-4260-9d2a-d02d5f1ae16d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b9116d7-0099-4dfe-b678-192ce74500eb", "name": "network-vif-plugged", "status": "completed", "tag": "b914fbeb-7aa5-47c8-9b2c-7bd96a54163e"}]} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:31:20.642097 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-946df09d-1182-4e71-bb23-0e1edfc3a39a req-267ef20a-b369-4260-9d2a-d02d5f1ae16d service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:20.644816 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-946df09d-1182-4e71-bb23-0e1edfc3a39a req-267ef20a-b369-4260-9d2a-d02d5f1ae16d service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:20.668942 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7ada7254-6d71-400d-ac7b-69348b9f5402 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:20.669778 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7ada7254-6d71-400d-ac7b-69348b9f5402 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:20.682186 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7ada7254-6d71-400d-ac7b-69348b9f5402 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:20.682663 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7ada7254-6d71-400d-ac7b-69348b9f5402 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:20.683904 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.compute.server_external_events [req-946df09d-1182-4e71-bb23-0e1edfc3a39a req-267ef20a-b369-4260-9d2a-d02d5f1ae16d service nova] Creating event network-vif-plugged:b914fbeb-7aa5-47c8-9b2c-7bd96a54163e for instance 0b9116d7-0099-4dfe-b678-192ce74500eb on hv-cinder-81977 Mar 03 02:31:20.687242 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7ada7254-6d71-400d-ac7b-69348b9f5402 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:20.688416 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7ada7254-6d71-400d-ac7b-69348b9f5402 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:20.702134 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [req-946df09d-1182-4e71-bb23-0e1edfc3a39a req-267ef20a-b369-4260-9d2a-d02d5f1ae16d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075114 Mar 03 02:31:20.706715 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 38/78] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:31:21.082528 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-7ada7254-6d71-400d-ac7b-69348b9f5402 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:21.090753 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7ada7254-6d71-400d-ac7b-69348b9f5402 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1322 microversion: 2.1 time: 0.426268 Mar 03 02:31:21.094268 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 41/79] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:20 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1322 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:21.384582 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e343bb83-f3ad-43cd-842c-2e61817590fd tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87484620-4ef9-496d-9244-17fbb797fdb9"}} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:31:21.385916 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e343bb83-f3ad-43cd-842c-2e61817590fd tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] [instance: ef11fe69-5cf1-46cc-afdd-57b330c977d6] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:21.392987 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e343bb83-f3ad-43cd-842c-2e61817590fd tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:21.393846 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e343bb83-f3ad-43cd-842c-2e61817590fd tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:21.395446 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e343bb83-f3ad-43cd-842c-2e61817590fd tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:21.395968 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e343bb83-f3ad-43cd-842c-2e61817590fd tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:21.444783 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-72284109-0ab0-48be-b0e7-3642ea372afe tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:21.445812 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-72284109-0ab0-48be-b0e7-3642ea372afe tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:21.457060 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-72284109-0ab0-48be-b0e7-3642ea372afe tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:21.459335 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-72284109-0ab0-48be-b0e7-3642ea372afe tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:21.460722 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-72284109-0ab0-48be-b0e7-3642ea372afe tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:21.465379 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-72284109-0ab0-48be-b0e7-3642ea372afe tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:21.718989 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-72284109-0ab0-48be-b0e7-3642ea372afe tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:21.729032 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-72284109-0ab0-48be-b0e7-3642ea372afe tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:21.731186 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-72284109-0ab0-48be-b0e7-3642ea372afe tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:21.733025 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-72284109-0ab0-48be-b0e7-3642ea372afe tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1407 microversion: 2.20 time: 0.293080 Mar 03 02:31:21.734718 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 42/80] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:31:21 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1407 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:31:21.739894 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-79b5164f-9860-48ff-a42c-a6a7dc50abca tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:21.740703 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-79b5164f-9860-48ff-a42c-a6a7dc50abca tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:21.747376 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-79b5164f-9860-48ff-a42c-a6a7dc50abca tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:21.748797 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-79b5164f-9860-48ff-a42c-a6a7dc50abca tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:21.749612 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-79b5164f-9860-48ff-a42c-a6a7dc50abca tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:21.750060 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-79b5164f-9860-48ff-a42c-a6a7dc50abca tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:21.907248 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e343bb83-f3ad-43cd-842c-2e61817590fd tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] 10.222.0.30 "POST /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.528008 Mar 03 02:31:21.913126 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 39/81] 10.222.0.30 () {60 vars in 1322 bytes} [Thu Mar 3 02:31:21 2022] POST /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6/os-volume_attachments => generated 194 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:31:21.993562 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5e958284-65bf-4f68-b484-1814d7574314 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd43e02d-9618-4fe0-94cb-53c31b6af67b"}} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:31:21.995066 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5e958284-65bf-4f68-b484-1814d7574314 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: dd292525-cb8e-4520-a771-d22e2d3d6619] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:22.012943 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5e958284-65bf-4f68-b484-1814d7574314 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:22.013652 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5e958284-65bf-4f68-b484-1814d7574314 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:22.014812 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5e958284-65bf-4f68-b484-1814d7574314 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:22.015394 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5e958284-65bf-4f68-b484-1814d7574314 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:22.035829 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-79b5164f-9860-48ff-a42c-a6a7dc50abca tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:22.047564 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-79b5164f-9860-48ff-a42c-a6a7dc50abca tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1361 microversion: 2.1 time: 0.311564 Mar 03 02:31:22.049184 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 43/82] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:21 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1361 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:22.113462 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-46e235de-d6e9-49d1-852d-600bc1b09c7f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:22.115643 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-46e235de-d6e9-49d1-852d-600bc1b09c7f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:22.124149 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-46e235de-d6e9-49d1-852d-600bc1b09c7f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:22.125123 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-46e235de-d6e9-49d1-852d-600bc1b09c7f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:22.126138 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-46e235de-d6e9-49d1-852d-600bc1b09c7f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:22.126782 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-46e235de-d6e9-49d1-852d-600bc1b09c7f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:22.554160 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5e958284-65bf-4f68-b484-1814d7574314 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "POST /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.561913 Mar 03 02:31:22.566251 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 40/83] 10.222.0.30 () {60 vars in 1322 bytes} [Thu Mar 3 02:31:21 2022] POST /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619/os-volume_attachments => generated 194 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:31:22.635499 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-46e235de-d6e9-49d1-852d-600bc1b09c7f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:22.647521 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-46e235de-d6e9-49d1-852d-600bc1b09c7f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1322 microversion: 2.1 time: 0.539005 Mar 03 02:31:22.663671 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 44/84] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:22 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1322 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:31:22.754616 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-469b7fe9-21ee-4771-8816-f92131aeaa39 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:22.755708 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-469b7fe9-21ee-4771-8816-f92131aeaa39 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:22.771139 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-469b7fe9-21ee-4771-8816-f92131aeaa39 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:22.774548 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-469b7fe9-21ee-4771-8816-f92131aeaa39 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:22.775387 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-469b7fe9-21ee-4771-8816-f92131aeaa39 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:22.775914 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-469b7fe9-21ee-4771-8816-f92131aeaa39 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:23.073604 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f004c17f-ff9f-4d91-a5b6-53418c8c2c10 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:23.075300 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f004c17f-ff9f-4d91-a5b6-53418c8c2c10 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:23.084400 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f004c17f-ff9f-4d91-a5b6-53418c8c2c10 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:23.087225 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f004c17f-ff9f-4d91-a5b6-53418c8c2c10 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:23.088310 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f004c17f-ff9f-4d91-a5b6-53418c8c2c10 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:23.088959 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f004c17f-ff9f-4d91-a5b6-53418c8c2c10 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:23.203886 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-469b7fe9-21ee-4771-8816-f92131aeaa39 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:23.215010 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-469b7fe9-21ee-4771-8816-f92131aeaa39 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:23.218661 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-469b7fe9-21ee-4771-8816-f92131aeaa39 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:23.219854 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-469b7fe9-21ee-4771-8816-f92131aeaa39 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1407 microversion: 2.20 time: 0.470317 Mar 03 02:31:23.220417 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 41/85] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:31:22 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1407 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:31:23.374646 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f004c17f-ff9f-4d91-a5b6-53418c8c2c10 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:23.381523 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [req-df91cc86-f7ec-4eb7-a9fe-aa107a160e69 req-66a0f189-782e-44c1-96fe-f24fbb7ad7f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df03ab77-ba2a-4603-b517-8e7b435882f2", "tag": "efc411a0-4951-463f-9b9e-b0b169a4a793"}]} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:31:23.393036 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f004c17f-ff9f-4d91-a5b6-53418c8c2c10 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1361 microversion: 2.1 time: 0.327559 Mar 03 02:31:23.397469 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 45/86] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:23 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1361 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:31:23.398795 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-df91cc86-f7ec-4eb7-a9fe-aa107a160e69 req-66a0f189-782e-44c1-96fe-f24fbb7ad7f8 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:23.399302 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-df91cc86-f7ec-4eb7-a9fe-aa107a160e69 req-66a0f189-782e-44c1-96fe-f24fbb7ad7f8 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:23.410817 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.compute.server_external_events [req-df91cc86-f7ec-4eb7-a9fe-aa107a160e69 req-66a0f189-782e-44c1-96fe-f24fbb7ad7f8 service nova] Creating event network-changed:efc411a0-4951-463f-9b9e-b0b169a4a793 for instance df03ab77-ba2a-4603-b517-8e7b435882f2 on hv-cinder-81977 Mar 03 02:31:23.415926 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [req-df91cc86-f7ec-4eb7-a9fe-aa107a160e69 req-66a0f189-782e-44c1-96fe-f24fbb7ad7f8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043696 Mar 03 02:31:23.417178 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 42/87] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:31:23.687489 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e6cf2709-e956-44a3-86f4-48fdc3e904cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:23.690034 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e6cf2709-e956-44a3-86f4-48fdc3e904cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:23.703996 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e6cf2709-e956-44a3-86f4-48fdc3e904cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:23.704746 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e6cf2709-e956-44a3-86f4-48fdc3e904cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:23.705887 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e6cf2709-e956-44a3-86f4-48fdc3e904cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:23.706578 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e6cf2709-e956-44a3-86f4-48fdc3e904cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:23.934867 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e6cf2709-e956-44a3-86f4-48fdc3e904cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:23.946183 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e6cf2709-e956-44a3-86f4-48fdc3e904cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1322 microversion: 2.1 time: 0.269915 Mar 03 02:31:23.959769 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 46/88] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:23 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1322 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:24.240168 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-aaa29083-76ba-4032-9ac4-26bcefc41816 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:24.242015 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-aaa29083-76ba-4032-9ac4-26bcefc41816 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:24.258708 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aaa29083-76ba-4032-9ac4-26bcefc41816 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:24.259457 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aaa29083-76ba-4032-9ac4-26bcefc41816 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:24.262371 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aaa29083-76ba-4032-9ac4-26bcefc41816 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:24.264681 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aaa29083-76ba-4032-9ac4-26bcefc41816 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:24.417849 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d6061291-7b2b-49a6-b554-4bbd67be0a7b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:24.419027 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d6061291-7b2b-49a6-b554-4bbd67be0a7b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:24.427456 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d6061291-7b2b-49a6-b554-4bbd67be0a7b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:24.428202 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d6061291-7b2b-49a6-b554-4bbd67be0a7b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:24.429514 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d6061291-7b2b-49a6-b554-4bbd67be0a7b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:24.430360 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d6061291-7b2b-49a6-b554-4bbd67be0a7b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:24.534541 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-aaa29083-76ba-4032-9ac4-26bcefc41816 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:24.545709 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-aaa29083-76ba-4032-9ac4-26bcefc41816 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:24.547434 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-aaa29083-76ba-4032-9ac4-26bcefc41816 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:24.548789 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-aaa29083-76ba-4032-9ac4-26bcefc41816 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1407 microversion: 2.20 time: 0.313822 Mar 03 02:31:24.549652 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 43/89] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:31:24 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1407 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:31:24.606298 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d6061291-7b2b-49a6-b554-4bbd67be0a7b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:24.615302 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d6061291-7b2b-49a6-b554-4bbd67be0a7b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1361 microversion: 2.1 time: 0.205652 Mar 03 02:31:24.616521 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 47/90] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:24 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1361 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:24.977029 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-22277e5a-6185-47ed-abb4-570b716b22ce tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:24.979298 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-22277e5a-6185-47ed-abb4-570b716b22ce tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:24.993596 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-22277e5a-6185-47ed-abb4-570b716b22ce tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:24.994663 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-22277e5a-6185-47ed-abb4-570b716b22ce tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:24.997359 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-22277e5a-6185-47ed-abb4-570b716b22ce tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:24.998227 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-22277e5a-6185-47ed-abb4-570b716b22ce tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:25.233137 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-22277e5a-6185-47ed-abb4-570b716b22ce tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:25.243973 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-22277e5a-6185-47ed-abb4-570b716b22ce tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1322 microversion: 2.1 time: 0.283184 Mar 03 02:31:25.244645 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 44/91] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:24 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1322 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:25.566739 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-88f748bb-0c33-4903-a783-3e2cd7dd4837 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:25.567324 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-88f748bb-0c33-4903-a783-3e2cd7dd4837 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:25.577721 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-88f748bb-0c33-4903-a783-3e2cd7dd4837 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:25.578295 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-88f748bb-0c33-4903-a783-3e2cd7dd4837 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:25.578970 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-88f748bb-0c33-4903-a783-3e2cd7dd4837 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:25.583523 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-88f748bb-0c33-4903-a783-3e2cd7dd4837 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:25.633887 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3224cd8f-617d-411a-8a62-840b0d94dfb5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:25.634569 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3224cd8f-617d-411a-8a62-840b0d94dfb5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:25.649402 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3224cd8f-617d-411a-8a62-840b0d94dfb5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:25.650196 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3224cd8f-617d-411a-8a62-840b0d94dfb5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:25.651533 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3224cd8f-617d-411a-8a62-840b0d94dfb5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:25.652194 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3224cd8f-617d-411a-8a62-840b0d94dfb5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:25.823126 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-3224cd8f-617d-411a-8a62-840b0d94dfb5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:25.833111 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3224cd8f-617d-411a-8a62-840b0d94dfb5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1361 microversion: 2.1 time: 0.202811 Mar 03 02:31:25.843261 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 45/92] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:25 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1361 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:31:25.843537 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-88f748bb-0c33-4903-a783-3e2cd7dd4837 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:25.845903 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-88f748bb-0c33-4903-a783-3e2cd7dd4837 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:25.847707 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-88f748bb-0c33-4903-a783-3e2cd7dd4837 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:25.848820 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-88f748bb-0c33-4903-a783-3e2cd7dd4837 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1407 microversion: 2.20 time: 0.286055 Mar 03 02:31:25.849618 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 48/93] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:31:25 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1407 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:31:26.265132 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-426c2926-b169-45eb-9a43-507269c73caf tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:26.266277 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-426c2926-b169-45eb-9a43-507269c73caf tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:26.272267 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-426c2926-b169-45eb-9a43-507269c73caf tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:26.272968 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-426c2926-b169-45eb-9a43-507269c73caf tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:26.273945 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-426c2926-b169-45eb-9a43-507269c73caf tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:26.274727 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-426c2926-b169-45eb-9a43-507269c73caf tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:26.452481 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-426c2926-b169-45eb-9a43-507269c73caf tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:26.470243 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-426c2926-b169-45eb-9a43-507269c73caf tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1322 microversion: 2.1 time: 0.212457 Mar 03 02:31:26.471079 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 46/94] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:26 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:26.745623 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [req-b746617e-e768-430d-94da-eddd00d90ba3 req-a00c8230-6452-4db8-ae84-8fa833c3bbf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7a0db60-ea15-44e4-a1ca-41531a1aa5c3", "name": "network-vif-plugged", "status": "completed", "tag": "9d68d852-474d-4287-a7c4-83666d7f71d4"}]} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:31:26.761024 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-b746617e-e768-430d-94da-eddd00d90ba3 req-a00c8230-6452-4db8-ae84-8fa833c3bbf3 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:26.762673 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-b746617e-e768-430d-94da-eddd00d90ba3 req-a00c8230-6452-4db8-ae84-8fa833c3bbf3 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:26.783316 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.compute.server_external_events [req-b746617e-e768-430d-94da-eddd00d90ba3 req-a00c8230-6452-4db8-ae84-8fa833c3bbf3 service nova] Creating event network-vif-plugged:9d68d852-474d-4287-a7c4-83666d7f71d4 for instance f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 on hv-cinder-81977 Mar 03 02:31:26.795639 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [req-b746617e-e768-430d-94da-eddd00d90ba3 req-a00c8230-6452-4db8-ae84-8fa833c3bbf3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052298 Mar 03 02:31:26.801014 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 49/95] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:31:26.852609 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b1071095-fee9-496d-b67c-32ca31b9bb22 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:26.853999 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b1071095-fee9-496d-b67c-32ca31b9bb22 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:26.871943 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b8e0ce0e-edb3-4191-9aff-e0d6df00fe0c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:26.871943 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b8e0ce0e-edb3-4191-9aff-e0d6df00fe0c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:26.873782 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b1071095-fee9-496d-b67c-32ca31b9bb22 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:26.875410 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b1071095-fee9-496d-b67c-32ca31b9bb22 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:26.876845 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b1071095-fee9-496d-b67c-32ca31b9bb22 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:26.877583 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b1071095-fee9-496d-b67c-32ca31b9bb22 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:26.885116 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b8e0ce0e-edb3-4191-9aff-e0d6df00fe0c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:26.886597 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b8e0ce0e-edb3-4191-9aff-e0d6df00fe0c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:26.889897 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b8e0ce0e-edb3-4191-9aff-e0d6df00fe0c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:26.890544 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b8e0ce0e-edb3-4191-9aff-e0d6df00fe0c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:27.228055 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b8e0ce0e-edb3-4191-9aff-e0d6df00fe0c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:27.239525 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b8e0ce0e-edb3-4191-9aff-e0d6df00fe0c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:27.242140 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b8e0ce0e-edb3-4191-9aff-e0d6df00fe0c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:27.243550 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b8e0ce0e-edb3-4191-9aff-e0d6df00fe0c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1407 microversion: 2.20 time: 0.380911 Mar 03 02:31:27.244469 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 50/96] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:31:26 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1407 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:31:27.302708 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b1071095-fee9-496d-b67c-32ca31b9bb22 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:27.312944 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b1071095-fee9-496d-b67c-32ca31b9bb22 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1361 microversion: 2.1 time: 0.466313 Mar 03 02:31:27.324541 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 47/97] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:26 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1361 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:27.488554 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-01559992-438f-4b28-ab2d-773f62dfdb09 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:27.489451 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-01559992-438f-4b28-ab2d-773f62dfdb09 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:27.498845 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-01559992-438f-4b28-ab2d-773f62dfdb09 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:27.499871 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-01559992-438f-4b28-ab2d-773f62dfdb09 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:27.504062 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-01559992-438f-4b28-ab2d-773f62dfdb09 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:27.504988 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-01559992-438f-4b28-ab2d-773f62dfdb09 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:27.651643 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-01559992-438f-4b28-ab2d-773f62dfdb09 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:27.659360 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-01559992-438f-4b28-ab2d-773f62dfdb09 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1322 microversion: 2.1 time: 0.174851 Mar 03 02:31:27.660539 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 51/98] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:27 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:28.262323 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0c91e7bd-0e1d-48ed-a4fd-5906807c71aa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:28.262991 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0c91e7bd-0e1d-48ed-a4fd-5906807c71aa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:28.269409 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0c91e7bd-0e1d-48ed-a4fd-5906807c71aa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:28.269935 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0c91e7bd-0e1d-48ed-a4fd-5906807c71aa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:28.270769 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0c91e7bd-0e1d-48ed-a4fd-5906807c71aa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:28.271205 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0c91e7bd-0e1d-48ed-a4fd-5906807c71aa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:28.337642 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1e59f2d6-67d7-4755-9319-a52fab7b09c0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:28.338289 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1e59f2d6-67d7-4755-9319-a52fab7b09c0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:28.345532 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1e59f2d6-67d7-4755-9319-a52fab7b09c0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:28.346445 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1e59f2d6-67d7-4755-9319-a52fab7b09c0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:28.347656 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1e59f2d6-67d7-4755-9319-a52fab7b09c0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:28.348317 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1e59f2d6-67d7-4755-9319-a52fab7b09c0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:28.530251 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1e59f2d6-67d7-4755-9319-a52fab7b09c0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:28.543973 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1e59f2d6-67d7-4755-9319-a52fab7b09c0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1361 microversion: 2.1 time: 0.206617 Mar 03 02:31:28.546649 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 52/99] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:28 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1361 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:28.588257 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0c91e7bd-0e1d-48ed-a4fd-5906807c71aa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:28.599018 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0c91e7bd-0e1d-48ed-a4fd-5906807c71aa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:28.600958 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0c91e7bd-0e1d-48ed-a4fd-5906807c71aa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:28.602252 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0c91e7bd-0e1d-48ed-a4fd-5906807c71aa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1407 microversion: 2.20 time: 0.343903 Mar 03 02:31:28.603212 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 48/100] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:31:28 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1407 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:31:28.677962 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-55f62f73-f6c7-4718-abde-0f1f680650a5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:28.678567 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-55f62f73-f6c7-4718-abde-0f1f680650a5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:28.685899 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-55f62f73-f6c7-4718-abde-0f1f680650a5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:28.686350 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-55f62f73-f6c7-4718-abde-0f1f680650a5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:28.687138 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-55f62f73-f6c7-4718-abde-0f1f680650a5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:28.687575 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-55f62f73-f6c7-4718-abde-0f1f680650a5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:28.820309 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [req-843096ea-3cad-4cfc-a37c-4382a054e0bf req-b88091ed-7c87-47a0-b7aa-2c99d6d1fdb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d34e2006-f63a-4cb6-99d2-47d791fbefcf", "name": "network-vif-plugged", "status": "completed", "tag": "276ceb62-db32-4f9d-86c8-a5060ec08dd1"}]} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:31:28.828984 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-843096ea-3cad-4cfc-a37c-4382a054e0bf req-b88091ed-7c87-47a0-b7aa-2c99d6d1fdb4 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:28.829448 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-843096ea-3cad-4cfc-a37c-4382a054e0bf req-b88091ed-7c87-47a0-b7aa-2c99d6d1fdb4 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:28.832071 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-55f62f73-f6c7-4718-abde-0f1f680650a5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:28.840020 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-55f62f73-f6c7-4718-abde-0f1f680650a5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1322 microversion: 2.1 time: 0.166420 Mar 03 02:31:28.840597 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 53/101] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:28 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:28.841392 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.compute.server_external_events [req-843096ea-3cad-4cfc-a37c-4382a054e0bf req-b88091ed-7c87-47a0-b7aa-2c99d6d1fdb4 service nova] Creating event network-vif-plugged:276ceb62-db32-4f9d-86c8-a5060ec08dd1 for instance d34e2006-f63a-4cb6-99d2-47d791fbefcf on hv-cinder-81977 Mar 03 02:31:28.846939 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [req-843096ea-3cad-4cfc-a37c-4382a054e0bf req-b88091ed-7c87-47a0-b7aa-2c99d6d1fdb4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031147 Mar 03 02:31:28.847552 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 49/102] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:31:29.563269 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f799ff42-0e46-47a0-9ceb-9e009b440ca6 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:29.563905 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f799ff42-0e46-47a0-9ceb-9e009b440ca6 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:29.569671 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f799ff42-0e46-47a0-9ceb-9e009b440ca6 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:29.570111 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f799ff42-0e46-47a0-9ceb-9e009b440ca6 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:29.570879 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f799ff42-0e46-47a0-9ceb-9e009b440ca6 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:29.571312 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f799ff42-0e46-47a0-9ceb-9e009b440ca6 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:29.622118 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-265de51b-1a12-4e14-b771-0f56b796f007 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:29.623728 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-265de51b-1a12-4e14-b771-0f56b796f007 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:29.630131 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-265de51b-1a12-4e14-b771-0f56b796f007 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:29.630630 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-265de51b-1a12-4e14-b771-0f56b796f007 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:29.631698 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-265de51b-1a12-4e14-b771-0f56b796f007 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:29.632121 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-265de51b-1a12-4e14-b771-0f56b796f007 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:29.716495 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f799ff42-0e46-47a0-9ceb-9e009b440ca6 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:29.725144 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f799ff42-0e46-47a0-9ceb-9e009b440ca6 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1361 microversion: 2.1 time: 0.165645 Mar 03 02:31:29.725886 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 54/103] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:29 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:29.789304 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-265de51b-1a12-4e14-b771-0f56b796f007 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:29.799315 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-265de51b-1a12-4e14-b771-0f56b796f007 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:29.801413 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-265de51b-1a12-4e14-b771-0f56b796f007 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:29.802588 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-265de51b-1a12-4e14-b771-0f56b796f007 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1600 microversion: 2.20 time: 0.185538 Mar 03 02:31:29.803459 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 50/104] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:31:29 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1600 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:31:29.820686 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-784df2b5-3975-4bad-b4ec-809016ee6033 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:29.821180 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-784df2b5-3975-4bad-b4ec-809016ee6033 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:29.828333 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-784df2b5-3975-4bad-b4ec-809016ee6033 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:29.828795 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-784df2b5-3975-4bad-b4ec-809016ee6033 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:29.829595 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-784df2b5-3975-4bad-b4ec-809016ee6033 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:29.830035 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-784df2b5-3975-4bad-b4ec-809016ee6033 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:29.860052 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-89bdb710-efaf-4864-a8f4-bb6a2a507b93 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:29.860901 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-89bdb710-efaf-4864-a8f4-bb6a2a507b93 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:29.871923 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-89bdb710-efaf-4864-a8f4-bb6a2a507b93 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:29.872395 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-89bdb710-efaf-4864-a8f4-bb6a2a507b93 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:29.873753 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-89bdb710-efaf-4864-a8f4-bb6a2a507b93 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:29.876672 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-89bdb710-efaf-4864-a8f4-bb6a2a507b93 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:30.090349 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-89bdb710-efaf-4864-a8f4-bb6a2a507b93 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:30.103469 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-89bdb710-efaf-4864-a8f4-bb6a2a507b93 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1322 microversion: 2.1 time: 0.250441 Mar 03 02:31:30.107662 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 51/105] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:29 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1322 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:31:30.172452 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-784df2b5-3975-4bad-b4ec-809016ee6033 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.355481 Mar 03 02:31:30.173388 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 55/106] 10.222.0.30 () {60 vars in 1315 bytes} [Thu Mar 3 02:31:29 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-interface => generated 285 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:31:30.742869 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-96b3a0b3-5f64-4420-95ff-6635efcbc476 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:30.743692 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-96b3a0b3-5f64-4420-95ff-6635efcbc476 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:30.751133 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-96b3a0b3-5f64-4420-95ff-6635efcbc476 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:30.753108 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-96b3a0b3-5f64-4420-95ff-6635efcbc476 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:30.755117 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-96b3a0b3-5f64-4420-95ff-6635efcbc476 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:30.755848 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-96b3a0b3-5f64-4420-95ff-6635efcbc476 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:30.879403 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [req-49a74d20-5dba-4acd-8969-e072815eebf8 req-9e04e76a-6583-45e1-aaf6-588669943bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df03ab77-ba2a-4603-b517-8e7b435882f2", "name": "network-vif-plugged", "status": "completed", "tag": "efc411a0-4951-463f-9b9e-b0b169a4a793"}]} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:31:30.890451 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-49a74d20-5dba-4acd-8969-e072815eebf8 req-9e04e76a-6583-45e1-aaf6-588669943bc1 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:30.890882 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-49a74d20-5dba-4acd-8969-e072815eebf8 req-9e04e76a-6583-45e1-aaf6-588669943bc1 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:30.917752 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.compute.server_external_events [req-49a74d20-5dba-4acd-8969-e072815eebf8 req-9e04e76a-6583-45e1-aaf6-588669943bc1 service nova] Creating event network-vif-plugged:efc411a0-4951-463f-9b9e-b0b169a4a793 for instance df03ab77-ba2a-4603-b517-8e7b435882f2 on hv-cinder-81977 Mar 03 02:31:30.931240 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [req-49a74d20-5dba-4acd-8969-e072815eebf8 req-9e04e76a-6583-45e1-aaf6-588669943bc1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065783 Mar 03 02:31:30.932503 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 56/107] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:31:30.967304 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-96b3a0b3-5f64-4420-95ff-6635efcbc476 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:30.979002 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-96b3a0b3-5f64-4420-95ff-6635efcbc476 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1361 microversion: 2.1 time: 0.238248 Mar 03 02:31:30.979635 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 52/108] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:30 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1361 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:31.129679 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c965033d-63cb-4f16-8b2b-5fa346c87a21 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:31.130552 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c965033d-63cb-4f16-8b2b-5fa346c87a21 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:31.140493 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c965033d-63cb-4f16-8b2b-5fa346c87a21 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:31.141206 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c965033d-63cb-4f16-8b2b-5fa346c87a21 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:31.152339 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c965033d-63cb-4f16-8b2b-5fa346c87a21 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:31.153154 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c965033d-63cb-4f16-8b2b-5fa346c87a21 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:31.488035 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c965033d-63cb-4f16-8b2b-5fa346c87a21 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:31.496818 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c965033d-63cb-4f16-8b2b-5fa346c87a21 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1515 microversion: 2.1 time: 0.379738 Mar 03 02:31:31.498123 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 57/109] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:31 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1515 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:31:31.532873 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c3c31e2a-b9c4-42bb-8346-7b1434ccce8d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:31:31.534004 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c3c31e2a-b9c4-42bb-8346-7b1434ccce8d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:31.542563 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c3c31e2a-b9c4-42bb-8346-7b1434ccce8d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:31.543150 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c3c31e2a-b9c4-42bb-8346-7b1434ccce8d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:31.544088 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c3c31e2a-b9c4-42bb-8346-7b1434ccce8d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:31.545321 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c3c31e2a-b9c4-42bb-8346-7b1434ccce8d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:31.574436 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.objects.instance [None req-c3c31e2a-b9c4-42bb-8346-7b1434ccce8d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lazy-loading 'flavor' on Instance uuid d34e2006-f63a-4cb6-99d2-47d791fbefcf {{(pid=116858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 03 02:31:31.736032 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c3c31e2a-b9c4-42bb-8346-7b1434ccce8d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "POST /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf/action" status: 200 len: 32 microversion: 2.1 time: 0.214924 Mar 03 02:31:31.736657 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 53/110] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Mar 3 02:31:31 2022] POST /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf/action => generated 32 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 03 02:31:31.745697 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-61e9bb52-efa0-4f12-b41b-f828f2097697 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:31.746730 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-61e9bb52-efa0-4f12-b41b-f828f2097697 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:31.753619 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-61e9bb52-efa0-4f12-b41b-f828f2097697 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:31.757357 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-61e9bb52-efa0-4f12-b41b-f828f2097697 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:31.760020 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-61e9bb52-efa0-4f12-b41b-f828f2097697 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:31.760661 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-61e9bb52-efa0-4f12-b41b-f828f2097697 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:31.960863 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-998d72fe-7405-4286-91a4-98e5d556890a tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:31.962440 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-998d72fe-7405-4286-91a4-98e5d556890a tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] [instance: ef11fe69-5cf1-46cc-afdd-57b330c977d6] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:31.975314 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-998d72fe-7405-4286-91a4-98e5d556890a tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:31.976878 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-998d72fe-7405-4286-91a4-98e5d556890a tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:31.981995 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-998d72fe-7405-4286-91a4-98e5d556890a tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:31.983499 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-998d72fe-7405-4286-91a4-98e5d556890a tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:32.021657 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-998d72fe-7405-4286-91a4-98e5d556890a tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] [instance: ef11fe69-5cf1-46cc-afdd-57b330c977d6] Going to try to terminate instance {{(pid=116858) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 03 02:31:32.133754 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-61e9bb52-efa0-4f12-b41b-f828f2097697 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:32.146378 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-61e9bb52-efa0-4f12-b41b-f828f2097697 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1521 microversion: 2.1 time: 0.404687 Mar 03 02:31:32.148422 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 58/111] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:31 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1521 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:32.159045 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-80312526-80a0-4ec2-bad7-66965ae79e15 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:32.161669 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-80312526-80a0-4ec2-bad7-66965ae79e15 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:32.172565 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-80312526-80a0-4ec2-bad7-66965ae79e15 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:32.187398 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-998d72fe-7405-4286-91a4-98e5d556890a tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6" status: 204 len: 0 microversion: 2.1 time: 0.231132 Mar 03 02:31:32.187887 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-80312526-80a0-4ec2-bad7-66965ae79e15 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:32.189523 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 54/112] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Mar 3 02:31:31 2022] DELETE /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 03 02:31:32.193730 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-80312526-80a0-4ec2-bad7-66965ae79e15 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:32.196021 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d647c91c-644d-4efb-a720-7d1645b6d1cd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:32.196587 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d647c91c-644d-4efb-a720-7d1645b6d1cd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:32.197151 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-80312526-80a0-4ec2-bad7-66965ae79e15 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:32.203533 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d647c91c-644d-4efb-a720-7d1645b6d1cd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:32.204243 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d647c91c-644d-4efb-a720-7d1645b6d1cd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:32.205187 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d647c91c-644d-4efb-a720-7d1645b6d1cd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:32.205800 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d647c91c-644d-4efb-a720-7d1645b6d1cd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:32.263534 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d647c91c-644d-4efb-a720-7d1645b6d1cd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/ips" status: 200 len: 113 microversion: 2.20 time: 0.072360 Mar 03 02:31:32.264465 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 55/113] 10.222.0.30 () {60 vars in 1288 bytes} [Thu Mar 3 02:31:32 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/ips => generated 113 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:31:32.269566 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [req-8257c0c7-f3ec-4d1c-b80c-67357ca48fde req-7bbdfb1f-0e56-4bca-bf78-e94b7000e621 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7a0db60-ea15-44e4-a1ca-41531a1aa5c3", "tag": "9d68d852-474d-4287-a7c4-83666d7f71d4"}]} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:31:32.280578 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-8257c0c7-f3ec-4d1c-b80c-67357ca48fde req-7bbdfb1f-0e56-4bca-bf78-e94b7000e621 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:32.281532 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-8257c0c7-f3ec-4d1c-b80c-67357ca48fde req-7bbdfb1f-0e56-4bca-bf78-e94b7000e621 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:32.293105 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.compute.server_external_events [req-8257c0c7-f3ec-4d1c-b80c-67357ca48fde req-7bbdfb1f-0e56-4bca-bf78-e94b7000e621 service nova] Creating event network-changed:9d68d852-474d-4287-a7c4-83666d7f71d4 for instance f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 on hv-cinder-81977 Mar 03 02:31:32.301794 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [req-8257c0c7-f3ec-4d1c-b80c-67357ca48fde req-7bbdfb1f-0e56-4bca-bf78-e94b7000e621 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035721 Mar 03 02:31:32.303103 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 56/114] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:31:32.308312 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6994ba98-355f-45af-9338-0bf62d5c1f45 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:32.309273 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6994ba98-355f-45af-9338-0bf62d5c1f45 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] [instance: ef11fe69-5cf1-46cc-afdd-57b330c977d6] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:32.327677 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6994ba98-355f-45af-9338-0bf62d5c1f45 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:32.330971 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6994ba98-355f-45af-9338-0bf62d5c1f45 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:32.332209 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6994ba98-355f-45af-9338-0bf62d5c1f45 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:32.333150 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6994ba98-355f-45af-9338-0bf62d5c1f45 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:32.488215 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-80312526-80a0-4ec2-bad7-66965ae79e15 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:32.495728 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-80312526-80a0-4ec2-bad7-66965ae79e15 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1361 microversion: 2.1 time: 0.346091 Mar 03 02:31:32.504409 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 59/115] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:32 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1361 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:32.967476 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6994ba98-355f-45af-9338-0bf62d5c1f45 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc43d1c3ceb4bc88fc588ef91f25dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391f419b7b114f10a01c5a7cdc200770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:32.977733 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6994ba98-355f-45af-9338-0bf62d5c1f45 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] 10.222.0.30 "GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6" status: 200 len: 1554 microversion: 2.1 time: 0.673215 Mar 03 02:31:32.981801 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 57/116] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:32 2022] GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6 => generated 1554 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:33.165790 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-aabe85cd-aa4f-49fb-81f5-7bee97d99e0b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:33.166949 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-aabe85cd-aa4f-49fb-81f5-7bee97d99e0b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:33.183899 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aabe85cd-aa4f-49fb-81f5-7bee97d99e0b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:33.184643 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aabe85cd-aa4f-49fb-81f5-7bee97d99e0b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:33.186154 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aabe85cd-aa4f-49fb-81f5-7bee97d99e0b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:33.186933 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aabe85cd-aa4f-49fb-81f5-7bee97d99e0b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:33.400664 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-aabe85cd-aa4f-49fb-81f5-7bee97d99e0b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:33.411912 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-aabe85cd-aa4f-49fb-81f5-7bee97d99e0b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1521 microversion: 2.1 time: 0.250462 Mar 03 02:31:33.413074 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 60/117] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:33 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:33.522753 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8417c425-f5dd-465e-9a5a-b7876644b9e5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:33.523654 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8417c425-f5dd-465e-9a5a-b7876644b9e5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:33.531073 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8417c425-f5dd-465e-9a5a-b7876644b9e5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:33.531844 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8417c425-f5dd-465e-9a5a-b7876644b9e5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:33.532960 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8417c425-f5dd-465e-9a5a-b7876644b9e5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:33.533393 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8417c425-f5dd-465e-9a5a-b7876644b9e5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:33.758264 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8417c425-f5dd-465e-9a5a-b7876644b9e5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:33.771152 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8417c425-f5dd-465e-9a5a-b7876644b9e5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1546 microversion: 2.1 time: 0.252939 Mar 03 02:31:33.772230 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 58/118] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:33 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1546 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:33.793412 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6036a49f-cd74-4cb3-8073-33fe43f65bbf tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:33.794182 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6036a49f-cd74-4cb3-8073-33fe43f65bbf tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:33.820894 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6036a49f-cd74-4cb3-8073-33fe43f65bbf tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:33.821353 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6036a49f-cd74-4cb3-8073-33fe43f65bbf tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:33.822166 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6036a49f-cd74-4cb3-8073-33fe43f65bbf tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:33.822600 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6036a49f-cd74-4cb3-8073-33fe43f65bbf tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:33.966365 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6036a49f-cd74-4cb3-8073-33fe43f65bbf tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.179783 Mar 03 02:31:33.966968 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 61/119] 10.222.0.30 () {58 vars in 1274 bytes} [Thu Mar 3 02:31:33 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-interface => generated 284 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:31:33.999095 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2f73c4ee-2cfb-4152-8139-b5ab373239e8 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:34.000496 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2f73c4ee-2cfb-4152-8139-b5ab373239e8 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] [instance: ef11fe69-5cf1-46cc-afdd-57b330c977d6] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:34.009351 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2f73c4ee-2cfb-4152-8139-b5ab373239e8 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:34.010614 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2f73c4ee-2cfb-4152-8139-b5ab373239e8 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:34.011679 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2f73c4ee-2cfb-4152-8139-b5ab373239e8 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:34.012758 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2f73c4ee-2cfb-4152-8139-b5ab373239e8 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:34.204433 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2f73c4ee-2cfb-4152-8139-b5ab373239e8 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc43d1c3ceb4bc88fc588ef91f25dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391f419b7b114f10a01c5a7cdc200770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:34.212446 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2f73c4ee-2cfb-4152-8139-b5ab373239e8 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] 10.222.0.30 "GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6" status: 200 len: 1554 microversion: 2.1 time: 0.217936 Mar 03 02:31:34.213111 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 59/120] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:33 2022] GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6 => generated 1554 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:34.429704 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-06008633-280e-4509-b31f-f9d4c1e5dec1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:34.431074 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-06008633-280e-4509-b31f-f9d4c1e5dec1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:34.438298 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-06008633-280e-4509-b31f-f9d4c1e5dec1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:34.438772 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-06008633-280e-4509-b31f-f9d4c1e5dec1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:34.439723 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-06008633-280e-4509-b31f-f9d4c1e5dec1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:34.440326 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-06008633-280e-4509-b31f-f9d4c1e5dec1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:34.793512 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-06008633-280e-4509-b31f-f9d4c1e5dec1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:34.803262 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-06008633-280e-4509-b31f-f9d4c1e5dec1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1521 microversion: 2.1 time: 0.378534 Mar 03 02:31:34.804040 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 62/121] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:34 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1521 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:35.230496 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e53bfc84-09f6-4e2e-86bf-3ce496b5ed71 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:35.231117 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e53bfc84-09f6-4e2e-86bf-3ce496b5ed71 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] [instance: ef11fe69-5cf1-46cc-afdd-57b330c977d6] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:35.244002 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e53bfc84-09f6-4e2e-86bf-3ce496b5ed71 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:35.244465 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e53bfc84-09f6-4e2e-86bf-3ce496b5ed71 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:35.245270 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e53bfc84-09f6-4e2e-86bf-3ce496b5ed71 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:35.245712 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e53bfc84-09f6-4e2e-86bf-3ce496b5ed71 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:35.309375 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0449abfd-caea-4faf-85b8-c54178c29a74 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:35.309958 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0449abfd-caea-4faf-85b8-c54178c29a74 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:35.317491 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0449abfd-caea-4faf-85b8-c54178c29a74 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:35.317952 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0449abfd-caea-4faf-85b8-c54178c29a74 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:35.319359 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0449abfd-caea-4faf-85b8-c54178c29a74 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:35.319845 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0449abfd-caea-4faf-85b8-c54178c29a74 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:35.352090 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0449abfd-caea-4faf-85b8-c54178c29a74 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/ips" status: 200 len: 105 microversion: 2.1 time: 0.047808 Mar 03 02:31:35.353279 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 63/122] 10.222.0.30 () {58 vars in 1247 bytes} [Thu Mar 3 02:31:35 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/ips => generated 105 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:31:35.359324 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [req-a04798db-a473-41c8-9179-8468296deefa req-f8543ae3-bd31-445b-8fe6-8f7acf9a230c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df03ab77-ba2a-4603-b517-8e7b435882f2", "tag": "efc411a0-4951-463f-9b9e-b0b169a4a793"}]} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:31:35.367890 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-a04798db-a473-41c8-9179-8468296deefa req-f8543ae3-bd31-445b-8fe6-8f7acf9a230c service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:35.368519 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-a04798db-a473-41c8-9179-8468296deefa req-f8543ae3-bd31-445b-8fe6-8f7acf9a230c service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:35.381767 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.compute.server_external_events [req-a04798db-a473-41c8-9179-8468296deefa req-f8543ae3-bd31-445b-8fe6-8f7acf9a230c service nova] Creating event network-changed:efc411a0-4951-463f-9b9e-b0b169a4a793 for instance df03ab77-ba2a-4603-b517-8e7b435882f2 on hv-cinder-81977 Mar 03 02:31:35.387642 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [req-a04798db-a473-41c8-9179-8468296deefa req-f8543ae3-bd31-445b-8fe6-8f7acf9a230c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032972 Mar 03 02:31:35.389563 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 64/123] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:31:35.823246 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1e2893bf-e519-400a-b9cd-9f096f23b7f8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:35.824150 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1e2893bf-e519-400a-b9cd-9f096f23b7f8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:35.828767 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e53bfc84-09f6-4e2e-86bf-3ce496b5ed71 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc43d1c3ceb4bc88fc588ef91f25dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391f419b7b114f10a01c5a7cdc200770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:35.832590 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1e2893bf-e519-400a-b9cd-9f096f23b7f8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:35.833149 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1e2893bf-e519-400a-b9cd-9f096f23b7f8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:35.834040 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1e2893bf-e519-400a-b9cd-9f096f23b7f8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:35.836732 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e53bfc84-09f6-4e2e-86bf-3ce496b5ed71 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] 10.222.0.30 "GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6" status: 200 len: 1554 microversion: 2.1 time: 0.610602 Mar 03 02:31:35.837334 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 60/124] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:35 2022] GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6 => generated 1554 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:35.855854 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1e2893bf-e519-400a-b9cd-9f096f23b7f8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:36.089650 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1e2893bf-e519-400a-b9cd-9f096f23b7f8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:36.099222 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1e2893bf-e519-400a-b9cd-9f096f23b7f8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1521 microversion: 2.1 time: 0.281081 Mar 03 02:31:36.100498 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 65/125] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:35 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:31:36.299864 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [req-aadfa1b6-3aed-4205-bb3b-a22c0b778ba0 req-26c81743-438f-4fc6-af08-8cee18a13ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef11fe69-5cf1-46cc-afdd-57b330c977d6", "name": "network-vif-deleted", "tag": "9d1b4fb7-cbb1-4036-be2d-33ac3458786e"}]} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:31:36.327404 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-aadfa1b6-3aed-4205-bb3b-a22c0b778ba0 req-26c81743-438f-4fc6-af08-8cee18a13ae2 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:36.328099 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-aadfa1b6-3aed-4205-bb3b-a22c0b778ba0 req-26c81743-438f-4fc6-af08-8cee18a13ae2 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:36.342391 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.compute.server_external_events [req-aadfa1b6-3aed-4205-bb3b-a22c0b778ba0 req-26c81743-438f-4fc6-af08-8cee18a13ae2 service nova] Creating event network-vif-deleted:9d1b4fb7-cbb1-4036-be2d-33ac3458786e for instance ef11fe69-5cf1-46cc-afdd-57b330c977d6 on hv-cinder-81977 Mar 03 02:31:36.347569 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [req-aadfa1b6-3aed-4205-bb3b-a22c0b778ba0 req-26c81743-438f-4fc6-af08-8cee18a13ae2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051257 Mar 03 02:31:36.349152 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 61/126] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:31:36.854535 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d9b1f42e-e646-496c-a841-d8578debd95b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:36.856312 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d9b1f42e-e646-496c-a841-d8578debd95b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] [instance: ef11fe69-5cf1-46cc-afdd-57b330c977d6] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:36.863207 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d9b1f42e-e646-496c-a841-d8578debd95b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:36.864025 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d9b1f42e-e646-496c-a841-d8578debd95b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:36.864834 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d9b1f42e-e646-496c-a841-d8578debd95b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:36.865442 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d9b1f42e-e646-496c-a841-d8578debd95b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:36.908858 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d9b1f42e-e646-496c-a841-d8578debd95b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:36.909269 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d9b1f42e-e646-496c-a841-d8578debd95b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:36.909850 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.objects.instance [None req-d9b1f42e-e646-496c-a841-d8578debd95b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lazy-loading 'fault' on Instance uuid ef11fe69-5cf1-46cc-afdd-57b330c977d6 {{(pid=116859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 03 02:31:36.958387 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d9b1f42e-e646-496c-a841-d8578debd95b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc43d1c3ceb4bc88fc588ef91f25dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391f419b7b114f10a01c5a7cdc200770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:36.967652 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d9b1f42e-e646-496c-a841-d8578debd95b tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] 10.222.0.30 "GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6" status: 200 len: 1351 microversion: 2.1 time: 0.116895 Mar 03 02:31:36.978190 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 66/127] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:36 2022] GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6 => generated 1351 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:37.118091 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3a070417-f536-473c-8d5f-b93e38e65d4c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:37.118808 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3a070417-f536-473c-8d5f-b93e38e65d4c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:37.126162 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3a070417-f536-473c-8d5f-b93e38e65d4c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:37.126742 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3a070417-f536-473c-8d5f-b93e38e65d4c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:37.127535 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3a070417-f536-473c-8d5f-b93e38e65d4c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:37.127995 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3a070417-f536-473c-8d5f-b93e38e65d4c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:37.323047 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-3a070417-f536-473c-8d5f-b93e38e65d4c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:37.331854 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3a070417-f536-473c-8d5f-b93e38e65d4c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1521 microversion: 2.1 time: 0.218314 Mar 03 02:31:37.347562 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 62/128] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:37 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:37.997471 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e336a632-db6f-4c27-90db-ab20b5c6ba54 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:38.000561 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e336a632-db6f-4c27-90db-ab20b5c6ba54 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] [instance: ef11fe69-5cf1-46cc-afdd-57b330c977d6] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:38.014095 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e336a632-db6f-4c27-90db-ab20b5c6ba54 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:38.015119 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e336a632-db6f-4c27-90db-ab20b5c6ba54 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:38.016445 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e336a632-db6f-4c27-90db-ab20b5c6ba54 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:38.017170 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e336a632-db6f-4c27-90db-ab20b5c6ba54 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:38.036585 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.wsgi [None req-e336a632-db6f-4c27-90db-ab20b5c6ba54 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] HTTP exception thrown: Instance ef11fe69-5cf1-46cc-afdd-57b330c977d6 could not be found. Mar 03 02:31:38.037696 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e336a632-db6f-4c27-90db-ab20b5c6ba54 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Returning 404 to user: Instance ef11fe69-5cf1-46cc-afdd-57b330c977d6 could not be found. {{(pid=116859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:31:38.038712 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e336a632-db6f-4c27-90db-ab20b5c6ba54 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] 10.222.0.30 "GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6" status: 404 len: 111 microversion: 2.1 time: 0.055121 Mar 03 02:31:38.040011 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 67/129] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:37 2022] GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 03 02:31:38.197032 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-27556a66-969c-43e9-9528-566faf5ed7e7 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:38.198630 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-27556a66-969c-43e9-9528-566faf5ed7e7 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] [instance: ef11fe69-5cf1-46cc-afdd-57b330c977d6] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:38.205634 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-27556a66-969c-43e9-9528-566faf5ed7e7 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:38.206090 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-27556a66-969c-43e9-9528-566faf5ed7e7 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:38.207512 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-27556a66-969c-43e9-9528-566faf5ed7e7 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:38.207988 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-27556a66-969c-43e9-9528-566faf5ed7e7 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:38.221148 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.wsgi [None req-27556a66-969c-43e9-9528-566faf5ed7e7 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] HTTP exception thrown: Instance ef11fe69-5cf1-46cc-afdd-57b330c977d6 could not be found. Mar 03 02:31:38.222269 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-27556a66-969c-43e9-9528-566faf5ed7e7 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Returning 404 to user: Instance ef11fe69-5cf1-46cc-afdd-57b330c977d6 could not be found. {{(pid=116858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:31:38.223831 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-27556a66-969c-43e9-9528-566faf5ed7e7 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] 10.222.0.30 "GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031152 Mar 03 02:31:38.224539 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 63/130] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:31:38 2022] GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 03 02:31:38.359349 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4538a3bb-af79-4903-88f4-fa7cf300cd66 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:38.360101 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4538a3bb-af79-4903-88f4-fa7cf300cd66 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:38.361633 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-de64ec2a-7b84-4b01-9bcf-4ed421fe4296 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1927801281", "imageRef": "1fe11a1a-b4d0-46f5-89cd-501ceff49317", "flavorRef": "452", "networks": [{"uuid": "d9d2edb4-611d-4e02-94de-0b7e65f130ad"}]}} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:31:38.367804 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4538a3bb-af79-4903-88f4-fa7cf300cd66 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:38.368591 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4538a3bb-af79-4903-88f4-fa7cf300cd66 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:38.369641 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4538a3bb-af79-4903-88f4-fa7cf300cd66 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:38.370284 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4538a3bb-af79-4903-88f4-fa7cf300cd66 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:38.483512 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.network.neutron [None req-de64ec2a-7b84-4b01-9bcf-4ed421fe4296 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] validate_networks() for [('d9d2edb4-611d-4e02-94de-0b7e65f130ad', None, None, None, None, None)] {{(pid=116858) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 03 02:31:38.566804 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4538a3bb-af79-4903-88f4-fa7cf300cd66 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:38.574486 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4538a3bb-af79-4903-88f4-fa7cf300cd66 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1521 microversion: 2.1 time: 0.224149 Mar 03 02:31:38.576136 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 68/131] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:38 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:39.011522 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-de64ec2a-7b84-4b01-9bcf-4ed421fe4296 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Flavor limits 0:0:0 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 03 02:31:39.011980 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-de64ec2a-7b84-4b01-9bcf-4ed421fe4296 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Image limits 0:0:0 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 03 02:31:39.012452 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-de64ec2a-7b84-4b01-9bcf-4ed421fe4296 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Flavor pref 0:0:0 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 03 02:31:39.012981 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-de64ec2a-7b84-4b01-9bcf-4ed421fe4296 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Image pref 0:0:0 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 03 02:31:39.014051 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-de64ec2a-7b84-4b01-9bcf-4ed421fe4296 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 03 02:31:39.027685 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-de64ec2a-7b84-4b01-9bcf-4ed421fe4296 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:39.028517 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-de64ec2a-7b84-4b01-9bcf-4ed421fe4296 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:39.029873 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-de64ec2a-7b84-4b01-9bcf-4ed421fe4296 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:39.030517 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-de64ec2a-7b84-4b01-9bcf-4ed421fe4296 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:39.050632 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.quota [None req-de64ec2a-7b84-4b01-9bcf-4ed421fe4296 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Getting quotas for project 2e235fd949e6494eb47967914074be06. Resources: {'instances', 'ram', 'cores'} {{(pid=116858) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 03 02:31:39.060308 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.quota [None req-de64ec2a-7b84-4b01-9bcf-4ed421fe4296 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Getting quotas for user 76da7e26281640968c429d04efb3dd3e and project 2e235fd949e6494eb47967914074be06. Resources: {'instances', 'ram', 'cores'} {{(pid=116858) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 03 02:31:39.090108 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-de64ec2a-7b84-4b01-9bcf-4ed421fe4296 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Going to run 1 instances... {{(pid=116858) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 03 02:31:39.093468 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-de64ec2a-7b84-4b01-9bcf-4ed421fe4296 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 0a347353-a177-432c-82bf-df27655c432b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1fe11a1a-b4d0-46f5-89cd-501ceff49317',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116858) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 03 02:31:39.167761 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-de64ec2a-7b84-4b01-9bcf-4ed421fe4296 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.811430 Mar 03 02:31:39.168407 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 64/132] 10.222.0.30 () {60 vars in 1146 bytes} [Thu Mar 3 02:31:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 03 02:31:39.187998 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4f815d7d-d6ff-4b66-be16-2c1296676f3d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:39.190256 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4f815d7d-d6ff-4b66-be16-2c1296676f3d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 0a347353-a177-432c-82bf-df27655c432b] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:39.274627 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4f815d7d-d6ff-4b66-be16-2c1296676f3d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:39.288812 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4f815d7d-d6ff-4b66-be16-2c1296676f3d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b" status: 200 len: 1218 microversion: 2.1 time: 0.113070 Mar 03 02:31:39.296151 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 69/133] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:39 2022] GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b => generated 1218 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:39.528020 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3f84a91b-8197-423a-bd1b-92bee103b4b9 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:39.528558 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3f84a91b-8197-423a-bd1b-92bee103b4b9 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] [instance: ef11fe69-5cf1-46cc-afdd-57b330c977d6] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:39.537680 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3f84a91b-8197-423a-bd1b-92bee103b4b9 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:39.538407 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3f84a91b-8197-423a-bd1b-92bee103b4b9 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:39.539999 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3f84a91b-8197-423a-bd1b-92bee103b4b9 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:39.540648 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3f84a91b-8197-423a-bd1b-92bee103b4b9 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:39.556741 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.wsgi [None req-3f84a91b-8197-423a-bd1b-92bee103b4b9 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] HTTP exception thrown: Instance ef11fe69-5cf1-46cc-afdd-57b330c977d6 could not be found. Mar 03 02:31:39.558068 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3f84a91b-8197-423a-bd1b-92bee103b4b9 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Returning 404 to user: Instance ef11fe69-5cf1-46cc-afdd-57b330c977d6 could not be found. {{(pid=116858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:31:39.559253 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3f84a91b-8197-423a-bd1b-92bee103b4b9 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6" status: 404 len: 111 microversion: 2.1 time: 0.036337 Mar 03 02:31:39.562476 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 65/134] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Mar 3 02:31:39 2022] DELETE /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 03 02:31:39.570397 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a119119b-be13-4c48-aaa8-b7f3a7448f80 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:39.571299 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a119119b-be13-4c48-aaa8-b7f3a7448f80 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] [instance: ef11fe69-5cf1-46cc-afdd-57b330c977d6] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:39.601406 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a119119b-be13-4c48-aaa8-b7f3a7448f80 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:39.607027 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a119119b-be13-4c48-aaa8-b7f3a7448f80 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:39.609109 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-93b646a1-a12e-4a8f-a1fb-986b11a4246a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:39.611925 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a119119b-be13-4c48-aaa8-b7f3a7448f80 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:39.615513 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a119119b-be13-4c48-aaa8-b7f3a7448f80 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:39.618384 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-93b646a1-a12e-4a8f-a1fb-986b11a4246a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:39.642216 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-93b646a1-a12e-4a8f-a1fb-986b11a4246a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:39.642799 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-93b646a1-a12e-4a8f-a1fb-986b11a4246a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:39.643741 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-93b646a1-a12e-4a8f-a1fb-986b11a4246a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:39.644199 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-93b646a1-a12e-4a8f-a1fb-986b11a4246a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:39.654258 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.wsgi [None req-a119119b-be13-4c48-aaa8-b7f3a7448f80 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] HTTP exception thrown: Instance ef11fe69-5cf1-46cc-afdd-57b330c977d6 could not be found. Mar 03 02:31:39.655402 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a119119b-be13-4c48-aaa8-b7f3a7448f80 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] Returning 404 to user: Instance ef11fe69-5cf1-46cc-afdd-57b330c977d6 could not be found. {{(pid=116859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:31:39.658170 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a119119b-be13-4c48-aaa8-b7f3a7448f80 tempest-DeleteServersTestJSON-723545460 tempest-DeleteServersTestJSON-723545460-project] 10.222.0.30 "GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6" status: 404 len: 111 microversion: 2.1 time: 0.092651 Mar 03 02:31:39.663922 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 70/135] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:39 2022] GET /compute/v2.1/servers/ef11fe69-5cf1-46cc-afdd-57b330c977d6 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 03 02:31:40.262430 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-93b646a1-a12e-4a8f-a1fb-986b11a4246a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:40.274278 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-93b646a1-a12e-4a8f-a1fb-986b11a4246a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1521 microversion: 2.1 time: 0.684336 Mar 03 02:31:40.277306 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 66/136] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:39 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1521 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:40.306773 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d7482fc7-3306-4012-be26-40366a9fb66c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:40.308541 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d7482fc7-3306-4012-be26-40366a9fb66c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 0a347353-a177-432c-82bf-df27655c432b] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:40.323914 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d7482fc7-3306-4012-be26-40366a9fb66c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:40.324678 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d7482fc7-3306-4012-be26-40366a9fb66c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:40.328423 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d7482fc7-3306-4012-be26-40366a9fb66c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:40.330040 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d7482fc7-3306-4012-be26-40366a9fb66c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:40.458135 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d7482fc7-3306-4012-be26-40366a9fb66c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:40.482846 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d7482fc7-3306-4012-be26-40366a9fb66c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b" status: 200 len: 1270 microversion: 2.1 time: 0.178969 Mar 03 02:31:40.483950 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 71/137] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:40 2022] GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b => generated 1270 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:31:41.300303 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-355f6a85-ef4e-415d-9bf8-3ee35194ba71 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:41.301028 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-355f6a85-ef4e-415d-9bf8-3ee35194ba71 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:41.318933 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-355f6a85-ef4e-415d-9bf8-3ee35194ba71 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:41.321118 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-355f6a85-ef4e-415d-9bf8-3ee35194ba71 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:41.324021 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-355f6a85-ef4e-415d-9bf8-3ee35194ba71 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:41.324649 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-355f6a85-ef4e-415d-9bf8-3ee35194ba71 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:41.501397 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d781cdd5-1a65-48ac-ba0b-b7edda9f0864 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:41.502684 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d781cdd5-1a65-48ac-ba0b-b7edda9f0864 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 0a347353-a177-432c-82bf-df27655c432b] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:41.511916 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d781cdd5-1a65-48ac-ba0b-b7edda9f0864 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:41.512481 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d781cdd5-1a65-48ac-ba0b-b7edda9f0864 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:41.516509 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d781cdd5-1a65-48ac-ba0b-b7edda9f0864 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:41.517216 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d781cdd5-1a65-48ac-ba0b-b7edda9f0864 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:41.790521 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d781cdd5-1a65-48ac-ba0b-b7edda9f0864 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:41.807513 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-355f6a85-ef4e-415d-9bf8-3ee35194ba71 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:41.810914 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d781cdd5-1a65-48ac-ba0b-b7edda9f0864 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b" status: 200 len: 1276 microversion: 2.1 time: 0.313535 Mar 03 02:31:41.819996 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-355f6a85-ef4e-415d-9bf8-3ee35194ba71 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1521 microversion: 2.1 time: 0.528953 Mar 03 02:31:41.821043 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 72/138] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:41 2022] GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b => generated 1276 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:41.821804 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 67/139] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:41 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1521 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:42.832704 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-948aceef-f2a4-4073-8f9c-41f7981b7bf3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:42.833405 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-948aceef-f2a4-4073-8f9c-41f7981b7bf3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 0a347353-a177-432c-82bf-df27655c432b] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:42.838267 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-56ab3dba-70ea-45a8-9bec-765bc9c7365e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:42.838860 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-56ab3dba-70ea-45a8-9bec-765bc9c7365e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:42.847575 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-948aceef-f2a4-4073-8f9c-41f7981b7bf3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:42.848247 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-948aceef-f2a4-4073-8f9c-41f7981b7bf3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:42.850196 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-56ab3dba-70ea-45a8-9bec-765bc9c7365e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:42.850646 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-56ab3dba-70ea-45a8-9bec-765bc9c7365e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:42.851432 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-56ab3dba-70ea-45a8-9bec-765bc9c7365e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:42.851893 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-56ab3dba-70ea-45a8-9bec-765bc9c7365e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:42.853018 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-948aceef-f2a4-4073-8f9c-41f7981b7bf3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:42.853182 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-948aceef-f2a4-4073-8f9c-41f7981b7bf3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:43.296281 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-56ab3dba-70ea-45a8-9bec-765bc9c7365e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:43.307581 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-56ab3dba-70ea-45a8-9bec-765bc9c7365e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1521 microversion: 2.1 time: 0.472991 Mar 03 02:31:43.311387 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 68/140] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:42 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1521 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:31:43.576427 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-948aceef-f2a4-4073-8f9c-41f7981b7bf3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:43.586006 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-948aceef-f2a4-4073-8f9c-41f7981b7bf3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b" status: 200 len: 1318 microversion: 2.1 time: 0.761534 Mar 03 02:31:43.592436 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 73/141] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:42 2022] GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b => generated 1318 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:43.636935 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [req-2953dc62-6e1f-4858-a303-7b9f7bab7f91 req-49c0e41e-da3c-43da-97e7-3bb41b4cf99a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a347353-a177-432c-82bf-df27655c432b", "tag": "f951e911-a3ec-4460-9442-5bd41e0e1976"}]} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:31:43.651145 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-2953dc62-6e1f-4858-a303-7b9f7bab7f91 req-49c0e41e-da3c-43da-97e7-3bb41b4cf99a service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:43.652276 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-2953dc62-6e1f-4858-a303-7b9f7bab7f91 req-49c0e41e-da3c-43da-97e7-3bb41b4cf99a service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:43.666183 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.compute.server_external_events [req-2953dc62-6e1f-4858-a303-7b9f7bab7f91 req-49c0e41e-da3c-43da-97e7-3bb41b4cf99a service nova] Creating event network-changed:f951e911-a3ec-4460-9442-5bd41e0e1976 for instance 0a347353-a177-432c-82bf-df27655c432b on hv-cinder-81977 Mar 03 02:31:43.675550 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [req-2953dc62-6e1f-4858-a303-7b9f7bab7f91 req-49c0e41e-da3c-43da-97e7-3bb41b4cf99a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041098 Mar 03 02:31:43.677405 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 69/142] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:31:44.324789 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-411b4d0c-7486-4f65-bc52-399626b82b13 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:44.325786 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-411b4d0c-7486-4f65-bc52-399626b82b13 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:44.335502 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-411b4d0c-7486-4f65-bc52-399626b82b13 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:44.335981 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-411b4d0c-7486-4f65-bc52-399626b82b13 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:44.336839 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-411b4d0c-7486-4f65-bc52-399626b82b13 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:44.337425 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-411b4d0c-7486-4f65-bc52-399626b82b13 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:44.577239 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-411b4d0c-7486-4f65-bc52-399626b82b13 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:44.585686 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-411b4d0c-7486-4f65-bc52-399626b82b13 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1521 microversion: 2.1 time: 0.265009 Mar 03 02:31:44.596528 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 74/143] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:44 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:44.605183 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-67d226e8-f160-40da-bda1-3a7df2b654b0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:44.605967 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-67d226e8-f160-40da-bda1-3a7df2b654b0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 0a347353-a177-432c-82bf-df27655c432b] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:44.618849 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-67d226e8-f160-40da-bda1-3a7df2b654b0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:44.619871 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-67d226e8-f160-40da-bda1-3a7df2b654b0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:44.620755 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-67d226e8-f160-40da-bda1-3a7df2b654b0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:44.621563 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-67d226e8-f160-40da-bda1-3a7df2b654b0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:44.785437 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-67d226e8-f160-40da-bda1-3a7df2b654b0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:44.795546 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-67d226e8-f160-40da-bda1-3a7df2b654b0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b" status: 200 len: 1318 microversion: 2.1 time: 0.196685 Mar 03 02:31:44.796462 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 70/144] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:44 2022] GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:45.603697 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3917c15b-c7f2-4101-9b95-d32e8ec81885 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:45.604623 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3917c15b-c7f2-4101-9b95-d32e8ec81885 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:45.612607 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3917c15b-c7f2-4101-9b95-d32e8ec81885 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:45.613082 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3917c15b-c7f2-4101-9b95-d32e8ec81885 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:45.613871 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3917c15b-c7f2-4101-9b95-d32e8ec81885 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:45.614307 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3917c15b-c7f2-4101-9b95-d32e8ec81885 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:45.812516 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e19a23e4-ad72-483b-a4c0-d688e42cb016 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:45.813149 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e19a23e4-ad72-483b-a4c0-d688e42cb016 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 0a347353-a177-432c-82bf-df27655c432b] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:45.820349 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e19a23e4-ad72-483b-a4c0-d688e42cb016 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:45.820830 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e19a23e4-ad72-483b-a4c0-d688e42cb016 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:45.821685 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e19a23e4-ad72-483b-a4c0-d688e42cb016 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:45.822129 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e19a23e4-ad72-483b-a4c0-d688e42cb016 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:45.857978 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3917c15b-c7f2-4101-9b95-d32e8ec81885 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:45.868861 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3917c15b-c7f2-4101-9b95-d32e8ec81885 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1521 microversion: 2.1 time: 0.269319 Mar 03 02:31:45.869710 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 75/145] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:45 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:46.088042 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e19a23e4-ad72-483b-a4c0-d688e42cb016 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:46.098056 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e19a23e4-ad72-483b-a4c0-d688e42cb016 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b" status: 200 len: 1318 microversion: 2.1 time: 0.289466 Mar 03 02:31:46.099436 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 71/146] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:45 2022] GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:31:46.886888 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9e0909f5-f070-4eb0-b136-76307cf2834a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:46.887848 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9e0909f5-f070-4eb0-b136-76307cf2834a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:46.895127 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9e0909f5-f070-4eb0-b136-76307cf2834a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:46.895983 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9e0909f5-f070-4eb0-b136-76307cf2834a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:46.897047 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9e0909f5-f070-4eb0-b136-76307cf2834a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:46.897589 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9e0909f5-f070-4eb0-b136-76307cf2834a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:47.080854 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9e0909f5-f070-4eb0-b136-76307cf2834a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:47.092603 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9e0909f5-f070-4eb0-b136-76307cf2834a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1521 microversion: 2.1 time: 0.207589 Mar 03 02:31:47.094229 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 76/147] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:46 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:47.116513 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0de7daf3-383d-4cae-9b93-f81f2e4096c5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:47.117710 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0de7daf3-383d-4cae-9b93-f81f2e4096c5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 0a347353-a177-432c-82bf-df27655c432b] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:47.128684 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0de7daf3-383d-4cae-9b93-f81f2e4096c5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:47.129400 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0de7daf3-383d-4cae-9b93-f81f2e4096c5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:47.130368 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0de7daf3-383d-4cae-9b93-f81f2e4096c5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:47.130952 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0de7daf3-383d-4cae-9b93-f81f2e4096c5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:47.429040 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-15d5ceff-8940-49a3-95aa-b01239128f4d tempest-VolumesTestJSON-1924302519 tempest-VolumesTestJSON-1924302519-project] Calling method '.version_select at 0x7fb3c84c5280>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:47.484816 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-15d5ceff-8940-49a3-95aa-b01239128f4d tempest-VolumesTestJSON-1924302519 tempest-VolumesTestJSON-1924302519-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b8a1c5e1-16a0-4e12-9bf9-eb80f425df69" status: 200 len: 351 microversion: 2.1 time: 0.059462 Mar 03 02:31:47.485547 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 77/148] 10.222.0.30 () {58 vars in 1244 bytes} [Thu Mar 3 02:31:47 2022] GET /compute/v2.1/os-volumes/b8a1c5e1-16a0-4e12-9bf9-eb80f425df69 => generated 351 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:31:47.533295 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0de7daf3-383d-4cae-9b93-f81f2e4096c5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:47.542362 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0de7daf3-383d-4cae-9b93-f81f2e4096c5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b" status: 200 len: 1318 microversion: 2.1 time: 0.429663 Mar 03 02:31:47.543654 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 72/149] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:47 2022] GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b => generated 1318 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:48.111192 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d56421fe-ab45-4ab5-a27d-fbe0dd3730f4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:48.111950 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d56421fe-ab45-4ab5-a27d-fbe0dd3730f4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:48.119187 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d56421fe-ab45-4ab5-a27d-fbe0dd3730f4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:48.119720 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d56421fe-ab45-4ab5-a27d-fbe0dd3730f4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:48.120574 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d56421fe-ab45-4ab5-a27d-fbe0dd3730f4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:48.121470 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d56421fe-ab45-4ab5-a27d-fbe0dd3730f4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:48.282498 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d56421fe-ab45-4ab5-a27d-fbe0dd3730f4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:48.297675 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d56421fe-ab45-4ab5-a27d-fbe0dd3730f4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1521 microversion: 2.1 time: 0.190160 Mar 03 02:31:48.299742 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 78/150] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:48 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:48.561982 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0364e81e-11a4-4ce5-8983-18d3f87336c4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:48.563214 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0364e81e-11a4-4ce5-8983-18d3f87336c4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 0a347353-a177-432c-82bf-df27655c432b] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:48.575906 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0364e81e-11a4-4ce5-8983-18d3f87336c4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:48.576772 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0364e81e-11a4-4ce5-8983-18d3f87336c4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:48.577972 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0364e81e-11a4-4ce5-8983-18d3f87336c4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:48.581637 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0364e81e-11a4-4ce5-8983-18d3f87336c4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:48.928467 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0364e81e-11a4-4ce5-8983-18d3f87336c4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:48.936194 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0364e81e-11a4-4ce5-8983-18d3f87336c4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b" status: 200 len: 1318 microversion: 2.1 time: 0.379165 Mar 03 02:31:48.936866 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 73/151] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:48 2022] GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b => generated 1318 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:49.314629 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-36bbcd50-178b-4d58-a753-76a644507f8c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:49.315897 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-36bbcd50-178b-4d58-a753-76a644507f8c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:49.323441 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-36bbcd50-178b-4d58-a753-76a644507f8c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:49.326466 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-36bbcd50-178b-4d58-a753-76a644507f8c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:49.327735 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-36bbcd50-178b-4d58-a753-76a644507f8c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:49.328336 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-36bbcd50-178b-4d58-a753-76a644507f8c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:49.556443 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-36bbcd50-178b-4d58-a753-76a644507f8c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:49.566747 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-36bbcd50-178b-4d58-a753-76a644507f8c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1521 microversion: 2.1 time: 0.256076 Mar 03 02:31:49.573257 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 79/152] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:49 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:49.954237 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6295bc3e-875c-41a3-adc2-5427af29af21 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:49.955391 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6295bc3e-875c-41a3-adc2-5427af29af21 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 0a347353-a177-432c-82bf-df27655c432b] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:49.964564 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6295bc3e-875c-41a3-adc2-5427af29af21 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:49.966797 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6295bc3e-875c-41a3-adc2-5427af29af21 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:49.967594 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6295bc3e-875c-41a3-adc2-5427af29af21 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:49.968054 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6295bc3e-875c-41a3-adc2-5427af29af21 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:50.322086 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6295bc3e-875c-41a3-adc2-5427af29af21 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:50.334848 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6295bc3e-875c-41a3-adc2-5427af29af21 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b" status: 200 len: 1318 microversion: 2.1 time: 0.385311 Mar 03 02:31:50.336133 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 74/153] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:49 2022] GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b => generated 1318 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:50.584717 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-20805d7c-68df-478a-b527-d6cec0bac867 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:50.585226 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-20805d7c-68df-478a-b527-d6cec0bac867 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:50.599248 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-20805d7c-68df-478a-b527-d6cec0bac867 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:50.600046 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-20805d7c-68df-478a-b527-d6cec0bac867 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:50.601025 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-20805d7c-68df-478a-b527-d6cec0bac867 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:50.601464 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-20805d7c-68df-478a-b527-d6cec0bac867 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:50.762137 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-20805d7c-68df-478a-b527-d6cec0bac867 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:50.771344 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-20805d7c-68df-478a-b527-d6cec0bac867 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1521 microversion: 2.1 time: 0.190294 Mar 03 02:31:50.772347 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 80/154] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:50 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:51.352665 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-96e7300c-13df-4cf0-903e-b5df23230784 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:51.353384 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-96e7300c-13df-4cf0-903e-b5df23230784 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 0a347353-a177-432c-82bf-df27655c432b] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:51.365165 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-96e7300c-13df-4cf0-903e-b5df23230784 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:51.365609 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-96e7300c-13df-4cf0-903e-b5df23230784 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:51.366402 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-96e7300c-13df-4cf0-903e-b5df23230784 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:51.366833 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-96e7300c-13df-4cf0-903e-b5df23230784 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:51.583633 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-96e7300c-13df-4cf0-903e-b5df23230784 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:51.592581 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-96e7300c-13df-4cf0-903e-b5df23230784 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b" status: 200 len: 1318 microversion: 2.1 time: 0.243823 Mar 03 02:31:51.596614 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 75/155] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:51 2022] GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:51.795406 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9d0d8426-61a9-4355-a6ad-1c8df70e360e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:51.797778 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9d0d8426-61a9-4355-a6ad-1c8df70e360e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:51.806144 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9d0d8426-61a9-4355-a6ad-1c8df70e360e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:51.807319 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9d0d8426-61a9-4355-a6ad-1c8df70e360e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:51.808799 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9d0d8426-61a9-4355-a6ad-1c8df70e360e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:51.809649 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9d0d8426-61a9-4355-a6ad-1c8df70e360e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:51.847108 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5f379bf2-316b-4db6-a88f-1daafa67962a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Action: 'create', calling method: .version_select at 0x7fb3c8416040>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2118924064"}} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:31:51.861930 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.quota [None req-5f379bf2-316b-4db6-a88f-1daafa67962a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Getting quotas for project 5fd996560b97427ea1efbf2206d5adb6. Resources: {'key_pairs'} {{(pid=116859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 03 02:31:51.866975 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.quota [None req-5f379bf2-316b-4db6-a88f-1daafa67962a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Getting quotas for user 4c8e9db4620246f1ad87ad65879ed5af and project 5fd996560b97427ea1efbf2206d5adb6. Resources: {'key_pairs'} {{(pid=116859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 03 02:31:51.945625 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9d0d8426-61a9-4355-a6ad-1c8df70e360e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:51.953520 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9d0d8426-61a9-4355-a6ad-1c8df70e360e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1521 microversion: 2.1 time: 0.168303 Mar 03 02:31:51.954363 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 76/156] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:51 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:31:52.029878 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.quota [None req-5f379bf2-316b-4db6-a88f-1daafa67962a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Getting quotas for project 5fd996560b97427ea1efbf2206d5adb6. Resources: {'key_pairs'} {{(pid=116859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 03 02:31:52.033481 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.quota [None req-5f379bf2-316b-4db6-a88f-1daafa67962a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Getting quotas for user 4c8e9db4620246f1ad87ad65879ed5af and project 5fd996560b97427ea1efbf2206d5adb6. Resources: {'key_pairs'} {{(pid=116859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 03 02:31:52.047922 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5f379bf2-316b-4db6-a88f-1daafa67962a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.385973 Mar 03 02:31:52.047922 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 81/157] 10.222.0.30 () {60 vars in 1157 bytes} [Thu Mar 3 02:31:51 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:52.611195 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-599d17e1-3a37-4052-8463-634e5c4edc9a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:52.611949 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-599d17e1-3a37-4052-8463-634e5c4edc9a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 0a347353-a177-432c-82bf-df27655c432b] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:52.618854 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-599d17e1-3a37-4052-8463-634e5c4edc9a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:52.619379 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-599d17e1-3a37-4052-8463-634e5c4edc9a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:52.620417 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-599d17e1-3a37-4052-8463-634e5c4edc9a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:52.620916 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-599d17e1-3a37-4052-8463-634e5c4edc9a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:52.835670 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-599d17e1-3a37-4052-8463-634e5c4edc9a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:52.843864 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-599d17e1-3a37-4052-8463-634e5c4edc9a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b" status: 200 len: 1318 microversion: 2.1 time: 0.237410 Mar 03 02:31:52.844658 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 77/158] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:52 2022] GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:52.971530 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c2ba0e5b-b2ce-4c74-bf25-b95969c8cb7e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:52.972793 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c2ba0e5b-b2ce-4c74-bf25-b95969c8cb7e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:52.979088 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c2ba0e5b-b2ce-4c74-bf25-b95969c8cb7e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:52.979538 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c2ba0e5b-b2ce-4c74-bf25-b95969c8cb7e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:52.980560 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c2ba0e5b-b2ce-4c74-bf25-b95969c8cb7e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:52.980998 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c2ba0e5b-b2ce-4c74-bf25-b95969c8cb7e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:53.133927 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c2ba0e5b-b2ce-4c74-bf25-b95969c8cb7e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:53.143315 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c2ba0e5b-b2ce-4c74-bf25-b95969c8cb7e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1521 microversion: 2.1 time: 0.175956 Mar 03 02:31:53.144319 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 82/159] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:52 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:53.861943 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-bdd0ef65-1002-4a8f-bf04-e4f1458a0ae7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:53.864265 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-bdd0ef65-1002-4a8f-bf04-e4f1458a0ae7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 0a347353-a177-432c-82bf-df27655c432b] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:53.871276 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bdd0ef65-1002-4a8f-bf04-e4f1458a0ae7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:53.871839 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bdd0ef65-1002-4a8f-bf04-e4f1458a0ae7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:53.874083 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bdd0ef65-1002-4a8f-bf04-e4f1458a0ae7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:53.874592 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bdd0ef65-1002-4a8f-bf04-e4f1458a0ae7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:54.032107 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-bdd0ef65-1002-4a8f-bf04-e4f1458a0ae7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:54.040681 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-bdd0ef65-1002-4a8f-bf04-e4f1458a0ae7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b" status: 200 len: 1318 microversion: 2.1 time: 0.182516 Mar 03 02:31:54.041658 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 78/160] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:53 2022] GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:54.161060 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-265aeddb-05dc-4aaa-a192-97be6473a44a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:54.161655 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-265aeddb-05dc-4aaa-a192-97be6473a44a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:54.167300 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-265aeddb-05dc-4aaa-a192-97be6473a44a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:54.167805 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-265aeddb-05dc-4aaa-a192-97be6473a44a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:54.168602 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-265aeddb-05dc-4aaa-a192-97be6473a44a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:54.169760 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-265aeddb-05dc-4aaa-a192-97be6473a44a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:54.278953 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-67234789-712f-4021-95ad-01902fef2a25 tempest-VolumesTestJSON-1924302519 tempest-VolumesTestJSON-1924302519-project] Calling method '.version_select at 0x7fb3c83174c0>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:54.329293 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-265aeddb-05dc-4aaa-a192-97be6473a44a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:54.337691 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-265aeddb-05dc-4aaa-a192-97be6473a44a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1521 microversion: 2.1 time: 0.180545 Mar 03 02:31:54.337885 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-67234789-712f-4021-95ad-01902fef2a25 tempest-VolumesTestJSON-1924302519 tempest-VolumesTestJSON-1924302519-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/bb2970fc-31f7-4d6f-a42e-f2b1c66b2142" status: 200 len: 351 microversion: 2.1 time: 0.063426 Mar 03 02:31:54.338543 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 79/161] 10.222.0.30 () {58 vars in 1244 bytes} [Thu Mar 3 02:31:54 2022] GET /compute/v2.1/os-volumes/bb2970fc-31f7-4d6f-a42e-f2b1c66b2142 => generated 351 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:31:54.341867 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 83/162] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:54 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:31:55.059032 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-43b11e93-e95b-42ce-ac22-9e6cf855bd61 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:55.059725 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-43b11e93-e95b-42ce-ac22-9e6cf855bd61 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 0a347353-a177-432c-82bf-df27655c432b] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:55.065815 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-43b11e93-e95b-42ce-ac22-9e6cf855bd61 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:55.066258 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-43b11e93-e95b-42ce-ac22-9e6cf855bd61 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:55.067031 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-43b11e93-e95b-42ce-ac22-9e6cf855bd61 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:55.067459 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-43b11e93-e95b-42ce-ac22-9e6cf855bd61 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:55.218707 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-43b11e93-e95b-42ce-ac22-9e6cf855bd61 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:55.228552 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-43b11e93-e95b-42ce-ac22-9e6cf855bd61 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b" status: 200 len: 1318 microversion: 2.1 time: 0.173872 Mar 03 02:31:55.229168 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 80/163] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:55 2022] GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:55.359055 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-bbc27843-fe33-4368-bc51-d2f1b852d679 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:55.359697 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-bbc27843-fe33-4368-bc51-d2f1b852d679 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:55.366222 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bbc27843-fe33-4368-bc51-d2f1b852d679 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:55.367482 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bbc27843-fe33-4368-bc51-d2f1b852d679 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:55.368298 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bbc27843-fe33-4368-bc51-d2f1b852d679 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:55.368745 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bbc27843-fe33-4368-bc51-d2f1b852d679 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:55.527835 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-bbc27843-fe33-4368-bc51-d2f1b852d679 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:55.535941 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-bbc27843-fe33-4368-bc51-d2f1b852d679 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1521 microversion: 2.1 time: 0.181098 Mar 03 02:31:55.536623 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 84/164] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:55 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:56.253183 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-34a84625-6072-425f-af23-c18d7f89dcdb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:56.253858 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-34a84625-6072-425f-af23-c18d7f89dcdb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 0a347353-a177-432c-82bf-df27655c432b] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:56.260163 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-34a84625-6072-425f-af23-c18d7f89dcdb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:56.260610 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-34a84625-6072-425f-af23-c18d7f89dcdb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:56.261386 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-34a84625-6072-425f-af23-c18d7f89dcdb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:56.261847 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-34a84625-6072-425f-af23-c18d7f89dcdb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:56.393243 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-34a84625-6072-425f-af23-c18d7f89dcdb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:56.400484 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-34a84625-6072-425f-af23-c18d7f89dcdb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b" status: 200 len: 1318 microversion: 2.1 time: 0.152204 Mar 03 02:31:56.401054 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 81/165] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:56 2022] GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:56.553709 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e1270936-861a-44d7-a408-319172413b28 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:56.554404 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e1270936-861a-44d7-a408-319172413b28 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:56.560553 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e1270936-861a-44d7-a408-319172413b28 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:56.561014 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e1270936-861a-44d7-a408-319172413b28 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:56.561802 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e1270936-861a-44d7-a408-319172413b28 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:56.562244 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e1270936-861a-44d7-a408-319172413b28 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:56.695460 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e1270936-861a-44d7-a408-319172413b28 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:56.705141 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e1270936-861a-44d7-a408-319172413b28 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1521 microversion: 2.1 time: 0.155337 Mar 03 02:31:56.705712 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 85/166] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:56 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:57.418364 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-29e80ca2-79c3-4acf-acd1-0d70275e0c48 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:57.419092 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-29e80ca2-79c3-4acf-acd1-0d70275e0c48 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 0a347353-a177-432c-82bf-df27655c432b] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:57.425356 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-29e80ca2-79c3-4acf-acd1-0d70275e0c48 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:57.425813 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-29e80ca2-79c3-4acf-acd1-0d70275e0c48 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:57.426591 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-29e80ca2-79c3-4acf-acd1-0d70275e0c48 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:57.427035 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-29e80ca2-79c3-4acf-acd1-0d70275e0c48 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:57.569013 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-29e80ca2-79c3-4acf-acd1-0d70275e0c48 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:57.578599 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-29e80ca2-79c3-4acf-acd1-0d70275e0c48 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b" status: 200 len: 1318 microversion: 2.1 time: 0.163918 Mar 03 02:31:57.579469 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 82/167] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:57 2022] GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:57.722254 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-28904372-e0b7-4b65-9805-b7d4fecac035 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:57.722856 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-28904372-e0b7-4b65-9805-b7d4fecac035 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:57.728760 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-28904372-e0b7-4b65-9805-b7d4fecac035 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:57.729204 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-28904372-e0b7-4b65-9805-b7d4fecac035 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:57.729971 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-28904372-e0b7-4b65-9805-b7d4fecac035 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:57.730404 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-28904372-e0b7-4b65-9805-b7d4fecac035 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:57.888212 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-28904372-e0b7-4b65-9805-b7d4fecac035 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:57.895343 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-28904372-e0b7-4b65-9805-b7d4fecac035 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1521 microversion: 2.1 time: 0.177026 Mar 03 02:31:57.895929 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 86/168] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:57 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:58.596230 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-85ec671b-7dbc-4a0d-bc6d-a1e26b4ff4c5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:58.596780 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-85ec671b-7dbc-4a0d-bc6d-a1e26b4ff4c5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 0a347353-a177-432c-82bf-df27655c432b] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:58.602871 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-85ec671b-7dbc-4a0d-bc6d-a1e26b4ff4c5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:58.603310 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-85ec671b-7dbc-4a0d-bc6d-a1e26b4ff4c5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:58.604132 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-85ec671b-7dbc-4a0d-bc6d-a1e26b4ff4c5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:58.604560 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-85ec671b-7dbc-4a0d-bc6d-a1e26b4ff4c5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:58.739713 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-85ec671b-7dbc-4a0d-bc6d-a1e26b4ff4c5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:58.747495 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-85ec671b-7dbc-4a0d-bc6d-a1e26b4ff4c5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b" status: 200 len: 1318 microversion: 2.1 time: 0.154740 Mar 03 02:31:58.748090 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 83/169] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:58 2022] GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:58.869534 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-18ba6090-417e-45d2-b701-071e3366d51f tempest-VolumesTestJSON-1924302519 tempest-VolumesTestJSON-1924302519-project] Calling method '.version_select at 0x7fb3c8402310>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:58.912152 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-74070f35-2096-497a-9ce3-6a6197393a7b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:58.912759 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-74070f35-2096-497a-9ce3-6a6197393a7b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:58.918652 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-74070f35-2096-497a-9ce3-6a6197393a7b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:58.919168 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-18ba6090-417e-45d2-b701-071e3366d51f tempest-VolumesTestJSON-1924302519 tempest-VolumesTestJSON-1924302519-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/8a9049d4-0c48-4b6b-9a7e-8fe1f2adf868" status: 200 len: 349 microversion: 2.1 time: 0.052815 Mar 03 02:31:58.919262 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-74070f35-2096-497a-9ce3-6a6197393a7b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:58.920114 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 87/170] 10.222.0.30 () {58 vars in 1244 bytes} [Thu Mar 3 02:31:58 2022] GET /compute/v2.1/os-volumes/8a9049d4-0c48-4b6b-9a7e-8fe1f2adf868 => generated 349 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:31:58.924921 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-74070f35-2096-497a-9ce3-6a6197393a7b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:58.925448 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-74070f35-2096-497a-9ce3-6a6197393a7b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:58.930687 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6ff93425-81c3-4422-ba01-4b8829e1716b tempest-VolumesTestJSON-1924302519 tempest-VolumesTestJSON-1924302519-project] Calling method '.version_select at 0x7fb3c8402040>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:59.026019 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6ff93425-81c3-4422-ba01-4b8829e1716b tempest-VolumesTestJSON-1924302519 tempest-VolumesTestJSON-1924302519-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.099133 Mar 03 02:31:59.026769 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 88/171] 10.222.0.30 () {58 vars in 1133 bytes} [Thu Mar 3 02:31:58 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:59.040480 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5b201b32-223a-4ade-9154-4acedcde1e22 tempest-VolumesTestJSON-1924302519 tempest-VolumesTestJSON-1924302519-project] Calling method '.version_select at 0x7fb3c84cbca0>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:59.085346 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-74070f35-2096-497a-9ce3-6a6197393a7b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:59.094326 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-74070f35-2096-497a-9ce3-6a6197393a7b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1521 microversion: 2.1 time: 0.185868 Mar 03 02:31:59.094904 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 84/172] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:58 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:31:59.145691 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5b201b32-223a-4ade-9154-4acedcde1e22 tempest-VolumesTestJSON-1924302519 tempest-VolumesTestJSON-1924302519-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.109014 Mar 03 02:31:59.146256 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 89/173] 10.222.0.30 () {58 vars in 1148 bytes} [Thu Mar 3 02:31:59 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:31:59.159014 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-058cdf3d-e39c-443f-87f4-927c4e151980 tempest-VolumesTestJSON-1924302519 tempest-VolumesTestJSON-1924302519-project] Calling method '.version_select at 0x7fb3c85c6c10>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:59.272453 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-058cdf3d-e39c-443f-87f4-927c4e151980 tempest-VolumesTestJSON-1924302519 tempest-VolumesTestJSON-1924302519-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.116831 Mar 03 02:31:59.279984 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 85/174] 10.222.0.30 () {58 vars in 1133 bytes} [Thu Mar 3 02:31:59 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:59.284336 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-dfe59575-2deb-42c5-ac4c-056aeb707fa5 tempest-VolumesTestJSON-1924302519 tempest-VolumesTestJSON-1924302519-project] Calling method '.version_select at 0x7fb3c85763a0>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:59.395366 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-dfe59575-2deb-42c5-ac4c-056aeb707fa5 tempest-VolumesTestJSON-1924302519 tempest-VolumesTestJSON-1924302519-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.114682 Mar 03 02:31:59.395968 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 90/175] 10.222.0.30 () {58 vars in 1166 bytes} [Thu Mar 3 02:31:59 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:31:59.408886 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-58916ffa-f9da-4933-b09d-67b9194488cf tempest-VolumesTestJSON-1924302519 tempest-VolumesTestJSON-1924302519-project] Calling method '.version_select at 0x7fb3c83c24c0>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:59.502791 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-58916ffa-f9da-4933-b09d-67b9194488cf tempest-VolumesTestJSON-1924302519 tempest-VolumesTestJSON-1924302519-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.099109 Mar 03 02:31:59.503480 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 86/176] 10.222.0.30 () {58 vars in 1169 bytes} [Thu Mar 3 02:31:59 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:31:59.520680 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-40eac5fe-3185-4f64-8c99-7ad1281b0f36 tempest-VolumesTestJSON-1924302519 tempest-VolumesTestJSON-1924302519-project] Calling method '.version_select at 0x7fb3c8402b80>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:59.619542 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-40eac5fe-3185-4f64-8c99-7ad1281b0f36 tempest-VolumesTestJSON-1924302519 tempest-VolumesTestJSON-1924302519-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.105281 Mar 03 02:31:59.620331 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 91/177] 10.222.0.30 () {58 vars in 1154 bytes} [Thu Mar 3 02:31:59 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:59.634177 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3d5e48f7-a0aa-412b-b002-bca75a6c34c9 tempest-VolumesTestJSON-1924302519 tempest-VolumesTestJSON-1924302519-project] Calling method '.version_select at 0x7fb3c82d9280>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:59.751664 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3d5e48f7-a0aa-412b-b002-bca75a6c34c9 tempest-VolumesTestJSON-1924302519 tempest-VolumesTestJSON-1924302519-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.122070 Mar 03 02:31:59.752521 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 87/178] 10.222.0.30 () {58 vars in 1187 bytes} [Thu Mar 3 02:31:59 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:31:59.765283 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-10f99128-d932-497a-9a82-35094d18c5f8 tempest-VolumesTestJSON-1924302519 tempest-VolumesTestJSON-1924302519-project] Calling method '.version_select at 0x7fb3c84803a0>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:59.766272 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a9b676d2-b2e6-47d7-8d10-f902c3a7b12a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:31:59.767115 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a9b676d2-b2e6-47d7-8d10-f902c3a7b12a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 0a347353-a177-432c-82bf-df27655c432b] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:31:59.774088 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a9b676d2-b2e6-47d7-8d10-f902c3a7b12a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:59.774555 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a9b676d2-b2e6-47d7-8d10-f902c3a7b12a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:59.776525 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a9b676d2-b2e6-47d7-8d10-f902c3a7b12a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:31:59.776981 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a9b676d2-b2e6-47d7-8d10-f902c3a7b12a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:31:59.859273 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-10f99128-d932-497a-9a82-35094d18c5f8 tempest-VolumesTestJSON-1924302519 tempest-VolumesTestJSON-1924302519-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.098067 Mar 03 02:31:59.860123 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 88/179] 10.222.0.30 () {58 vars in 1154 bytes} [Thu Mar 3 02:31:59 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:31:59.963755 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a9b676d2-b2e6-47d7-8d10-f902c3a7b12a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:31:59.972937 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a9b676d2-b2e6-47d7-8d10-f902c3a7b12a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b" status: 200 len: 1318 microversion: 2.1 time: 0.211576 Mar 03 02:31:59.973656 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 92/180] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:31:59 2022] GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:00.111463 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8203fae2-9424-4b46-859b-b6a72cfcf10f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:00.112090 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8203fae2-9424-4b46-859b-b6a72cfcf10f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:00.118172 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8203fae2-9424-4b46-859b-b6a72cfcf10f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:00.118617 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8203fae2-9424-4b46-859b-b6a72cfcf10f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:00.119381 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8203fae2-9424-4b46-859b-b6a72cfcf10f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:00.119836 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8203fae2-9424-4b46-859b-b6a72cfcf10f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:00.257934 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8203fae2-9424-4b46-859b-b6a72cfcf10f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:00.265726 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8203fae2-9424-4b46-859b-b6a72cfcf10f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1521 microversion: 2.1 time: 0.158448 Mar 03 02:32:00.266298 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 89/181] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:00 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:00.991252 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b29b9dd5-649a-4ebb-80bb-3e19da72f05d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:00.991887 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b29b9dd5-649a-4ebb-80bb-3e19da72f05d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 0a347353-a177-432c-82bf-df27655c432b] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:01.001868 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b29b9dd5-649a-4ebb-80bb-3e19da72f05d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:01.001868 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b29b9dd5-649a-4ebb-80bb-3e19da72f05d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:01.001868 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b29b9dd5-649a-4ebb-80bb-3e19da72f05d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:01.001868 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b29b9dd5-649a-4ebb-80bb-3e19da72f05d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:01.217997 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b29b9dd5-649a-4ebb-80bb-3e19da72f05d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:01.228126 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b29b9dd5-649a-4ebb-80bb-3e19da72f05d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b" status: 200 len: 1318 microversion: 2.1 time: 0.240570 Mar 03 02:32:01.229080 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 93/182] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:00 2022] GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:01.285496 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-29691638-12fc-4bc4-ad41-8b43d765d7fb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:01.287023 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-29691638-12fc-4bc4-ad41-8b43d765d7fb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:01.295209 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-29691638-12fc-4bc4-ad41-8b43d765d7fb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:01.295673 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-29691638-12fc-4bc4-ad41-8b43d765d7fb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:01.296478 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-29691638-12fc-4bc4-ad41-8b43d765d7fb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:01.296979 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-29691638-12fc-4bc4-ad41-8b43d765d7fb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:01.472653 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [req-9e5995ee-bc67-46f5-853b-9fd1adb4dabc req-44fef9d5-da73-4528-8012-3ef540166e9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a347353-a177-432c-82bf-df27655c432b", "name": "network-vif-plugged", "status": "completed", "tag": "f951e911-a3ec-4460-9442-5bd41e0e1976"}]} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:32:01.478601 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-29691638-12fc-4bc4-ad41-8b43d765d7fb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:01.488227 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-29691638-12fc-4bc4-ad41-8b43d765d7fb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1521 microversion: 2.1 time: 0.207050 Mar 03 02:32:01.491768 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 90/183] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:01 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:01.493587 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-9e5995ee-bc67-46f5-853b-9fd1adb4dabc req-44fef9d5-da73-4528-8012-3ef540166e9c service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:01.494099 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-9e5995ee-bc67-46f5-853b-9fd1adb4dabc req-44fef9d5-da73-4528-8012-3ef540166e9c service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:01.506332 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.compute.server_external_events [req-9e5995ee-bc67-46f5-853b-9fd1adb4dabc req-44fef9d5-da73-4528-8012-3ef540166e9c service nova] Creating event network-vif-plugged:f951e911-a3ec-4460-9442-5bd41e0e1976 for instance 0a347353-a177-432c-82bf-df27655c432b on hv-cinder-81977 Mar 03 02:32:01.511693 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [req-9e5995ee-bc67-46f5-853b-9fd1adb4dabc req-44fef9d5-da73-4528-8012-3ef540166e9c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042734 Mar 03 02:32:01.512558 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 94/184] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:32:02.248280 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-df16eb16-0df2-4015-ad25-c72da637c983 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:02.249275 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-df16eb16-0df2-4015-ad25-c72da637c983 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 0a347353-a177-432c-82bf-df27655c432b] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:02.257318 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-df16eb16-0df2-4015-ad25-c72da637c983 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:02.258050 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-df16eb16-0df2-4015-ad25-c72da637c983 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:02.259392 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-df16eb16-0df2-4015-ad25-c72da637c983 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:02.263924 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-df16eb16-0df2-4015-ad25-c72da637c983 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:02.413726 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-df16eb16-0df2-4015-ad25-c72da637c983 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:02.423427 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-df16eb16-0df2-4015-ad25-c72da637c983 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b" status: 200 len: 1318 microversion: 2.1 time: 0.180769 Mar 03 02:32:02.424065 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 91/185] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:02 2022] GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:02.508061 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-68f3fa39-40f8-4a1f-93bb-9f224a39ed8c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:02.508835 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-68f3fa39-40f8-4a1f-93bb-9f224a39ed8c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:02.516243 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-68f3fa39-40f8-4a1f-93bb-9f224a39ed8c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:02.516897 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-68f3fa39-40f8-4a1f-93bb-9f224a39ed8c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:02.517656 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-68f3fa39-40f8-4a1f-93bb-9f224a39ed8c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:02.518159 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-68f3fa39-40f8-4a1f-93bb-9f224a39ed8c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:02.665038 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-68f3fa39-40f8-4a1f-93bb-9f224a39ed8c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:02.672345 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-68f3fa39-40f8-4a1f-93bb-9f224a39ed8c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1521 microversion: 2.1 time: 0.168605 Mar 03 02:32:02.672913 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 95/186] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:02 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:03.442173 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-76d3fa41-83d0-48a3-a911-3ccefaaf2a8a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:03.443686 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-76d3fa41-83d0-48a3-a911-3ccefaaf2a8a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 0a347353-a177-432c-82bf-df27655c432b] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:03.451025 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-76d3fa41-83d0-48a3-a911-3ccefaaf2a8a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:03.451468 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-76d3fa41-83d0-48a3-a911-3ccefaaf2a8a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:03.452284 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-76d3fa41-83d0-48a3-a911-3ccefaaf2a8a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:03.452714 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-76d3fa41-83d0-48a3-a911-3ccefaaf2a8a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:03.614916 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-76d3fa41-83d0-48a3-a911-3ccefaaf2a8a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:03.623279 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-76d3fa41-83d0-48a3-a911-3ccefaaf2a8a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b" status: 200 len: 1508 microversion: 2.1 time: 0.185793 Mar 03 02:32:03.623966 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 92/187] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:03 2022] GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b => generated 1508 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:03.640794 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ec4f8852-dea6-4f05-9f83-83c93aaa3a53 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd43e02d-9618-4fe0-94cb-53c31b6af67b"}} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:32:03.642623 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ec4f8852-dea6-4f05-9f83-83c93aaa3a53 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 0a347353-a177-432c-82bf-df27655c432b] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:03.649929 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ec4f8852-dea6-4f05-9f83-83c93aaa3a53 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:03.650644 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ec4f8852-dea6-4f05-9f83-83c93aaa3a53 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:03.651864 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ec4f8852-dea6-4f05-9f83-83c93aaa3a53 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:03.652759 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ec4f8852-dea6-4f05-9f83-83c93aaa3a53 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:03.690613 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-af66174a-5d05-449e-887a-366c1e352a60 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:03.691233 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-af66174a-5d05-449e-887a-366c1e352a60 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:03.697381 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-af66174a-5d05-449e-887a-366c1e352a60 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:03.697839 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-af66174a-5d05-449e-887a-366c1e352a60 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:03.698627 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-af66174a-5d05-449e-887a-366c1e352a60 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:03.699224 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-af66174a-5d05-449e-887a-366c1e352a60 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:03.753725 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.wsgi [None req-ec4f8852-dea6-4f05-9f83-83c93aaa3a53 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] HTTP exception thrown: Invalid volume: volume bd43e02d-9618-4fe0-94cb-53c31b6af67b is already attached to instances: dd292525-cb8e-4520-a771-d22e2d3d6619 Mar 03 02:32:03.754471 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ec4f8852-dea6-4f05-9f83-83c93aaa3a53 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Returning 400 to user: Invalid volume: volume bd43e02d-9618-4fe0-94cb-53c31b6af67b is already attached to instances: dd292525-cb8e-4520-a771-d22e2d3d6619 {{(pid=116859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:32:03.755408 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ec4f8852-dea6-4f05-9f83-83c93aaa3a53 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "POST /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.118999 Mar 03 02:32:03.756113 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 96/188] 10.222.0.30 () {60 vars in 1322 bytes} [Thu Mar 3 02:32:03 2022] POST /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b/os-volume_attachments => generated 174 bytes in 120 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 03 02:32:03.851379 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7c6258c5-4d39-4f81-93f5-bf71f6becdb1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:03.852405 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7c6258c5-4d39-4f81-93f5-bf71f6becdb1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: dd292525-cb8e-4520-a771-d22e2d3d6619] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:03.862093 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7c6258c5-4d39-4f81-93f5-bf71f6becdb1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:03.862801 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7c6258c5-4d39-4f81-93f5-bf71f6becdb1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:03.864332 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7c6258c5-4d39-4f81-93f5-bf71f6becdb1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:03.865138 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7c6258c5-4d39-4f81-93f5-bf71f6becdb1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:03.912372 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-af66174a-5d05-449e-887a-366c1e352a60 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:03.920673 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-af66174a-5d05-449e-887a-366c1e352a60 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1521 microversion: 2.1 time: 0.234760 Mar 03 02:32:03.921507 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 93/189] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:03 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:32:03.999821 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.objects.instance [None req-7c6258c5-4d39-4f81-93f5-bf71f6becdb1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lazy-loading 'services' on Instance uuid dd292525-cb8e-4520-a771-d22e2d3d6619 {{(pid=116859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 03 02:32:04.129720 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7c6258c5-4d39-4f81-93f5-bf71f6becdb1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "DELETE /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619/os-volume_attachments/bd43e02d-9618-4fe0-94cb-53c31b6af67b" status: 202 len: 0 microversion: 2.1 time: 0.283019 Mar 03 02:32:04.134542 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 97/190] 10.222.0.30 () {58 vars in 1415 bytes} [Thu Mar 3 02:32:03 2022] DELETE /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619/os-volume_attachments/bd43e02d-9618-4fe0-94cb-53c31b6af67b => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 03 02:32:04.139151 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7c61d052-de86-4a57-9e1d-6aff8fccb9a6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:04.140356 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7c61d052-de86-4a57-9e1d-6aff8fccb9a6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: dd292525-cb8e-4520-a771-d22e2d3d6619] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:04.147135 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c61d052-de86-4a57-9e1d-6aff8fccb9a6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:04.147638 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c61d052-de86-4a57-9e1d-6aff8fccb9a6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:04.148530 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c61d052-de86-4a57-9e1d-6aff8fccb9a6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:04.149158 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c61d052-de86-4a57-9e1d-6aff8fccb9a6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:04.181002 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7c61d052-de86-4a57-9e1d-6aff8fccb9a6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046085 Mar 03 02:32:04.181583 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 94/191] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:32:04 2022] GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:32:04.938684 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-bd7a6c5e-4196-4912-bf6b-7180a22f89be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:04.940086 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-bd7a6c5e-4196-4912-bf6b-7180a22f89be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:04.945006 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-fdf83f9a-a3d6-422e-b6d0-7860acb87f79 tempest-VolumesNegativeTest-354939239 tempest-VolumesNegativeTest-354939239-project] Action: 'create', calling method: .version_select at 0x7fb3c8486a60>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1349026598", "metadata": {"Type": "work"}}} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:32:04.946991 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-fdf83f9a-a3d6-422e-b6d0-7860acb87f79 tempest-VolumesNegativeTest-354939239 tempest-VolumesNegativeTest-354939239-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:32:04.947261 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bd7a6c5e-4196-4912-bf6b-7180a22f89be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:04.947732 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bd7a6c5e-4196-4912-bf6b-7180a22f89be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:04.947876 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-fdf83f9a-a3d6-422e-b6d0-7860acb87f79 tempest-VolumesNegativeTest-354939239 tempest-VolumesNegativeTest-354939239-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.128941 Mar 03 02:32:04.948358 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 98/192] 10.222.0.30 () {60 vars in 1155 bytes} [Thu Mar 3 02:32:04 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 130 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 03 02:32:04.948808 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bd7a6c5e-4196-4912-bf6b-7180a22f89be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:04.949244 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bd7a6c5e-4196-4912-bf6b-7180a22f89be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:04.958246 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2307fb5e-770f-4b1f-aa12-8954483a8a6b tempest-VolumesNegativeTest-354939239 tempest-VolumesNegativeTest-354939239-project] Action: 'create', calling method: .version_select at 0x7fb3c8494ca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2098144159", "metadata": {"Type": "work"}}} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:32:04.959630 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2307fb5e-770f-4b1f-aa12-8954483a8a6b tempest-VolumesNegativeTest-354939239 tempest-VolumesNegativeTest-354939239-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:32:04.960432 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2307fb5e-770f-4b1f-aa12-8954483a8a6b tempest-VolumesNegativeTest-354939239 tempest-VolumesNegativeTest-354939239-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006558 Mar 03 02:32:04.965048 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 99/193] 10.222.0.30 () {60 vars in 1155 bytes} [Thu Mar 3 02:32:04 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 03 02:32:04.970096 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-015e77af-2cba-440c-b7cb-e6a0e12c040e tempest-VolumesNegativeTest-354939239 tempest-VolumesNegativeTest-354939239-project] Action: 'create', calling method: .version_select at 0x7fb3c94d7f70>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-495751061", "metadata": {"Type": "work"}}} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:32:04.971233 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-015e77af-2cba-440c-b7cb-e6a0e12c040e tempest-VolumesNegativeTest-354939239 tempest-VolumesNegativeTest-354939239-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:32:04.972056 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-015e77af-2cba-440c-b7cb-e6a0e12c040e tempest-VolumesNegativeTest-354939239 tempest-VolumesNegativeTest-354939239-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005534 Mar 03 02:32:04.972576 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 100/194] 10.222.0.30 () {60 vars in 1155 bytes} [Thu Mar 3 02:32:04 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 03 02:32:04.981417 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d1fd5b40-bcb7-408c-9e7c-d0d6cc1f3e68 tempest-VolumesNegativeTest-354939239 tempest-VolumesNegativeTest-354939239-project] Calling method '.version_select at 0x7fb3c83ce790>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:05.014423 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.wsgi [None req-d1fd5b40-bcb7-408c-9e7c-d0d6cc1f3e68 tempest-VolumesNegativeTest-354939239 tempest-VolumesNegativeTest-354939239-project] HTTP exception thrown: Volume tempest-invalid-1044012945 could not be found. Mar 03 02:32:05.015027 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d1fd5b40-bcb7-408c-9e7c-d0d6cc1f3e68 tempest-VolumesNegativeTest-354939239 tempest-VolumesNegativeTest-354939239-project] Returning 404 to user: Volume tempest-invalid-1044012945 could not be found. {{(pid=116859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:32:05.016099 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d1fd5b40-bcb7-408c-9e7c-d0d6cc1f3e68 tempest-VolumesNegativeTest-354939239 tempest-VolumesNegativeTest-354939239-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1044012945" status: 404 len: 99 microversion: 2.1 time: 0.038596 Mar 03 02:32:05.016649 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 101/195] 10.222.0.30 () {58 vars in 1217 bytes} [Thu Mar 3 02:32:04 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1044012945 => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Mar 03 02:32:05.026715 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5f75d4b8-38a4-4131-a8e4-e01b550967e7 tempest-VolumesNegativeTest-354939239 tempest-VolumesNegativeTest-354939239-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003726 Mar 03 02:32:05.027397 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 102/196] 10.222.0.30 () {58 vars in 1139 bytes} [Thu Mar 3 02:32:05 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Mar 03 02:32:05.036517 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6b3ef627-d844-4aa7-b65a-f27e00ee2a00 tempest-VolumesNegativeTest-354939239 tempest-VolumesNegativeTest-354939239-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003603 Mar 03 02:32:05.037158 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 103/197] 10.222.0.30 () {58 vars in 1136 bytes} [Thu Mar 3 02:32:05 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Mar 03 02:32:05.046074 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-28546011-a1f2-4156-9d05-bcdaf6336a76 tempest-VolumesNegativeTest-354939239 tempest-VolumesNegativeTest-354939239-project] Calling method '.version_select at 0x7fb3c84c5160>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:05.076383 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.wsgi [None req-28546011-a1f2-4156-9d05-bcdaf6336a76 tempest-VolumesNegativeTest-354939239 tempest-VolumesNegativeTest-354939239-project] HTTP exception thrown: Volume 98a180ba-a3fe-420d-9b2a-1fe05da02d05 could not be found. Mar 03 02:32:05.077790 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-28546011-a1f2-4156-9d05-bcdaf6336a76 tempest-VolumesNegativeTest-354939239 tempest-VolumesNegativeTest-354939239-project] Returning 404 to user: Volume 98a180ba-a3fe-420d-9b2a-1fe05da02d05 could not be found. {{(pid=116859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:32:05.079202 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-28546011-a1f2-4156-9d05-bcdaf6336a76 tempest-VolumesNegativeTest-354939239 tempest-VolumesNegativeTest-354939239-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/98a180ba-a3fe-420d-9b2a-1fe05da02d05" status: 404 len: 109 microversion: 2.1 time: 0.036848 Mar 03 02:32:05.080177 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 104/198] 10.222.0.30 () {58 vars in 1247 bytes} [Thu Mar 3 02:32:05 2022] DELETE /compute/v2.1/os-volumes/98a180ba-a3fe-420d-9b2a-1fe05da02d05 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 03 02:32:05.091023 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2465a45d-9499-4c10-90fa-5675de10c9ff tempest-VolumesNegativeTest-354939239 tempest-VolumesNegativeTest-354939239-project] Calling method '.version_select at 0x7fb3c85b8b80>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:05.124087 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-bd7a6c5e-4196-4912-bf6b-7180a22f89be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:05.127120 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.wsgi [None req-2465a45d-9499-4c10-90fa-5675de10c9ff tempest-VolumesNegativeTest-354939239 tempest-VolumesNegativeTest-354939239-project] HTTP exception thrown: Volume e3e74d3b-390a-4ea2-a133-1eeb5b38b55c could not be found. Mar 03 02:32:05.127979 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2465a45d-9499-4c10-90fa-5675de10c9ff tempest-VolumesNegativeTest-354939239 tempest-VolumesNegativeTest-354939239-project] Returning 404 to user: Volume e3e74d3b-390a-4ea2-a133-1eeb5b38b55c could not be found. {{(pid=116859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:32:05.128803 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2465a45d-9499-4c10-90fa-5675de10c9ff tempest-VolumesNegativeTest-354939239 tempest-VolumesNegativeTest-354939239-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/e3e74d3b-390a-4ea2-a133-1eeb5b38b55c" status: 404 len: 109 microversion: 2.1 time: 0.043380 Mar 03 02:32:05.129479 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 105/199] 10.222.0.30 () {58 vars in 1244 bytes} [Thu Mar 3 02:32:05 2022] GET /compute/v2.1/os-volumes/e3e74d3b-390a-4ea2-a133-1eeb5b38b55c => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 03 02:32:05.132716 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-bd7a6c5e-4196-4912-bf6b-7180a22f89be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1521 microversion: 2.1 time: 0.197586 Mar 03 02:32:05.135922 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 95/200] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:04 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:32:05.193465 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4ec29ea7-c712-430f-8d21-3df3a1b3fb15 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:05.194487 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4ec29ea7-c712-430f-8d21-3df3a1b3fb15 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: dd292525-cb8e-4520-a771-d22e2d3d6619] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:05.201956 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4ec29ea7-c712-430f-8d21-3df3a1b3fb15 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:05.202401 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4ec29ea7-c712-430f-8d21-3df3a1b3fb15 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:05.203368 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4ec29ea7-c712-430f-8d21-3df3a1b3fb15 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:05.203829 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4ec29ea7-c712-430f-8d21-3df3a1b3fb15 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:05.248784 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4ec29ea7-c712-430f-8d21-3df3a1b3fb15 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059079 Mar 03 02:32:05.249963 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 106/201] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:32:05 2022] GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:32:06.151406 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-37a290eb-f072-4246-be1a-d1d8b8d9134d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:06.152110 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-37a290eb-f072-4246-be1a-d1d8b8d9134d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:06.160821 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-37a290eb-f072-4246-be1a-d1d8b8d9134d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:06.161604 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-37a290eb-f072-4246-be1a-d1d8b8d9134d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:06.162619 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-37a290eb-f072-4246-be1a-d1d8b8d9134d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:06.163259 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-37a290eb-f072-4246-be1a-d1d8b8d9134d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:06.261165 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2f06e3a0-838c-4f52-97fd-ee9582dd885f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:06.262849 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2f06e3a0-838c-4f52-97fd-ee9582dd885f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: dd292525-cb8e-4520-a771-d22e2d3d6619] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:06.270011 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f06e3a0-838c-4f52-97fd-ee9582dd885f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:06.270466 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f06e3a0-838c-4f52-97fd-ee9582dd885f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:06.275065 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f06e3a0-838c-4f52-97fd-ee9582dd885f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:06.275744 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f06e3a0-838c-4f52-97fd-ee9582dd885f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:06.319265 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2f06e3a0-838c-4f52-97fd-ee9582dd885f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062602 Mar 03 02:32:06.323483 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 107/202] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:32:06 2022] GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:32:06.388440 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-37a290eb-f072-4246-be1a-d1d8b8d9134d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:06.396134 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-37a290eb-f072-4246-be1a-d1d8b8d9134d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1521 microversion: 2.1 time: 0.248688 Mar 03 02:32:06.396854 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 96/203] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:06 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:07.330843 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3054012e-8045-4f0f-9fb0-b005479ecc3c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:07.333004 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3054012e-8045-4f0f-9fb0-b005479ecc3c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: dd292525-cb8e-4520-a771-d22e2d3d6619] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:07.339488 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3054012e-8045-4f0f-9fb0-b005479ecc3c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:07.340208 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3054012e-8045-4f0f-9fb0-b005479ecc3c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:07.342361 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3054012e-8045-4f0f-9fb0-b005479ecc3c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:07.343376 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3054012e-8045-4f0f-9fb0-b005479ecc3c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:07.379847 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3054012e-8045-4f0f-9fb0-b005479ecc3c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053016 Mar 03 02:32:07.380550 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 108/204] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:32:07 2022] GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:32:07.415587 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b22e8868-7ce9-474c-a802-d0e3455a330a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:07.416918 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b22e8868-7ce9-474c-a802-d0e3455a330a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:07.423631 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b22e8868-7ce9-474c-a802-d0e3455a330a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:07.424093 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b22e8868-7ce9-474c-a802-d0e3455a330a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:07.424985 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b22e8868-7ce9-474c-a802-d0e3455a330a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:07.425423 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b22e8868-7ce9-474c-a802-d0e3455a330a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:07.645621 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b22e8868-7ce9-474c-a802-d0e3455a330a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:07.653256 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b22e8868-7ce9-474c-a802-d0e3455a330a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1521 microversion: 2.1 time: 0.243431 Mar 03 02:32:07.654020 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 97/205] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:07 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:32:08.400479 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-97a90c19-e8e8-416e-967e-7db32af5244e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:08.401905 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-97a90c19-e8e8-416e-967e-7db32af5244e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: dd292525-cb8e-4520-a771-d22e2d3d6619] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:08.410860 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-97a90c19-e8e8-416e-967e-7db32af5244e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:08.411318 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-97a90c19-e8e8-416e-967e-7db32af5244e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:08.412141 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-97a90c19-e8e8-416e-967e-7db32af5244e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:08.412605 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-97a90c19-e8e8-416e-967e-7db32af5244e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:08.485602 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-97a90c19-e8e8-416e-967e-7db32af5244e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.091466 Mar 03 02:32:08.487651 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 109/206] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:32:08 2022] GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619/os-volume_attachments => generated 25 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 03 02:32:08.660276 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5bd9ff63-4326-41bf-b5f8-782391f8d4a2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1537562438", "imageRef": "1fe11a1a-b4d0-46f5-89cd-501ceff49317", "flavorRef": "452", "networks": [{"uuid": "d9d2edb4-611d-4e02-94de-0b7e65f130ad"}]}} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:32:08.671441 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b5adf062-7782-438b-b3d3-48a969636d79 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:08.672160 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b5adf062-7782-438b-b3d3-48a969636d79 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:08.686881 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b5adf062-7782-438b-b3d3-48a969636d79 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:08.687176 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b5adf062-7782-438b-b3d3-48a969636d79 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:08.688005 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b5adf062-7782-438b-b3d3-48a969636d79 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:08.688441 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b5adf062-7782-438b-b3d3-48a969636d79 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:08.778062 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.network.neutron [None req-5bd9ff63-4326-41bf-b5f8-782391f8d4a2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] validate_networks() for [('d9d2edb4-611d-4e02-94de-0b7e65f130ad', None, None, None, None, None)] {{(pid=116858) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 03 02:32:09.088041 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b5adf062-7782-438b-b3d3-48a969636d79 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:09.100564 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b5adf062-7782-438b-b3d3-48a969636d79 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1521 microversion: 2.1 time: 0.434017 Mar 03 02:32:09.101434 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 110/207] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:08 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1521 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:09.325481 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-5bd9ff63-4326-41bf-b5f8-782391f8d4a2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Flavor limits 0:0:0 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 03 02:32:09.326111 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-5bd9ff63-4326-41bf-b5f8-782391f8d4a2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Image limits 0:0:0 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 03 02:32:09.326765 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-5bd9ff63-4326-41bf-b5f8-782391f8d4a2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Flavor pref 0:0:0 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 03 02:32:09.327312 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-5bd9ff63-4326-41bf-b5f8-782391f8d4a2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Image pref 0:0:0 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 03 02:32:09.328032 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-5bd9ff63-4326-41bf-b5f8-782391f8d4a2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 03 02:32:09.342564 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5bd9ff63-4326-41bf-b5f8-782391f8d4a2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:09.344283 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5bd9ff63-4326-41bf-b5f8-782391f8d4a2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:09.346733 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5bd9ff63-4326-41bf-b5f8-782391f8d4a2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:09.348031 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5bd9ff63-4326-41bf-b5f8-782391f8d4a2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:09.371468 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.quota [None req-5bd9ff63-4326-41bf-b5f8-782391f8d4a2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Getting quotas for project 2e235fd949e6494eb47967914074be06. Resources: {'instances', 'ram', 'cores'} {{(pid=116858) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 03 02:32:09.377962 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.quota [None req-5bd9ff63-4326-41bf-b5f8-782391f8d4a2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Getting quotas for user 76da7e26281640968c429d04efb3dd3e and project 2e235fd949e6494eb47967914074be06. Resources: {'instances', 'ram', 'cores'} {{(pid=116858) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 03 02:32:09.391792 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5bd9ff63-4326-41bf-b5f8-782391f8d4a2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Going to run 1 instances... {{(pid=116858) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 03 02:32:09.395116 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5bd9ff63-4326-41bf-b5f8-782391f8d4a2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 530afc76-5f4b-470c-a4fe-6ecb6f5dbb97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1fe11a1a-b4d0-46f5-89cd-501ceff49317',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116858) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 03 02:32:09.491005 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5bd9ff63-4326-41bf-b5f8-782391f8d4a2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.835170 Mar 03 02:32:09.492210 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 98/208] 10.222.0.30 () {60 vars in 1146 bytes} [Thu Mar 3 02:32:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 03 02:32:09.502950 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f79826f4-5bef-4275-8729-4a608295fd0f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:09.504580 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f79826f4-5bef-4275-8729-4a608295fd0f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 530afc76-5f4b-470c-a4fe-6ecb6f5dbb97] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:09.581071 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f79826f4-5bef-4275-8729-4a608295fd0f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:09.593454 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f79826f4-5bef-4275-8729-4a608295fd0f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97" status: 200 len: 1218 microversion: 2.1 time: 0.094003 Mar 03 02:32:09.597126 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 111/209] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:09 2022] GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97 => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:10.118807 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a9b5228d-5e0c-4b57-9b6c-837399f5a2ad tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:10.120513 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a9b5228d-5e0c-4b57-9b6c-837399f5a2ad tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:10.130936 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a9b5228d-5e0c-4b57-9b6c-837399f5a2ad tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:10.131504 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a9b5228d-5e0c-4b57-9b6c-837399f5a2ad tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:10.132457 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a9b5228d-5e0c-4b57-9b6c-837399f5a2ad tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:10.132962 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a9b5228d-5e0c-4b57-9b6c-837399f5a2ad tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:10.365442 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a9b5228d-5e0c-4b57-9b6c-837399f5a2ad tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:10.386971 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a9b5228d-5e0c-4b57-9b6c-837399f5a2ad tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1521 microversion: 2.1 time: 0.272330 Mar 03 02:32:10.388351 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 99/210] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:10 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:10.611198 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-59a0990d-c8c8-48b6-95c2-a8f882e8bd2e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:10.611864 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-59a0990d-c8c8-48b6-95c2-a8f882e8bd2e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 530afc76-5f4b-470c-a4fe-6ecb6f5dbb97] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:10.625319 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-59a0990d-c8c8-48b6-95c2-a8f882e8bd2e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:10.626133 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-59a0990d-c8c8-48b6-95c2-a8f882e8bd2e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:10.627202 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-59a0990d-c8c8-48b6-95c2-a8f882e8bd2e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:10.627733 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-59a0990d-c8c8-48b6-95c2-a8f882e8bd2e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:10.847181 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-59a0990d-c8c8-48b6-95c2-a8f882e8bd2e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:10.855302 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-59a0990d-c8c8-48b6-95c2-a8f882e8bd2e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97" status: 200 len: 1222 microversion: 2.1 time: 0.248635 Mar 03 02:32:10.856745 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 112/211] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:10 2022] GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97 => generated 1222 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:11.405146 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-01ac816d-7b21-4ed0-9f49-5ae92b63eb49 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:11.406002 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-01ac816d-7b21-4ed0-9f49-5ae92b63eb49 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:11.415819 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-01ac816d-7b21-4ed0-9f49-5ae92b63eb49 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:11.416367 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-01ac816d-7b21-4ed0-9f49-5ae92b63eb49 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:11.417252 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-01ac816d-7b21-4ed0-9f49-5ae92b63eb49 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:11.417765 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-01ac816d-7b21-4ed0-9f49-5ae92b63eb49 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:11.640006 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-01ac816d-7b21-4ed0-9f49-5ae92b63eb49 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:11.648895 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-01ac816d-7b21-4ed0-9f49-5ae92b63eb49 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1521 microversion: 2.1 time: 0.248037 Mar 03 02:32:11.649932 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 100/212] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:11 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:11.874295 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-706ad7e9-1dd3-418f-af43-72805b9ddfd7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:11.875426 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-706ad7e9-1dd3-418f-af43-72805b9ddfd7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 530afc76-5f4b-470c-a4fe-6ecb6f5dbb97] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:11.881841 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-706ad7e9-1dd3-418f-af43-72805b9ddfd7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:11.882328 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-706ad7e9-1dd3-418f-af43-72805b9ddfd7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:11.883195 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-706ad7e9-1dd3-418f-af43-72805b9ddfd7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:11.883660 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-706ad7e9-1dd3-418f-af43-72805b9ddfd7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:11.953896 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-706ad7e9-1dd3-418f-af43-72805b9ddfd7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:11.961559 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-706ad7e9-1dd3-418f-af43-72805b9ddfd7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97" status: 200 len: 1270 microversion: 2.1 time: 0.092036 Mar 03 02:32:11.962136 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 113/213] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:11 2022] GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97 => generated 1270 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:12.674411 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-633eab4e-3c6a-499a-a5fd-0a03d882ac2e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:12.676410 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-633eab4e-3c6a-499a-a5fd-0a03d882ac2e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:12.706804 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-633eab4e-3c6a-499a-a5fd-0a03d882ac2e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:12.707744 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-633eab4e-3c6a-499a-a5fd-0a03d882ac2e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:12.716352 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-633eab4e-3c6a-499a-a5fd-0a03d882ac2e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:12.717969 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-633eab4e-3c6a-499a-a5fd-0a03d882ac2e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:12.979870 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-74be619a-97cb-4fef-9297-5d364f6fbad2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:12.980524 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-74be619a-97cb-4fef-9297-5d364f6fbad2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 530afc76-5f4b-470c-a4fe-6ecb6f5dbb97] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:12.992488 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-74be619a-97cb-4fef-9297-5d364f6fbad2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:12.993260 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-74be619a-97cb-4fef-9297-5d364f6fbad2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:12.994772 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-74be619a-97cb-4fef-9297-5d364f6fbad2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:12.995540 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-74be619a-97cb-4fef-9297-5d364f6fbad2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:13.111433 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-74be619a-97cb-4fef-9297-5d364f6fbad2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:13.123337 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-74be619a-97cb-4fef-9297-5d364f6fbad2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97" status: 200 len: 1276 microversion: 2.1 time: 0.147166 Mar 03 02:32:13.125105 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 114/214] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:12 2022] GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97 => generated 1276 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:13.464300 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-633eab4e-3c6a-499a-a5fd-0a03d882ac2e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:13.478011 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-633eab4e-3c6a-499a-a5fd-0a03d882ac2e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1521 microversion: 2.1 time: 0.812764 Mar 03 02:32:13.478945 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 101/215] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:12 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1521 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:14.141919 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-98ec423b-c32f-4dea-b492-e38dadf21ec1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:14.142627 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-98ec423b-c32f-4dea-b492-e38dadf21ec1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 530afc76-5f4b-470c-a4fe-6ecb6f5dbb97] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:14.173237 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-98ec423b-c32f-4dea-b492-e38dadf21ec1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:14.174127 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-98ec423b-c32f-4dea-b492-e38dadf21ec1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:14.174407 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-98ec423b-c32f-4dea-b492-e38dadf21ec1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:14.174833 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-98ec423b-c32f-4dea-b492-e38dadf21ec1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:14.460214 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-98ec423b-c32f-4dea-b492-e38dadf21ec1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:14.474368 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-98ec423b-c32f-4dea-b492-e38dadf21ec1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97" status: 200 len: 1318 microversion: 2.1 time: 0.337617 Mar 03 02:32:14.475726 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 115/216] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:14 2022] GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97 => generated 1318 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:14.499670 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-84898db0-f16e-432f-b8e0-ace10d3212d8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:14.500273 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-84898db0-f16e-432f-b8e0-ace10d3212d8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:14.506883 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-84898db0-f16e-432f-b8e0-ace10d3212d8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:14.507658 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-84898db0-f16e-432f-b8e0-ace10d3212d8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:14.508684 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-84898db0-f16e-432f-b8e0-ace10d3212d8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:14.509350 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-84898db0-f16e-432f-b8e0-ace10d3212d8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:14.891329 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-84898db0-f16e-432f-b8e0-ace10d3212d8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:14.900641 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-84898db0-f16e-432f-b8e0-ace10d3212d8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1521 microversion: 2.1 time: 0.407647 Mar 03 02:32:14.901568 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 102/217] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:14 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1521 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:15.501977 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-bc3db170-8288-4d6f-ac23-bf06103a4cb9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:15.504186 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-bc3db170-8288-4d6f-ac23-bf06103a4cb9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 530afc76-5f4b-470c-a4fe-6ecb6f5dbb97] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:15.523169 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bc3db170-8288-4d6f-ac23-bf06103a4cb9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:15.524086 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bc3db170-8288-4d6f-ac23-bf06103a4cb9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:15.525368 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bc3db170-8288-4d6f-ac23-bf06103a4cb9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:15.526168 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bc3db170-8288-4d6f-ac23-bf06103a4cb9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:15.616120 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [req-f4db4000-e912-4a62-8225-d1347601d1a2 req-c41f93c8-5fe8-4fe2-bdb7-af6abc4ed041 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "530afc76-5f4b-470c-a4fe-6ecb6f5dbb97", "tag": "1828ce31-b2f8-47d4-8193-c1c71a8d2361"}]} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:32:15.632275 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-f4db4000-e912-4a62-8225-d1347601d1a2 req-c41f93c8-5fe8-4fe2-bdb7-af6abc4ed041 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:15.634017 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-f4db4000-e912-4a62-8225-d1347601d1a2 req-c41f93c8-5fe8-4fe2-bdb7-af6abc4ed041 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:15.650665 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.compute.server_external_events [req-f4db4000-e912-4a62-8225-d1347601d1a2 req-c41f93c8-5fe8-4fe2-bdb7-af6abc4ed041 service nova] Creating event network-changed:1828ce31-b2f8-47d4-8193-c1c71a8d2361 for instance 530afc76-5f4b-470c-a4fe-6ecb6f5dbb97 on hv-cinder-81977 Mar 03 02:32:15.657372 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [req-f4db4000-e912-4a62-8225-d1347601d1a2 req-c41f93c8-5fe8-4fe2-bdb7-af6abc4ed041 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046272 Mar 03 02:32:15.658606 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 103/218] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:32:15.793038 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-bc3db170-8288-4d6f-ac23-bf06103a4cb9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:15.803738 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-bc3db170-8288-4d6f-ac23-bf06103a4cb9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97" status: 200 len: 1318 microversion: 2.1 time: 0.315098 Mar 03 02:32:15.805221 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 116/219] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:15 2022] GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97 => generated 1318 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:15.920786 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-69aee334-2e1d-49bb-805b-8a3c4ac603bd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:15.921500 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-69aee334-2e1d-49bb-805b-8a3c4ac603bd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:15.940287 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-69aee334-2e1d-49bb-805b-8a3c4ac603bd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:15.940747 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-69aee334-2e1d-49bb-805b-8a3c4ac603bd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:15.941817 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-69aee334-2e1d-49bb-805b-8a3c4ac603bd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:15.943115 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-69aee334-2e1d-49bb-805b-8a3c4ac603bd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:16.253141 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-69aee334-2e1d-49bb-805b-8a3c4ac603bd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:16.262674 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-69aee334-2e1d-49bb-805b-8a3c4ac603bd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1521 microversion: 2.1 time: 0.347728 Mar 03 02:32:16.265168 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 104/220] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:15 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1521 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:16.821322 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-674e818e-49d1-41be-8dbb-e143bd84faf1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:16.821967 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-674e818e-49d1-41be-8dbb-e143bd84faf1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 530afc76-5f4b-470c-a4fe-6ecb6f5dbb97] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:16.832624 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-674e818e-49d1-41be-8dbb-e143bd84faf1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:16.833446 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-674e818e-49d1-41be-8dbb-e143bd84faf1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:16.833876 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-674e818e-49d1-41be-8dbb-e143bd84faf1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:16.834317 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-674e818e-49d1-41be-8dbb-e143bd84faf1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:17.060895 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-674e818e-49d1-41be-8dbb-e143bd84faf1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:17.070525 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-674e818e-49d1-41be-8dbb-e143bd84faf1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97" status: 200 len: 1318 microversion: 2.1 time: 0.252809 Mar 03 02:32:17.071682 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 117/221] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:16 2022] GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97 => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:17.282434 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-16d9655c-593e-41fa-8c1d-327b805eb992 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:17.286004 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-16d9655c-593e-41fa-8c1d-327b805eb992 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:17.294717 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-16d9655c-593e-41fa-8c1d-327b805eb992 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:17.295619 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-16d9655c-593e-41fa-8c1d-327b805eb992 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:17.296674 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-16d9655c-593e-41fa-8c1d-327b805eb992 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:17.298595 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-16d9655c-593e-41fa-8c1d-327b805eb992 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:17.740324 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-16d9655c-593e-41fa-8c1d-327b805eb992 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:17.749792 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-16d9655c-593e-41fa-8c1d-327b805eb992 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1521 microversion: 2.1 time: 0.472121 Mar 03 02:32:17.759316 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 105/222] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:17 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1521 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:18.100993 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c7afc007-0eb2-4170-9728-bfae54db7130 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:18.102146 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c7afc007-0eb2-4170-9728-bfae54db7130 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 530afc76-5f4b-470c-a4fe-6ecb6f5dbb97] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:18.111135 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c7afc007-0eb2-4170-9728-bfae54db7130 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:18.111833 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c7afc007-0eb2-4170-9728-bfae54db7130 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:18.112852 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c7afc007-0eb2-4170-9728-bfae54db7130 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:18.113560 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c7afc007-0eb2-4170-9728-bfae54db7130 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:18.303897 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c7afc007-0eb2-4170-9728-bfae54db7130 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:18.312469 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c7afc007-0eb2-4170-9728-bfae54db7130 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97" status: 200 len: 1318 microversion: 2.1 time: 0.215751 Mar 03 02:32:18.313406 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 118/223] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:18 2022] GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97 => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:18.780666 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-91fa0137-a623-4316-9484-9c977f1437dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:18.781386 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-91fa0137-a623-4316-9484-9c977f1437dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:18.787898 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-91fa0137-a623-4316-9484-9c977f1437dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:18.788424 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-91fa0137-a623-4316-9484-9c977f1437dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:18.791541 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-91fa0137-a623-4316-9484-9c977f1437dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:18.792339 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-91fa0137-a623-4316-9484-9c977f1437dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:19.011782 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-91fa0137-a623-4316-9484-9c977f1437dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:19.077005 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-91fa0137-a623-4316-9484-9c977f1437dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1521 microversion: 2.1 time: 0.302809 Mar 03 02:32:19.078833 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 106/224] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:18 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:19.337249 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-127f9908-af88-423c-b379-1d8e2fe02dd7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:19.338408 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-127f9908-af88-423c-b379-1d8e2fe02dd7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 530afc76-5f4b-470c-a4fe-6ecb6f5dbb97] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:19.354566 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-127f9908-af88-423c-b379-1d8e2fe02dd7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:19.355227 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-127f9908-af88-423c-b379-1d8e2fe02dd7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:19.357702 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-127f9908-af88-423c-b379-1d8e2fe02dd7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:19.365103 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-127f9908-af88-423c-b379-1d8e2fe02dd7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:19.633301 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-127f9908-af88-423c-b379-1d8e2fe02dd7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:19.642595 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-127f9908-af88-423c-b379-1d8e2fe02dd7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97" status: 200 len: 1318 microversion: 2.1 time: 0.309665 Mar 03 02:32:19.657868 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 119/225] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:19 2022] GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97 => generated 1318 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:20.104665 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0e414a92-c1bf-48b5-84bb-0cd42fcfb105 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:20.106644 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0e414a92-c1bf-48b5-84bb-0cd42fcfb105 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:20.113886 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0e414a92-c1bf-48b5-84bb-0cd42fcfb105 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:20.114913 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0e414a92-c1bf-48b5-84bb-0cd42fcfb105 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:20.117116 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0e414a92-c1bf-48b5-84bb-0cd42fcfb105 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:20.117797 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0e414a92-c1bf-48b5-84bb-0cd42fcfb105 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:20.321805 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0e414a92-c1bf-48b5-84bb-0cd42fcfb105 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:20.329397 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0e414a92-c1bf-48b5-84bb-0cd42fcfb105 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1521 microversion: 2.1 time: 0.230900 Mar 03 02:32:20.338553 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 107/226] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:20 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:20.663781 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-edc19d39-5958-486b-929c-b267d203ff1d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:20.665316 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-edc19d39-5958-486b-929c-b267d203ff1d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 530afc76-5f4b-470c-a4fe-6ecb6f5dbb97] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:20.678707 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-edc19d39-5958-486b-929c-b267d203ff1d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:20.680095 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-edc19d39-5958-486b-929c-b267d203ff1d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:20.682406 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-edc19d39-5958-486b-929c-b267d203ff1d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:20.684196 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-edc19d39-5958-486b-929c-b267d203ff1d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:20.948312 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-edc19d39-5958-486b-929c-b267d203ff1d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:20.958402 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-edc19d39-5958-486b-929c-b267d203ff1d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97" status: 200 len: 1318 microversion: 2.1 time: 0.301353 Mar 03 02:32:20.959566 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 120/227] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:20 2022] GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97 => generated 1318 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:21.346518 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9cfc69e3-b6ea-439b-a342-2e9b544bf2ed tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:21.347133 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9cfc69e3-b6ea-439b-a342-2e9b544bf2ed tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:21.357361 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9cfc69e3-b6ea-439b-a342-2e9b544bf2ed tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:21.358461 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9cfc69e3-b6ea-439b-a342-2e9b544bf2ed tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:21.360810 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9cfc69e3-b6ea-439b-a342-2e9b544bf2ed tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:21.361255 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9cfc69e3-b6ea-439b-a342-2e9b544bf2ed tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:21.623993 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9cfc69e3-b6ea-439b-a342-2e9b544bf2ed tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:21.633202 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9cfc69e3-b6ea-439b-a342-2e9b544bf2ed tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1521 microversion: 2.1 time: 0.290648 Mar 03 02:32:21.635670 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 108/228] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:21 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:21.718044 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9f312ae9-e992-4737-8841-88507810c448 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2057870054", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2118924064", "security_groups": [{"name": "tempest-secgroup-smoke-527377081"}], "block_device_mapping_v2": [{"uuid": "bfa35eaa-0b49-4aac-bcaa-fdcbdd428025", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d4423e33-b4d0-4ac8-978d-cd726e65a6f4"}]}} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:32:21.878379 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.network.neutron [None req-9f312ae9-e992-4737-8841-88507810c448 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] validate_networks() for [('d4423e33-b4d0-4ac8-978d-cd726e65a6f4', None, None, None, None, None)] {{(pid=116859) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 03 02:32:21.976994 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-49a58e0f-7af3-49e2-b79c-7323eadfbb5d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:21.977778 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-49a58e0f-7af3-49e2-b79c-7323eadfbb5d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 530afc76-5f4b-470c-a4fe-6ecb6f5dbb97] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:21.987400 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-49a58e0f-7af3-49e2-b79c-7323eadfbb5d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:21.987937 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-49a58e0f-7af3-49e2-b79c-7323eadfbb5d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:21.990213 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-49a58e0f-7af3-49e2-b79c-7323eadfbb5d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:21.990866 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-49a58e0f-7af3-49e2-b79c-7323eadfbb5d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:22.307464 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-49a58e0f-7af3-49e2-b79c-7323eadfbb5d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:22.321145 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-49a58e0f-7af3-49e2-b79c-7323eadfbb5d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97" status: 200 len: 1318 microversion: 2.1 time: 0.348930 Mar 03 02:32:22.322197 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 109/229] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:21 2022] GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97 => generated 1318 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:32:22.560697 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-9f312ae9-e992-4737-8841-88507810c448 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Flavor limits 0:0:0 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 03 02:32:22.561026 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-9f312ae9-e992-4737-8841-88507810c448 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Image limits 0:0:0 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 03 02:32:22.561498 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-9f312ae9-e992-4737-8841-88507810c448 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Flavor pref 0:0:0 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 03 02:32:22.561908 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-9f312ae9-e992-4737-8841-88507810c448 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Image pref 0:0:0 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 03 02:32:22.562318 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-9f312ae9-e992-4737-8841-88507810c448 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 03 02:32:22.571965 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9f312ae9-e992-4737-8841-88507810c448 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:22.572683 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9f312ae9-e992-4737-8841-88507810c448 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:22.573731 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9f312ae9-e992-4737-8841-88507810c448 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:22.574419 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9f312ae9-e992-4737-8841-88507810c448 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:22.595237 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.quota [None req-9f312ae9-e992-4737-8841-88507810c448 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Getting quotas for project 5fd996560b97427ea1efbf2206d5adb6. Resources: {'instances', 'ram', 'cores'} {{(pid=116859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 03 02:32:22.599500 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.quota [None req-9f312ae9-e992-4737-8841-88507810c448 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Getting quotas for user 4c8e9db4620246f1ad87ad65879ed5af and project 5fd996560b97427ea1efbf2206d5adb6. Resources: {'instances', 'ram', 'cores'} {{(pid=116859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 03 02:32:22.652279 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2d678441-82c9-45d5-89ff-7fe627b588f2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:22.652974 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2d678441-82c9-45d5-89ff-7fe627b588f2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:22.659363 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2d678441-82c9-45d5-89ff-7fe627b588f2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:22.667715 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2d678441-82c9-45d5-89ff-7fe627b588f2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:22.669138 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2d678441-82c9-45d5-89ff-7fe627b588f2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:22.669590 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2d678441-82c9-45d5-89ff-7fe627b588f2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:22.698843 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9f312ae9-e992-4737-8841-88507810c448 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Going to run 1 instances... {{(pid=116859) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 03 02:32:22.702837 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9f312ae9-e992-4737-8841-88507810c448 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bfa35eaa-0b49-4aac-bcaa-fdcbdd428025',volume_size=None,volume_type=None)] {{(pid=116859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 03 02:32:22.933309 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9f312ae9-e992-4737-8841-88507810c448 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.220885 Mar 03 02:32:22.936933 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 121/230] 10.222.0.30 () {60 vars in 1146 bytes} [Thu Mar 3 02:32:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 1225 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 03 02:32:22.960957 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2d678441-82c9-45d5-89ff-7fe627b588f2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:22.975752 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-09ab652f-fb77-4c6f-8003-775b91bdc040 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:22.978805 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2d678441-82c9-45d5-89ff-7fe627b588f2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1521 microversion: 2.1 time: 0.325655 Mar 03 02:32:22.981013 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-09ab652f-fb77-4c6f-8003-775b91bdc040 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:22.981887 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 110/231] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:22 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:32:23.109627 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-09ab652f-fb77-4c6f-8003-775b91bdc040 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:23.126597 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-09ab652f-fb77-4c6f-8003-775b91bdc040 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1095 microversion: 2.1 time: 0.173566 Mar 03 02:32:23.127203 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 122/232] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:22 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1095 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:23.391915 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9ee75434-c9e7-464f-82c9-8678c25af604 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:23.391915 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9ee75434-c9e7-464f-82c9-8678c25af604 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 530afc76-5f4b-470c-a4fe-6ecb6f5dbb97] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:23.398587 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9ee75434-c9e7-464f-82c9-8678c25af604 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:23.400081 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9ee75434-c9e7-464f-82c9-8678c25af604 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:23.401051 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9ee75434-c9e7-464f-82c9-8678c25af604 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:23.401646 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9ee75434-c9e7-464f-82c9-8678c25af604 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:23.713319 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9ee75434-c9e7-464f-82c9-8678c25af604 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:23.727761 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9ee75434-c9e7-464f-82c9-8678c25af604 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97" status: 200 len: 1318 microversion: 2.1 time: 0.366736 Mar 03 02:32:23.729575 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 111/233] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:23 2022] GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97 => generated 1318 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:32:24.006741 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6dfc0f1c-f8f8-4916-a091-a208f38a2cef tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:24.007588 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6dfc0f1c-f8f8-4916-a091-a208f38a2cef tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:24.017874 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6dfc0f1c-f8f8-4916-a091-a208f38a2cef tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:24.022251 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6dfc0f1c-f8f8-4916-a091-a208f38a2cef tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:24.024849 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6dfc0f1c-f8f8-4916-a091-a208f38a2cef tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:24.027633 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6dfc0f1c-f8f8-4916-a091-a208f38a2cef tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:24.144631 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-708f02bf-a58a-41a3-ac01-de141c17ba5e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:24.145623 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-708f02bf-a58a-41a3-ac01-de141c17ba5e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:24.158803 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-708f02bf-a58a-41a3-ac01-de141c17ba5e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:24.160989 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-708f02bf-a58a-41a3-ac01-de141c17ba5e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:24.162248 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-708f02bf-a58a-41a3-ac01-de141c17ba5e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:24.163031 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-708f02bf-a58a-41a3-ac01-de141c17ba5e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:24.247307 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-6dfc0f1c-f8f8-4916-a091-a208f38a2cef tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:24.262211 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6dfc0f1c-f8f8-4916-a091-a208f38a2cef tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1521 microversion: 2.1 time: 0.269245 Mar 03 02:32:24.267956 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 123/234] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:23 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:32:24.276547 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-708f02bf-a58a-41a3-ac01-de141c17ba5e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:24.288127 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-708f02bf-a58a-41a3-ac01-de141c17ba5e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1193 microversion: 2.1 time: 0.147199 Mar 03 02:32:24.289239 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 112/235] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:24 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1193 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:24.747253 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8d3d2bbc-fb0a-47fd-b515-87469121c654 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:24.747993 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8d3d2bbc-fb0a-47fd-b515-87469121c654 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 530afc76-5f4b-470c-a4fe-6ecb6f5dbb97] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:24.758429 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8d3d2bbc-fb0a-47fd-b515-87469121c654 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:24.759237 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8d3d2bbc-fb0a-47fd-b515-87469121c654 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:24.762703 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8d3d2bbc-fb0a-47fd-b515-87469121c654 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:24.763370 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8d3d2bbc-fb0a-47fd-b515-87469121c654 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:25.045915 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8d3d2bbc-fb0a-47fd-b515-87469121c654 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:25.064778 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8d3d2bbc-fb0a-47fd-b515-87469121c654 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97" status: 200 len: 1318 microversion: 2.1 time: 0.322375 Mar 03 02:32:25.077749 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 124/236] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:24 2022] GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97 => generated 1318 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:25.281504 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [req-4a9bbcf0-c1e5-439d-8aa0-86811e174cbb req-147528d9-0447-437e-9802-d2d85687102e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "530afc76-5f4b-470c-a4fe-6ecb6f5dbb97", "name": "network-vif-plugged", "status": "completed", "tag": "1828ce31-b2f8-47d4-8193-c1c71a8d2361"}]} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:32:25.289135 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c55d6c4a-5b6d-44b8-be16-bd191e546c49 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:25.289762 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c55d6c4a-5b6d-44b8-be16-bd191e546c49 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:25.308884 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c55d6c4a-5b6d-44b8-be16-bd191e546c49 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:25.309535 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c55d6c4a-5b6d-44b8-be16-bd191e546c49 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:25.310512 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c55d6c4a-5b6d-44b8-be16-bd191e546c49 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:25.337653 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-4a9bbcf0-c1e5-439d-8aa0-86811e174cbb req-147528d9-0447-437e-9802-d2d85687102e service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:25.337653 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-4a9bbcf0-c1e5-439d-8aa0-86811e174cbb req-147528d9-0447-437e-9802-d2d85687102e service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:25.337818 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c55d6c4a-5b6d-44b8-be16-bd191e546c49 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:25.394668 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.compute.server_external_events [req-4a9bbcf0-c1e5-439d-8aa0-86811e174cbb req-147528d9-0447-437e-9802-d2d85687102e service nova] Creating event network-vif-plugged:1828ce31-b2f8-47d4-8193-c1c71a8d2361 for instance 530afc76-5f4b-470c-a4fe-6ecb6f5dbb97 on hv-cinder-81977 Mar 03 02:32:25.417963 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [req-4a9bbcf0-c1e5-439d-8aa0-86811e174cbb req-147528d9-0447-437e-9802-d2d85687102e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140681 Mar 03 02:32:25.428076 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 125/237] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:32:25.457857 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-cdf570a9-1c01-4263-b7aa-300ce753a186 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:25.458567 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-cdf570a9-1c01-4263-b7aa-300ce753a186 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:25.485737 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cdf570a9-1c01-4263-b7aa-300ce753a186 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:25.491120 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cdf570a9-1c01-4263-b7aa-300ce753a186 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:25.494907 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cdf570a9-1c01-4263-b7aa-300ce753a186 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:25.498425 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cdf570a9-1c01-4263-b7aa-300ce753a186 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:25.747809 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-cdf570a9-1c01-4263-b7aa-300ce753a186 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:25.773084 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-cdf570a9-1c01-4263-b7aa-300ce753a186 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1211 microversion: 2.1 time: 0.337070 Mar 03 02:32:25.774814 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 126/238] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:25 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1211 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:26.032372 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c55d6c4a-5b6d-44b8-be16-bd191e546c49 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:26.039800 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c55d6c4a-5b6d-44b8-be16-bd191e546c49 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1521 microversion: 2.1 time: 0.763533 Mar 03 02:32:26.040385 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 113/239] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:25 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1521 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:26.085641 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6c68ba9d-5d27-4e41-a306-9b0dc0ff2906 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:26.086257 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6c68ba9d-5d27-4e41-a306-9b0dc0ff2906 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 530afc76-5f4b-470c-a4fe-6ecb6f5dbb97] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:26.095591 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6c68ba9d-5d27-4e41-a306-9b0dc0ff2906 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:26.097023 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6c68ba9d-5d27-4e41-a306-9b0dc0ff2906 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:26.098049 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6c68ba9d-5d27-4e41-a306-9b0dc0ff2906 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:26.098526 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6c68ba9d-5d27-4e41-a306-9b0dc0ff2906 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:26.342154 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-6c68ba9d-5d27-4e41-a306-9b0dc0ff2906 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:26.350676 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6c68ba9d-5d27-4e41-a306-9b0dc0ff2906 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97" status: 200 len: 1318 microversion: 2.1 time: 0.269037 Mar 03 02:32:26.351266 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 127/240] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:26 2022] GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97 => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:26.796152 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-dc414614-9446-492c-a91c-6087d3ff015e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:26.797566 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-dc414614-9446-492c-a91c-6087d3ff015e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:26.813886 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dc414614-9446-492c-a91c-6087d3ff015e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:26.814705 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dc414614-9446-492c-a91c-6087d3ff015e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:26.815878 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dc414614-9446-492c-a91c-6087d3ff015e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:26.816718 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dc414614-9446-492c-a91c-6087d3ff015e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:27.057771 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f5fba9b8-ec80-4b5b-b3e4-e6120dfacc4f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:27.058420 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f5fba9b8-ec80-4b5b-b3e4-e6120dfacc4f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:27.069090 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f5fba9b8-ec80-4b5b-b3e4-e6120dfacc4f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:27.070417 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f5fba9b8-ec80-4b5b-b3e4-e6120dfacc4f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:27.077100 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f5fba9b8-ec80-4b5b-b3e4-e6120dfacc4f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:27.077717 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f5fba9b8-ec80-4b5b-b3e4-e6120dfacc4f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:27.268267 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f5fba9b8-ec80-4b5b-b3e4-e6120dfacc4f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:27.278950 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f5fba9b8-ec80-4b5b-b3e4-e6120dfacc4f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1521 microversion: 2.1 time: 0.223889 Mar 03 02:32:27.280060 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 128/241] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:27 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:27.281133 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-dc414614-9446-492c-a91c-6087d3ff015e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:27.288311 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-dc414614-9446-492c-a91c-6087d3ff015e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1266 microversion: 2.1 time: 0.500533 Mar 03 02:32:27.292707 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 114/242] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:26 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1266 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:27.375801 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-03f201a0-6b09-4d54-b869-daca2f7efc77 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:27.377583 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-03f201a0-6b09-4d54-b869-daca2f7efc77 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 530afc76-5f4b-470c-a4fe-6ecb6f5dbb97] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:27.394325 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-03f201a0-6b09-4d54-b869-daca2f7efc77 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:27.395030 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-03f201a0-6b09-4d54-b869-daca2f7efc77 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:27.396118 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-03f201a0-6b09-4d54-b869-daca2f7efc77 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:27.397039 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-03f201a0-6b09-4d54-b869-daca2f7efc77 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:27.637374 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-03f201a0-6b09-4d54-b869-daca2f7efc77 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:27.651564 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-03f201a0-6b09-4d54-b869-daca2f7efc77 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97" status: 200 len: 1318 microversion: 2.1 time: 0.283264 Mar 03 02:32:27.654824 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 129/243] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:27 2022] GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97 => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:27.777225 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [req-0b0300e9-74c6-4b5d-ac2d-48a281492094 req-8bcf4540-3df9-474a-9656-cc87a4273ad4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4ca9b17-c039-4bdc-9a51-c1351edaf4d3", "tag": "3a27027e-071e-47ba-b741-f3a6273ab83f"}]} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:32:27.797769 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-0b0300e9-74c6-4b5d-ac2d-48a281492094 req-8bcf4540-3df9-474a-9656-cc87a4273ad4 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:27.799669 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-0b0300e9-74c6-4b5d-ac2d-48a281492094 req-8bcf4540-3df9-474a-9656-cc87a4273ad4 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:27.821025 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.compute.server_external_events [req-0b0300e9-74c6-4b5d-ac2d-48a281492094 req-8bcf4540-3df9-474a-9656-cc87a4273ad4 service nova] Creating event network-changed:3a27027e-071e-47ba-b741-f3a6273ab83f for instance b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 on hv-cinder-81977 Mar 03 02:32:27.828636 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [req-0b0300e9-74c6-4b5d-ac2d-48a281492094 req-8bcf4540-3df9-474a-9656-cc87a4273ad4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059756 Mar 03 02:32:27.832462 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 115/244] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:32:28.308035 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-780808ac-0547-4c02-9929-40803488aa0e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:28.309216 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-780808ac-0547-4c02-9929-40803488aa0e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:28.332158 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-780808ac-0547-4c02-9929-40803488aa0e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:28.339060 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ab72d0dd-030d-4c24-953b-a28168a899ce tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:28.341439 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ab72d0dd-030d-4c24-953b-a28168a899ce tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:28.353102 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-780808ac-0547-4c02-9929-40803488aa0e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:28.356137 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-780808ac-0547-4c02-9929-40803488aa0e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:28.359755 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-780808ac-0547-4c02-9929-40803488aa0e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:28.371328 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ab72d0dd-030d-4c24-953b-a28168a899ce tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:28.373277 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ab72d0dd-030d-4c24-953b-a28168a899ce tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:28.374367 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ab72d0dd-030d-4c24-953b-a28168a899ce tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:28.374955 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ab72d0dd-030d-4c24-953b-a28168a899ce tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:28.616505 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ab72d0dd-030d-4c24-953b-a28168a899ce tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:28.626823 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ab72d0dd-030d-4c24-953b-a28168a899ce tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1501 microversion: 2.1 time: 0.334352 Mar 03 02:32:28.635234 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 130/245] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:28 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1501 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:28.651067 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-380652fc-6ede-4159-acd3-048f6f1dd893 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:28.651842 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-380652fc-6ede-4159-acd3-048f6f1dd893 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:28.658502 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-380652fc-6ede-4159-acd3-048f6f1dd893 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:28.659043 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-380652fc-6ede-4159-acd3-048f6f1dd893 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:28.660006 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-380652fc-6ede-4159-acd3-048f6f1dd893 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:28.660458 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-380652fc-6ede-4159-acd3-048f6f1dd893 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:28.926655 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-780808ac-0547-4c02-9929-40803488aa0e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:28.939544 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-780808ac-0547-4c02-9929-40803488aa0e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1266 microversion: 2.1 time: 0.636607 Mar 03 02:32:28.951286 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 116/246] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:28 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1266 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:32:28.960131 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-829d5588-206e-4421-90c2-9f06fb69119c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:28.961349 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-829d5588-206e-4421-90c2-9f06fb69119c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 530afc76-5f4b-470c-a4fe-6ecb6f5dbb97] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:28.968439 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-829d5588-206e-4421-90c2-9f06fb69119c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:28.969416 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-829d5588-206e-4421-90c2-9f06fb69119c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:28.970695 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-829d5588-206e-4421-90c2-9f06fb69119c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:28.971477 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-829d5588-206e-4421-90c2-9f06fb69119c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:29.160296 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-380652fc-6ede-4159-acd3-048f6f1dd893 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:29.168911 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-380652fc-6ede-4159-acd3-048f6f1dd893 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1514 microversion: 2.1 time: 0.521160 Mar 03 02:32:29.179976 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 131/247] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:28 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1514 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:32:29.418711 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-829d5588-206e-4421-90c2-9f06fb69119c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:29.430306 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-829d5588-206e-4421-90c2-9f06fb69119c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97" status: 200 len: 1507 microversion: 2.1 time: 0.475828 Mar 03 02:32:29.433307 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 117/248] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:28 2022] GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97 => generated 1507 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:29.958101 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-903c5d7f-9b4a-42ee-a238-2030bcb16999 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:29.958700 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-903c5d7f-9b4a-42ee-a238-2030bcb16999 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:29.974220 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-903c5d7f-9b4a-42ee-a238-2030bcb16999 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:29.974220 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-903c5d7f-9b4a-42ee-a238-2030bcb16999 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:29.974220 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-903c5d7f-9b4a-42ee-a238-2030bcb16999 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:29.974220 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-903c5d7f-9b4a-42ee-a238-2030bcb16999 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:30.175391 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-903c5d7f-9b4a-42ee-a238-2030bcb16999 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:30.183449 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-903c5d7f-9b4a-42ee-a238-2030bcb16999 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1266 microversion: 2.1 time: 0.229090 Mar 03 02:32:30.185496 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 132/249] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:29 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:30.697811 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6ea3bcec-e852-4774-be94-5281a4fb7379 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:32:30.700865 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6ea3bcec-e852-4774-be94-5281a4fb7379 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:30.708868 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6ea3bcec-e852-4774-be94-5281a4fb7379 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:30.709559 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6ea3bcec-e852-4774-be94-5281a4fb7379 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:30.710580 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6ea3bcec-e852-4774-be94-5281a4fb7379 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:30.711168 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6ea3bcec-e852-4774-be94-5281a4fb7379 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:30.753461 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.objects.instance [None req-6ea3bcec-e852-4774-be94-5281a4fb7379 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lazy-loading 'flavor' on Instance uuid 0b9116d7-0099-4dfe-b678-192ce74500eb {{(pid=116858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 03 02:32:30.869277 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6ea3bcec-e852-4774-be94-5281a4fb7379 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "POST /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/action" status: 200 len: 32 microversion: 2.1 time: 0.175043 Mar 03 02:32:30.876706 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 118/250] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Mar 3 02:32:30 2022] POST /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/action => generated 32 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Mar 03 02:32:30.881204 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e6611dd5-d62d-4465-b13c-d811f5bc89b6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:30.882114 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e6611dd5-d62d-4465-b13c-d811f5bc89b6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:30.910326 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e6611dd5-d62d-4465-b13c-d811f5bc89b6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:30.911190 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e6611dd5-d62d-4465-b13c-d811f5bc89b6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:30.912040 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e6611dd5-d62d-4465-b13c-d811f5bc89b6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:30.912482 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e6611dd5-d62d-4465-b13c-d811f5bc89b6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:31.079843 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a8c09e5d-123f-46cc-873e-04dea9e57c44 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4bdc59df-0108-461f-b95d-8441f4400460"}} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:32:31.081075 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a8c09e5d-123f-46cc-873e-04dea9e57c44 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 530afc76-5f4b-470c-a4fe-6ecb6f5dbb97] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:31.089372 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a8c09e5d-123f-46cc-873e-04dea9e57c44 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:31.090253 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a8c09e5d-123f-46cc-873e-04dea9e57c44 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:31.092190 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a8c09e5d-123f-46cc-873e-04dea9e57c44 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:31.093276 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a8c09e5d-123f-46cc-873e-04dea9e57c44 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:31.210829 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e6611dd5-d62d-4465-b13c-d811f5bc89b6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:31.224928 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e6611dd5-d62d-4465-b13c-d811f5bc89b6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1520 microversion: 2.1 time: 0.343892 Mar 03 02:32:31.228687 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 133/251] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:30 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1520 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:31.245486 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1425e747-9457-43df-8343-fd017661a15d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:31.247536 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1425e747-9457-43df-8343-fd017661a15d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:31.259060 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1425e747-9457-43df-8343-fd017661a15d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:31.259510 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1425e747-9457-43df-8343-fd017661a15d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:31.260330 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1425e747-9457-43df-8343-fd017661a15d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:31.260765 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1425e747-9457-43df-8343-fd017661a15d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:31.533028 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a8c09e5d-123f-46cc-873e-04dea9e57c44 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "POST /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.458166 Mar 03 02:32:31.533583 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1425e747-9457-43df-8343-fd017661a15d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:31.534795 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 119/252] 10.222.0.30 () {60 vars in 1322 bytes} [Thu Mar 3 02:32:31 2022] POST /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97/os-volume_attachments => generated 194 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:32:31.561701 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1425e747-9457-43df-8343-fd017661a15d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1266 microversion: 2.1 time: 0.331717 Mar 03 02:32:31.569410 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 134/253] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:31 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1266 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:32.260556 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f2fc3291-46a8-4da5-a57f-753c3255d0b8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:32.265103 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f2fc3291-46a8-4da5-a57f-753c3255d0b8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:32.280104 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f2fc3291-46a8-4da5-a57f-753c3255d0b8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:32.280672 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f2fc3291-46a8-4da5-a57f-753c3255d0b8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:32.286481 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f2fc3291-46a8-4da5-a57f-753c3255d0b8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:32.287893 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f2fc3291-46a8-4da5-a57f-753c3255d0b8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:32.486749 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f2fc3291-46a8-4da5-a57f-753c3255d0b8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:32.497871 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f2fc3291-46a8-4da5-a57f-753c3255d0b8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1520 microversion: 2.1 time: 0.255664 Mar 03 02:32:32.498492 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 120/254] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:32 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1520 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:32.581529 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-dd13bcba-e5f9-472f-806e-ad208247f060 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:32.582331 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-dd13bcba-e5f9-472f-806e-ad208247f060 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:32.588315 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dd13bcba-e5f9-472f-806e-ad208247f060 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:32.588778 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dd13bcba-e5f9-472f-806e-ad208247f060 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:32.592286 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dd13bcba-e5f9-472f-806e-ad208247f060 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:32.592737 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dd13bcba-e5f9-472f-806e-ad208247f060 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:32.775139 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-dd13bcba-e5f9-472f-806e-ad208247f060 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:32.783856 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-dd13bcba-e5f9-472f-806e-ad208247f060 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1266 microversion: 2.1 time: 0.208411 Mar 03 02:32:32.798864 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 135/255] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:32 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:33.519767 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-129566f5-4c32-4042-a468-1ba259a7c999 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:33.521378 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-129566f5-4c32-4042-a468-1ba259a7c999 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:33.530518 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-129566f5-4c32-4042-a468-1ba259a7c999 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:33.531393 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-129566f5-4c32-4042-a468-1ba259a7c999 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:33.532501 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-129566f5-4c32-4042-a468-1ba259a7c999 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:33.533420 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-129566f5-4c32-4042-a468-1ba259a7c999 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:33.722294 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-129566f5-4c32-4042-a468-1ba259a7c999 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:33.729976 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-129566f5-4c32-4042-a468-1ba259a7c999 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1520 microversion: 2.1 time: 0.215926 Mar 03 02:32:33.732430 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 121/256] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:33 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:33.805084 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-bf8040d2-4d1a-448c-a1d4-5d0ca0dd7dbc tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:33.806375 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-bf8040d2-4d1a-448c-a1d4-5d0ca0dd7dbc tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:33.817047 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bf8040d2-4d1a-448c-a1d4-5d0ca0dd7dbc tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:33.820147 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bf8040d2-4d1a-448c-a1d4-5d0ca0dd7dbc tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:33.821192 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bf8040d2-4d1a-448c-a1d4-5d0ca0dd7dbc tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:33.821573 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bf8040d2-4d1a-448c-a1d4-5d0ca0dd7dbc tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:33.990886 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-bf8040d2-4d1a-448c-a1d4-5d0ca0dd7dbc tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:34.000360 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-bf8040d2-4d1a-448c-a1d4-5d0ca0dd7dbc tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1266 microversion: 2.1 time: 0.199503 Mar 03 02:32:34.004112 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-33e2a9db-b145-4b37-b8cb-a7e799cdf4d6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Action: 'create', calling method: .version_select at 0x7fb3c82a0820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2084008363"}} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:32:34.010169 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 136/257] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:33 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:34.023589 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.quota [None req-33e2a9db-b145-4b37-b8cb-a7e799cdf4d6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Getting quotas for project 5ed6875428804fbaa1f9fb16ed63a4a5. Resources: {'key_pairs'} {{(pid=116858) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 03 02:32:34.028059 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.quota [None req-33e2a9db-b145-4b37-b8cb-a7e799cdf4d6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Getting quotas for user 69fd047c3a1545a1a4b71d198eb20d2c and project 5ed6875428804fbaa1f9fb16ed63a4a5. Resources: {'key_pairs'} {{(pid=116858) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 03 02:32:34.227757 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.quota [None req-33e2a9db-b145-4b37-b8cb-a7e799cdf4d6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Getting quotas for project 5ed6875428804fbaa1f9fb16ed63a4a5. Resources: {'key_pairs'} {{(pid=116858) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 03 02:32:34.231410 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.quota [None req-33e2a9db-b145-4b37-b8cb-a7e799cdf4d6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Getting quotas for user 69fd047c3a1545a1a4b71d198eb20d2c and project 5ed6875428804fbaa1f9fb16ed63a4a5. Resources: {'key_pairs'} {{(pid=116858) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 03 02:32:34.244602 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-33e2a9db-b145-4b37-b8cb-a7e799cdf4d6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.244652 Mar 03 02:32:34.245219 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 122/258] 10.222.0.30 () {60 vars in 1157 bytes} [Thu Mar 3 02:32:33 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:32:34.340351 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-35bc8b51-129a-40f8-873f-1351e3aeec1c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1547578344", "imageRef": "f50bfb55-df27-42ee-954c-6e08785a688b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2084008363", "networks": [{"uuid": "4c4ce444-59e3-425e-a02d-2184b359f67b"}]}} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:32:34.391077 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.network.neutron [None req-35bc8b51-129a-40f8-873f-1351e3aeec1c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] validate_networks() for [('4c4ce444-59e3-425e-a02d-2184b359f67b', None, None, None, None, None)] {{(pid=116859) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 03 02:32:34.749305 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8753d86e-6cee-4131-8639-6f28db3eb0e8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:34.749924 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8753d86e-6cee-4131-8639-6f28db3eb0e8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:34.756428 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8753d86e-6cee-4131-8639-6f28db3eb0e8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:34.757102 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8753d86e-6cee-4131-8639-6f28db3eb0e8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:34.757899 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8753d86e-6cee-4131-8639-6f28db3eb0e8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:34.758343 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8753d86e-6cee-4131-8639-6f28db3eb0e8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:34.817300 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-35bc8b51-129a-40f8-873f-1351e3aeec1c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Flavor limits 0:0:0 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 03 02:32:34.817768 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-35bc8b51-129a-40f8-873f-1351e3aeec1c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Image limits 0:0:0 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 03 02:32:34.818166 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-35bc8b51-129a-40f8-873f-1351e3aeec1c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Flavor pref 0:0:0 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 03 02:32:34.818755 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-35bc8b51-129a-40f8-873f-1351e3aeec1c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Image pref 0:0:0 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 03 02:32:34.819163 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-35bc8b51-129a-40f8-873f-1351e3aeec1c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 03 02:32:34.840280 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-35bc8b51-129a-40f8-873f-1351e3aeec1c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:34.840924 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-35bc8b51-129a-40f8-873f-1351e3aeec1c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:34.841911 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-35bc8b51-129a-40f8-873f-1351e3aeec1c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:34.842503 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-35bc8b51-129a-40f8-873f-1351e3aeec1c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:34.862252 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.quota [None req-35bc8b51-129a-40f8-873f-1351e3aeec1c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Getting quotas for project 5ed6875428804fbaa1f9fb16ed63a4a5. Resources: {'instances', 'ram', 'cores'} {{(pid=116859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 03 02:32:34.867307 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.quota [None req-35bc8b51-129a-40f8-873f-1351e3aeec1c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Getting quotas for user 69fd047c3a1545a1a4b71d198eb20d2c and project 5ed6875428804fbaa1f9fb16ed63a4a5. Resources: {'instances', 'ram', 'cores'} {{(pid=116859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 03 02:32:34.880651 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-35bc8b51-129a-40f8-873f-1351e3aeec1c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Going to run 1 instances... {{(pid=116859) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 03 02:32:34.883781 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-35bc8b51-129a-40f8-873f-1351e3aeec1c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f50bfb55-df27-42ee-954c-6e08785a688b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 03 02:32:34.951622 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-35bc8b51-129a-40f8-873f-1351e3aeec1c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.615232 Mar 03 02:32:34.952696 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 137/259] 10.222.0.30 () {60 vars in 1146 bytes} [Thu Mar 3 02:32:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 03 02:32:34.962979 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-cfc30fe6-82fc-44a8-b6c9-7d33e89e8988 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:34.963723 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-cfc30fe6-82fc-44a8-b6c9-7d33e89e8988 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:35.058040 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8753d86e-6cee-4131-8639-6f28db3eb0e8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:35.059636 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-cfc30fe6-82fc-44a8-b6c9-7d33e89e8988 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:35.067377 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-cfc30fe6-82fc-44a8-b6c9-7d33e89e8988 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1259 microversion: 2.1 time: 0.108714 Mar 03 02:32:35.068245 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 138/260] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:34 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1259 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:32:35.073575 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-28beda75-8e7d-46d3-b5cf-9018c0afbf3d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:35.074630 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-28beda75-8e7d-46d3-b5cf-9018c0afbf3d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:35.077958 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8753d86e-6cee-4131-8639-6f28db3eb0e8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1520 microversion: 2.1 time: 0.333828 Mar 03 02:32:35.078568 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 123/261] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:34 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1520 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:32:35.088243 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-28beda75-8e7d-46d3-b5cf-9018c0afbf3d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:35.088712 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-28beda75-8e7d-46d3-b5cf-9018c0afbf3d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:35.090788 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-28beda75-8e7d-46d3-b5cf-9018c0afbf3d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:35.091008 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-28beda75-8e7d-46d3-b5cf-9018c0afbf3d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:35.281409 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-28beda75-8e7d-46d3-b5cf-9018c0afbf3d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:35.289637 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-28beda75-8e7d-46d3-b5cf-9018c0afbf3d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1266 microversion: 2.1 time: 0.219849 Mar 03 02:32:35.290617 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 139/262] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:35 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:36.083900 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-dddf2491-6bca-4342-92d9-250d0d8f68ad tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:36.084506 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-dddf2491-6bca-4342-92d9-250d0d8f68ad tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:36.090985 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dddf2491-6bca-4342-92d9-250d0d8f68ad tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:36.091438 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dddf2491-6bca-4342-92d9-250d0d8f68ad tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:36.092246 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dddf2491-6bca-4342-92d9-250d0d8f68ad tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:36.092685 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dddf2491-6bca-4342-92d9-250d0d8f68ad tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:36.094906 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7c4ab32f-273f-4165-95f1-2f8897be18c2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:36.095585 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7c4ab32f-273f-4165-95f1-2f8897be18c2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:36.101681 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7c4ab32f-273f-4165-95f1-2f8897be18c2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:36.102136 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7c4ab32f-273f-4165-95f1-2f8897be18c2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:36.102925 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7c4ab32f-273f-4165-95f1-2f8897be18c2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:36.103367 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7c4ab32f-273f-4165-95f1-2f8897be18c2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:36.168053 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-dddf2491-6bca-4342-92d9-250d0d8f68ad tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:36.176248 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-dddf2491-6bca-4342-92d9-250d0d8f68ad tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1311 microversion: 2.1 time: 0.096024 Mar 03 02:32:36.177166 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 124/263] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:36 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1311 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:36.256843 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-7c4ab32f-273f-4165-95f1-2f8897be18c2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:36.264943 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7c4ab32f-273f-4165-95f1-2f8897be18c2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1520 microversion: 2.1 time: 0.174579 Mar 03 02:32:36.265527 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 140/264] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:36 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:32:36.307619 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e69c3e2f-a9c1-47f8-b84b-f736ea7f208e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:36.308349 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e69c3e2f-a9c1-47f8-b84b-f736ea7f208e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:36.319521 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e69c3e2f-a9c1-47f8-b84b-f736ea7f208e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:36.320218 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e69c3e2f-a9c1-47f8-b84b-f736ea7f208e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:36.322044 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e69c3e2f-a9c1-47f8-b84b-f736ea7f208e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:36.322717 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e69c3e2f-a9c1-47f8-b84b-f736ea7f208e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:36.837560 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e69c3e2f-a9c1-47f8-b84b-f736ea7f208e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:36.864491 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e69c3e2f-a9c1-47f8-b84b-f736ea7f208e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1266 microversion: 2.1 time: 0.560233 Mar 03 02:32:36.872545 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 125/265] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:36 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1266 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:37.194797 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-efa9ffe6-71ef-4377-aebd-4233011a342b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:37.195422 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-efa9ffe6-71ef-4377-aebd-4233011a342b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:37.213156 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-efa9ffe6-71ef-4377-aebd-4233011a342b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:37.215476 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-efa9ffe6-71ef-4377-aebd-4233011a342b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:37.219058 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-efa9ffe6-71ef-4377-aebd-4233011a342b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:37.220480 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-efa9ffe6-71ef-4377-aebd-4233011a342b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:37.284666 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e96252db-0f55-4ddc-a651-56fcfc8c6f70 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:37.285483 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e96252db-0f55-4ddc-a651-56fcfc8c6f70 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:37.302554 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e96252db-0f55-4ddc-a651-56fcfc8c6f70 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:37.304253 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e96252db-0f55-4ddc-a651-56fcfc8c6f70 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:37.312558 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e96252db-0f55-4ddc-a651-56fcfc8c6f70 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:37.315990 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e96252db-0f55-4ddc-a651-56fcfc8c6f70 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:37.470346 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-efa9ffe6-71ef-4377-aebd-4233011a342b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:37.479178 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-efa9ffe6-71ef-4377-aebd-4233011a342b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1317 microversion: 2.1 time: 0.288671 Mar 03 02:32:37.482154 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 141/266] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:37 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1317 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:37.883530 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e96252db-0f55-4ddc-a651-56fcfc8c6f70 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:37.896351 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2ca4f457-464a-46bd-a822-a93b6e71d4eb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:37.897419 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2ca4f457-464a-46bd-a822-a93b6e71d4eb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:37.898084 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e96252db-0f55-4ddc-a651-56fcfc8c6f70 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1520 microversion: 2.1 time: 0.618293 Mar 03 02:32:37.898667 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 126/267] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:37 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1520 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:37.928061 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2ca4f457-464a-46bd-a822-a93b6e71d4eb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:37.930355 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2ca4f457-464a-46bd-a822-a93b6e71d4eb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:37.933826 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2ca4f457-464a-46bd-a822-a93b6e71d4eb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:37.934383 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2ca4f457-464a-46bd-a822-a93b6e71d4eb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:38.251056 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2ca4f457-464a-46bd-a822-a93b6e71d4eb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:38.263533 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2ca4f457-464a-46bd-a822-a93b6e71d4eb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1266 microversion: 2.1 time: 0.375220 Mar 03 02:32:38.265096 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 142/268] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:37 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1266 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:32:38.500754 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2b1b0176-e359-4083-a077-5913c0e4c6f5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:38.502369 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2b1b0176-e359-4083-a077-5913c0e4c6f5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:38.514778 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2b1b0176-e359-4083-a077-5913c0e4c6f5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:38.515583 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2b1b0176-e359-4083-a077-5913c0e4c6f5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:38.516811 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2b1b0176-e359-4083-a077-5913c0e4c6f5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:38.518538 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2b1b0176-e359-4083-a077-5913c0e4c6f5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:38.821515 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2b1b0176-e359-4083-a077-5913c0e4c6f5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:38.831293 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2b1b0176-e359-4083-a077-5913c0e4c6f5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1359 microversion: 2.1 time: 0.336589 Mar 03 02:32:38.840474 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 127/269] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:38 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1359 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:38.916621 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-78675bde-d032-4d79-b02a-c6b9e9fbac32 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:38.917424 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-78675bde-d032-4d79-b02a-c6b9e9fbac32 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:38.927594 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-78675bde-d032-4d79-b02a-c6b9e9fbac32 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:38.928131 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-78675bde-d032-4d79-b02a-c6b9e9fbac32 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:38.929086 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-78675bde-d032-4d79-b02a-c6b9e9fbac32 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:38.929533 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-78675bde-d032-4d79-b02a-c6b9e9fbac32 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:39.122728 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-78675bde-d032-4d79-b02a-c6b9e9fbac32 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:39.130722 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-78675bde-d032-4d79-b02a-c6b9e9fbac32 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1520 microversion: 2.1 time: 0.217948 Mar 03 02:32:39.132233 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 143/270] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:38 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:39.281569 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-de02deaa-0bcf-499d-8248-7b04a48120cd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:39.282312 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-de02deaa-0bcf-499d-8248-7b04a48120cd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:39.288493 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-de02deaa-0bcf-499d-8248-7b04a48120cd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:39.288947 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-de02deaa-0bcf-499d-8248-7b04a48120cd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:39.289750 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-de02deaa-0bcf-499d-8248-7b04a48120cd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:39.290193 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-de02deaa-0bcf-499d-8248-7b04a48120cd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:39.495993 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-de02deaa-0bcf-499d-8248-7b04a48120cd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:39.503572 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-de02deaa-0bcf-499d-8248-7b04a48120cd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1266 microversion: 2.1 time: 0.226528 Mar 03 02:32:39.504497 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 128/271] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:39 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:39.850423 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2c121e58-ca40-4877-adfb-5bb34c9b2160 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:39.851070 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2c121e58-ca40-4877-adfb-5bb34c9b2160 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:39.868545 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2c121e58-ca40-4877-adfb-5bb34c9b2160 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:39.871446 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2c121e58-ca40-4877-adfb-5bb34c9b2160 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:39.874894 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2c121e58-ca40-4877-adfb-5bb34c9b2160 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:39.877198 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2c121e58-ca40-4877-adfb-5bb34c9b2160 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:40.076205 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2c121e58-ca40-4877-adfb-5bb34c9b2160 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:40.085305 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2c121e58-ca40-4877-adfb-5bb34c9b2160 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1359 microversion: 2.1 time: 0.238682 Mar 03 02:32:40.096228 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 144/272] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:39 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1359 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:40.149974 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8268047d-053d-47ce-b18b-9b84d91a016f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:40.150667 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8268047d-053d-47ce-b18b-9b84d91a016f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:40.183185 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8268047d-053d-47ce-b18b-9b84d91a016f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:40.183185 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8268047d-053d-47ce-b18b-9b84d91a016f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:40.183185 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8268047d-053d-47ce-b18b-9b84d91a016f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:40.183185 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8268047d-053d-47ce-b18b-9b84d91a016f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:40.371771 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8268047d-053d-47ce-b18b-9b84d91a016f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:40.379247 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8268047d-053d-47ce-b18b-9b84d91a016f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1520 microversion: 2.1 time: 0.233734 Mar 03 02:32:40.379856 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 129/273] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:40 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1520 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:40.525840 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-84c0f647-5cdc-49ed-80a8-773b13801beb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:40.526805 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-84c0f647-5cdc-49ed-80a8-773b13801beb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:40.537346 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-84c0f647-5cdc-49ed-80a8-773b13801beb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:40.540120 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-84c0f647-5cdc-49ed-80a8-773b13801beb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:40.542622 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-84c0f647-5cdc-49ed-80a8-773b13801beb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:40.544595 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-84c0f647-5cdc-49ed-80a8-773b13801beb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:40.727345 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-84c0f647-5cdc-49ed-80a8-773b13801beb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:40.738905 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-84c0f647-5cdc-49ed-80a8-773b13801beb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1266 microversion: 2.1 time: 0.221711 Mar 03 02:32:40.739490 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 145/274] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:40 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:41.104107 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b19fc11f-1d7c-4786-9790-5a9dbedcf66b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:41.106558 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b19fc11f-1d7c-4786-9790-5a9dbedcf66b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:41.113304 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b19fc11f-1d7c-4786-9790-5a9dbedcf66b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:41.113929 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b19fc11f-1d7c-4786-9790-5a9dbedcf66b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:41.114925 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b19fc11f-1d7c-4786-9790-5a9dbedcf66b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:41.115813 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b19fc11f-1d7c-4786-9790-5a9dbedcf66b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:41.238686 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [req-287d5aa5-7221-4e5a-8214-df48cd60c8eb req-7705c5ed-9c33-4bb2-bf72-b43a1f3dba0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4ca9b17-c039-4bdc-9a51-c1351edaf4d3", "name": "network-vif-plugged", "status": "completed", "tag": "3a27027e-071e-47ba-b741-f3a6273ab83f"}]} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:32:41.262228 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-287d5aa5-7221-4e5a-8214-df48cd60c8eb req-7705c5ed-9c33-4bb2-bf72-b43a1f3dba0e service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:41.265403 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-287d5aa5-7221-4e5a-8214-df48cd60c8eb req-7705c5ed-9c33-4bb2-bf72-b43a1f3dba0e service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:41.283300 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.compute.server_external_events [req-287d5aa5-7221-4e5a-8214-df48cd60c8eb req-7705c5ed-9c33-4bb2-bf72-b43a1f3dba0e service nova] Creating event network-vif-plugged:3a27027e-071e-47ba-b741-f3a6273ab83f for instance b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 on hv-cinder-81977 Mar 03 02:32:41.290143 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [req-287d5aa5-7221-4e5a-8214-df48cd60c8eb req-7705c5ed-9c33-4bb2-bf72-b43a1f3dba0e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061691 Mar 03 02:32:41.295163 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 146/275] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:32:41.405256 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ffa9eae0-d79c-41e0-9100-338cdeb9a1dc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:41.406477 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ffa9eae0-d79c-41e0-9100-338cdeb9a1dc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:41.412348 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b19fc11f-1d7c-4786-9790-5a9dbedcf66b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:41.418225 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ffa9eae0-d79c-41e0-9100-338cdeb9a1dc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:41.420116 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ffa9eae0-d79c-41e0-9100-338cdeb9a1dc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:41.421537 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ffa9eae0-d79c-41e0-9100-338cdeb9a1dc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:41.422899 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ffa9eae0-d79c-41e0-9100-338cdeb9a1dc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:41.426402 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b19fc11f-1d7c-4786-9790-5a9dbedcf66b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1359 microversion: 2.1 time: 0.324976 Mar 03 02:32:41.427181 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 130/276] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:41 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1359 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:41.631691 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ffa9eae0-d79c-41e0-9100-338cdeb9a1dc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:41.640711 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ffa9eae0-d79c-41e0-9100-338cdeb9a1dc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1520 microversion: 2.1 time: 0.245409 Mar 03 02:32:41.641510 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 147/277] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:41 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:41.782372 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3a09a00f-d66b-44d4-84d1-5784f8d7522d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:41.785239 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3a09a00f-d66b-44d4-84d1-5784f8d7522d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:41.831065 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3a09a00f-d66b-44d4-84d1-5784f8d7522d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:41.833167 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3a09a00f-d66b-44d4-84d1-5784f8d7522d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:41.838840 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3a09a00f-d66b-44d4-84d1-5784f8d7522d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:41.842762 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3a09a00f-d66b-44d4-84d1-5784f8d7522d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:42.121808 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-3a09a00f-d66b-44d4-84d1-5784f8d7522d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:42.130288 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3a09a00f-d66b-44d4-84d1-5784f8d7522d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1266 microversion: 2.1 time: 0.375858 Mar 03 02:32:42.131219 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 131/278] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:41 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1266 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:42.356938 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2b6e7201-c0f6-4306-9fc0-1fe6045e8b9b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:32:42.358188 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2b6e7201-c0f6-4306-9fc0-1fe6045e8b9b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:42.367523 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2b6e7201-c0f6-4306-9fc0-1fe6045e8b9b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:42.368088 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2b6e7201-c0f6-4306-9fc0-1fe6045e8b9b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:42.369122 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2b6e7201-c0f6-4306-9fc0-1fe6045e8b9b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:42.369753 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2b6e7201-c0f6-4306-9fc0-1fe6045e8b9b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:42.409900 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.objects.instance [None req-2b6e7201-c0f6-4306-9fc0-1fe6045e8b9b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lazy-loading 'flavor' on Instance uuid f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 {{(pid=116859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 03 02:32:42.450238 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1871375d-d343-4ea3-8812-c589e5af5327 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:42.451185 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1871375d-d343-4ea3-8812-c589e5af5327 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:42.475178 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1871375d-d343-4ea3-8812-c589e5af5327 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:42.476116 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1871375d-d343-4ea3-8812-c589e5af5327 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:42.479411 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1871375d-d343-4ea3-8812-c589e5af5327 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:42.480097 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1871375d-d343-4ea3-8812-c589e5af5327 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:42.681570 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1871375d-d343-4ea3-8812-c589e5af5327 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:42.692804 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1871375d-d343-4ea3-8812-c589e5af5327 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1359 microversion: 2.1 time: 0.247394 Mar 03 02:32:42.703455 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 132/279] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:42 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1359 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:42.709591 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c2fcd8ca-4e17-4c07-b762-57ae061f0117 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:42.710513 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c2fcd8ca-4e17-4c07-b762-57ae061f0117 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:42.717854 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c2fcd8ca-4e17-4c07-b762-57ae061f0117 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:42.718651 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c2fcd8ca-4e17-4c07-b762-57ae061f0117 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:42.719694 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c2fcd8ca-4e17-4c07-b762-57ae061f0117 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:42.720275 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c2fcd8ca-4e17-4c07-b762-57ae061f0117 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:42.932037 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c2fcd8ca-4e17-4c07-b762-57ae061f0117 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:42.941173 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c2fcd8ca-4e17-4c07-b762-57ae061f0117 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1520 microversion: 2.1 time: 0.236075 Mar 03 02:32:42.941830 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 133/280] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:42 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:43.150161 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e243db8d-ab97-4459-a677-48427e13ebd2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:43.150990 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e243db8d-ab97-4459-a677-48427e13ebd2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:43.160825 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e243db8d-ab97-4459-a677-48427e13ebd2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:43.161371 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e243db8d-ab97-4459-a677-48427e13ebd2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:43.162256 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e243db8d-ab97-4459-a677-48427e13ebd2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:43.162763 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e243db8d-ab97-4459-a677-48427e13ebd2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:43.363864 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e243db8d-ab97-4459-a677-48427e13ebd2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:43.372337 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e243db8d-ab97-4459-a677-48427e13ebd2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1266 microversion: 2.1 time: 0.227230 Mar 03 02:32:43.373465 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 134/281] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:43 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:32:43.710043 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-252f57db-daf2-4e03-a051-aace801149ae tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:43.710658 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-252f57db-daf2-4e03-a051-aace801149ae tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:43.718642 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-252f57db-daf2-4e03-a051-aace801149ae tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:43.719097 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-252f57db-daf2-4e03-a051-aace801149ae tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:43.720108 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-252f57db-daf2-4e03-a051-aace801149ae tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:43.720704 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-252f57db-daf2-4e03-a051-aace801149ae tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:43.913535 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-252f57db-daf2-4e03-a051-aace801149ae tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:43.934168 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-252f57db-daf2-4e03-a051-aace801149ae tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1359 microversion: 2.1 time: 0.227242 Mar 03 02:32:43.936274 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 135/282] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:43 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1359 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:43.959268 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-32904a35-e4e3-4691-9d33-e9aae76db857 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:43.960014 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-32904a35-e4e3-4691-9d33-e9aae76db857 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:43.965856 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-32904a35-e4e3-4691-9d33-e9aae76db857 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:43.966416 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-32904a35-e4e3-4691-9d33-e9aae76db857 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:43.967410 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-32904a35-e4e3-4691-9d33-e9aae76db857 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:43.971297 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-32904a35-e4e3-4691-9d33-e9aae76db857 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:44.148504 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-32904a35-e4e3-4691-9d33-e9aae76db857 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:44.158574 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-32904a35-e4e3-4691-9d33-e9aae76db857 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1520 microversion: 2.1 time: 0.203080 Mar 03 02:32:44.162751 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 136/283] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:43 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:32:44.390136 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-71623ea9-95e6-4bdb-807d-361557c6eb99 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:44.390970 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-71623ea9-95e6-4bdb-807d-361557c6eb99 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:44.398476 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-71623ea9-95e6-4bdb-807d-361557c6eb99 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:44.399152 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-71623ea9-95e6-4bdb-807d-361557c6eb99 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:44.400159 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-71623ea9-95e6-4bdb-807d-361557c6eb99 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:44.400765 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-71623ea9-95e6-4bdb-807d-361557c6eb99 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:44.592881 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-71623ea9-95e6-4bdb-807d-361557c6eb99 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:44.600684 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-71623ea9-95e6-4bdb-807d-361557c6eb99 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1266 microversion: 2.1 time: 0.215083 Mar 03 02:32:44.601272 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 137/284] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:44 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:32:44.955512 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f0186047-c5af-41a0-90a1-dda6eebf4c76 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:44.956158 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f0186047-c5af-41a0-90a1-dda6eebf4c76 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:44.962421 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f0186047-c5af-41a0-90a1-dda6eebf4c76 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:44.963121 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f0186047-c5af-41a0-90a1-dda6eebf4c76 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:44.963967 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f0186047-c5af-41a0-90a1-dda6eebf4c76 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:44.964408 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f0186047-c5af-41a0-90a1-dda6eebf4c76 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:45.165397 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f0186047-c5af-41a0-90a1-dda6eebf4c76 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:45.174476 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f0186047-c5af-41a0-90a1-dda6eebf4c76 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1359 microversion: 2.1 time: 0.221756 Mar 03 02:32:45.174476 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 138/285] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:44 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1359 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:32:45.179482 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-935f83f7-00c6-4268-88a4-e8932189136c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:45.180380 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-935f83f7-00c6-4268-88a4-e8932189136c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:45.187160 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-935f83f7-00c6-4268-88a4-e8932189136c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:45.187693 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-935f83f7-00c6-4268-88a4-e8932189136c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:45.188592 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-935f83f7-00c6-4268-88a4-e8932189136c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:45.189099 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-935f83f7-00c6-4268-88a4-e8932189136c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:45.385315 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-935f83f7-00c6-4268-88a4-e8932189136c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:45.399968 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-935f83f7-00c6-4268-88a4-e8932189136c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1520 microversion: 2.1 time: 0.223426 Mar 03 02:32:45.411507 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 139/286] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:45 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:32:45.618114 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-04915efe-d74e-43ba-b4ce-40f9de23ecbb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:45.618728 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-04915efe-d74e-43ba-b4ce-40f9de23ecbb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:45.624874 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-04915efe-d74e-43ba-b4ce-40f9de23ecbb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:45.625335 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-04915efe-d74e-43ba-b4ce-40f9de23ecbb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:45.626121 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-04915efe-d74e-43ba-b4ce-40f9de23ecbb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:45.626563 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-04915efe-d74e-43ba-b4ce-40f9de23ecbb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:45.809305 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-04915efe-d74e-43ba-b4ce-40f9de23ecbb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:45.817187 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-04915efe-d74e-43ba-b4ce-40f9de23ecbb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1266 microversion: 2.1 time: 0.202944 Mar 03 02:32:45.818412 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 140/287] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:45 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:46.191466 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-cee48847-3406-4da7-95b0-f690e19e339f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:46.192542 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-cee48847-3406-4da7-95b0-f690e19e339f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:46.198713 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cee48847-3406-4da7-95b0-f690e19e339f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:46.199652 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cee48847-3406-4da7-95b0-f690e19e339f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:46.200637 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cee48847-3406-4da7-95b0-f690e19e339f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:46.201065 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cee48847-3406-4da7-95b0-f690e19e339f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:46.513938 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-cee48847-3406-4da7-95b0-f690e19e339f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:46.521207 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-cee48847-3406-4da7-95b0-f690e19e339f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1359 microversion: 2.1 time: 0.334127 Mar 03 02:32:46.521848 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 141/288] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:46 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1359 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:46.530554 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0211dd96-a491-448b-8aa1-66c6278b1d39 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:46.531279 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0211dd96-a491-448b-8aa1-66c6278b1d39 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:46.537555 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0211dd96-a491-448b-8aa1-66c6278b1d39 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:46.538008 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0211dd96-a491-448b-8aa1-66c6278b1d39 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:46.538807 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0211dd96-a491-448b-8aa1-66c6278b1d39 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:46.539242 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0211dd96-a491-448b-8aa1-66c6278b1d39 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:46.819499 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0211dd96-a491-448b-8aa1-66c6278b1d39 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:46.840741 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0211dd96-a491-448b-8aa1-66c6278b1d39 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1520 microversion: 2.1 time: 0.314327 Mar 03 02:32:46.844872 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 142/289] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:46 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1520 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:46.853331 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a08a9a97-5fa2-411a-9b64-83ac7abf19bb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:46.859954 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a08a9a97-5fa2-411a-9b64-83ac7abf19bb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:46.879410 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a08a9a97-5fa2-411a-9b64-83ac7abf19bb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:46.880466 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a08a9a97-5fa2-411a-9b64-83ac7abf19bb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:46.883194 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a08a9a97-5fa2-411a-9b64-83ac7abf19bb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:46.887794 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a08a9a97-5fa2-411a-9b64-83ac7abf19bb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:47.185477 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a08a9a97-5fa2-411a-9b64-83ac7abf19bb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:47.200066 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a08a9a97-5fa2-411a-9b64-83ac7abf19bb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1266 microversion: 2.1 time: 0.348583 Mar 03 02:32:47.213049 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 143/290] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:46 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1266 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:47.539155 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a941b595-49df-4b31-b5ee-6db6577865eb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:47.540008 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a941b595-49df-4b31-b5ee-6db6577865eb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:47.548426 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a941b595-49df-4b31-b5ee-6db6577865eb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:47.549242 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a941b595-49df-4b31-b5ee-6db6577865eb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:47.550462 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a941b595-49df-4b31-b5ee-6db6577865eb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:47.550882 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a941b595-49df-4b31-b5ee-6db6577865eb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:47.728495 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a941b595-49df-4b31-b5ee-6db6577865eb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:47.736081 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a941b595-49df-4b31-b5ee-6db6577865eb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1359 microversion: 2.1 time: 0.201305 Mar 03 02:32:47.737646 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 144/291] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:47 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1359 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:32:47.861227 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3165646c-1a7b-4182-9f78-cc1f14556858 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:47.862824 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3165646c-1a7b-4182-9f78-cc1f14556858 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:47.869844 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3165646c-1a7b-4182-9f78-cc1f14556858 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:47.871239 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3165646c-1a7b-4182-9f78-cc1f14556858 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:47.872527 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3165646c-1a7b-4182-9f78-cc1f14556858 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:47.872963 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3165646c-1a7b-4182-9f78-cc1f14556858 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:48.021654 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-3165646c-1a7b-4182-9f78-cc1f14556858 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:48.031013 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3165646c-1a7b-4182-9f78-cc1f14556858 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1520 microversion: 2.1 time: 0.173426 Mar 03 02:32:48.031569 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 145/292] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:47 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:32:48.218501 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9a9d0829-d836-45b0-a7f9-21bedce6290c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:48.219314 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9a9d0829-d836-45b0-a7f9-21bedce6290c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:48.225649 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9a9d0829-d836-45b0-a7f9-21bedce6290c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:48.226103 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9a9d0829-d836-45b0-a7f9-21bedce6290c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:48.226892 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9a9d0829-d836-45b0-a7f9-21bedce6290c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:48.227340 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9a9d0829-d836-45b0-a7f9-21bedce6290c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:48.250886 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2b6e7201-c0f6-4306-9fc0-1fe6045e8b9b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "POST /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/action" status: 202 len: 0 microversion: 2.20 time: 5.898296 Mar 03 02:32:48.255324 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 148/293] 10.222.0.30 () {62 vars in 1318 bytes} [Thu Mar 3 02:32:42 2022] POST /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/action => generated 0 bytes in 5904 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 03 02:32:48.261180 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9e74f3e1-3003-4980-8aea-4684a657caa5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:48.263001 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9e74f3e1-3003-4980-8aea-4684a657caa5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:48.270138 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9e74f3e1-3003-4980-8aea-4684a657caa5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:48.270706 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9e74f3e1-3003-4980-8aea-4684a657caa5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:48.271502 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9e74f3e1-3003-4980-8aea-4684a657caa5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:48.274777 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9e74f3e1-3003-4980-8aea-4684a657caa5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:48.369588 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9a9d0829-d836-45b0-a7f9-21bedce6290c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:48.378162 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9a9d0829-d836-45b0-a7f9-21bedce6290c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1266 microversion: 2.1 time: 0.163722 Mar 03 02:32:48.378813 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 146/294] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:48 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:32:48.418181 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9e74f3e1-3003-4980-8aea-4684a657caa5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:48.426527 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9e74f3e1-3003-4980-8aea-4684a657caa5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:48.428159 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9e74f3e1-3003-4980-8aea-4684a657caa5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:48.429398 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9e74f3e1-3003-4980-8aea-4684a657caa5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1725 microversion: 2.20 time: 0.172722 Mar 03 02:32:48.430241 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 149/295] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:32:48 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:32:48.461934 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-021dd1f5-42cd-49c3-bc8f-823f440acef9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11ff84ea-b1e5-4148-ba60-3f66b05ab802"}} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:32:48.463086 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-021dd1f5-42cd-49c3-bc8f-823f440acef9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:48.469054 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-021dd1f5-42cd-49c3-bc8f-823f440acef9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:48.469590 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-021dd1f5-42cd-49c3-bc8f-823f440acef9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:48.470378 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-021dd1f5-42cd-49c3-bc8f-823f440acef9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:48.470978 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-021dd1f5-42cd-49c3-bc8f-823f440acef9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:48.755333 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ddd3fd60-1ebb-40b5-9b58-28a453c5f4d1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:48.756037 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ddd3fd60-1ebb-40b5-9b58-28a453c5f4d1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:48.775770 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ddd3fd60-1ebb-40b5-9b58-28a453c5f4d1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:48.777492 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ddd3fd60-1ebb-40b5-9b58-28a453c5f4d1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:48.777794 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ddd3fd60-1ebb-40b5-9b58-28a453c5f4d1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:48.778334 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ddd3fd60-1ebb-40b5-9b58-28a453c5f4d1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:48.988082 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-021dd1f5-42cd-49c3-bc8f-823f440acef9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "POST /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.529763 Mar 03 02:32:48.989599 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 147/296] 10.222.0.30 () {60 vars in 1322 bytes} [Thu Mar 3 02:32:48 2022] POST /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments => generated 194 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:32:49.006302 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ab63f86a-1224-4059-9bd3-efb4c74a06f9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1812376359", "imageRef": "1fe11a1a-b4d0-46f5-89cd-501ceff49317", "flavorRef": "452", "networks": [{"uuid": "f1291070-b169-4a89-81cc-b9cf7087c831"}]}} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:32:49.031897 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ddd3fd60-1ebb-40b5-9b58-28a453c5f4d1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:49.040893 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ddd3fd60-1ebb-40b5-9b58-28a453c5f4d1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1359 microversion: 2.1 time: 0.289532 Mar 03 02:32:49.042590 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 150/297] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:48 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1359 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:32:49.048616 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-406e17be-f126-4750-952b-a465a59e806a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:49.049793 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-406e17be-f126-4750-952b-a465a59e806a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:49.057683 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-406e17be-f126-4750-952b-a465a59e806a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:49.059587 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-406e17be-f126-4750-952b-a465a59e806a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:49.060743 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-406e17be-f126-4750-952b-a465a59e806a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:49.061348 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-406e17be-f126-4750-952b-a465a59e806a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:49.102170 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.network.neutron [None req-ab63f86a-1224-4059-9bd3-efb4c74a06f9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] validate_networks() for [('f1291070-b169-4a89-81cc-b9cf7087c831', None, None, None, None, None)] {{(pid=116858) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 03 02:32:49.252337 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-406e17be-f126-4750-952b-a465a59e806a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:49.260119 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-406e17be-f126-4750-952b-a465a59e806a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1520 microversion: 2.1 time: 0.215848 Mar 03 02:32:49.260698 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 151/298] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:49 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:49.396542 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-40888c48-c3ad-4761-a507-6bac5fdebfdc tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:49.397147 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-40888c48-c3ad-4761-a507-6bac5fdebfdc tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:49.403397 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-40888c48-c3ad-4761-a507-6bac5fdebfdc tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:49.404177 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-40888c48-c3ad-4761-a507-6bac5fdebfdc tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:49.405169 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-40888c48-c3ad-4761-a507-6bac5fdebfdc tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:49.405603 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-40888c48-c3ad-4761-a507-6bac5fdebfdc tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:49.575979 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-40888c48-c3ad-4761-a507-6bac5fdebfdc tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:49.584744 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-40888c48-c3ad-4761-a507-6bac5fdebfdc tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1266 microversion: 2.1 time: 0.192058 Mar 03 02:32:49.585421 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 152/299] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:49 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:49.591383 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-27b155b6-a150-4e0a-a5e0-9c835ec3dc61 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:49.592353 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-27b155b6-a150-4e0a-a5e0-9c835ec3dc61 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:49.598387 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-27b155b6-a150-4e0a-a5e0-9c835ec3dc61 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:49.598809 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-27b155b6-a150-4e0a-a5e0-9c835ec3dc61 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:49.599747 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-27b155b6-a150-4e0a-a5e0-9c835ec3dc61 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:49.600247 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-27b155b6-a150-4e0a-a5e0-9c835ec3dc61 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:49.764553 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-27b155b6-a150-4e0a-a5e0-9c835ec3dc61 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:49.773761 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-27b155b6-a150-4e0a-a5e0-9c835ec3dc61 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:49.776202 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-27b155b6-a150-4e0a-a5e0-9c835ec3dc61 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:49.777557 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-27b155b6-a150-4e0a-a5e0-9c835ec3dc61 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1725 microversion: 2.20 time: 0.191108 Mar 03 02:32:49.778303 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 153/300] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:32:49 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1725 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:32:49.953342 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-ab63f86a-1224-4059-9bd3-efb4c74a06f9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Flavor limits 0:0:0 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 03 02:32:49.953985 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-ab63f86a-1224-4059-9bd3-efb4c74a06f9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Image limits 0:0:0 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 03 02:32:49.954350 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-ab63f86a-1224-4059-9bd3-efb4c74a06f9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Flavor pref 0:0:0 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 03 02:32:49.954765 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-ab63f86a-1224-4059-9bd3-efb4c74a06f9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Image pref 0:0:0 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 03 02:32:49.955180 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-ab63f86a-1224-4059-9bd3-efb4c74a06f9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 03 02:32:49.963797 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ab63f86a-1224-4059-9bd3-efb4c74a06f9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:49.964262 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ab63f86a-1224-4059-9bd3-efb4c74a06f9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:49.965845 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ab63f86a-1224-4059-9bd3-efb4c74a06f9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:49.966289 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ab63f86a-1224-4059-9bd3-efb4c74a06f9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:49.984031 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.quota [None req-ab63f86a-1224-4059-9bd3-efb4c74a06f9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Getting quotas for project 23d0b9beb23448d1885663a1fda84ed4. Resources: {'instances', 'ram', 'cores'} {{(pid=116858) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 03 02:32:49.988217 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.quota [None req-ab63f86a-1224-4059-9bd3-efb4c74a06f9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Getting quotas for user 12c0d786575641a596781a434502b220 and project 23d0b9beb23448d1885663a1fda84ed4. Resources: {'instances', 'ram', 'cores'} {{(pid=116858) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 03 02:32:50.001326 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ab63f86a-1224-4059-9bd3-efb4c74a06f9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Going to run 1 instances... {{(pid=116858) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 03 02:32:50.006860 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ab63f86a-1224-4059-9bd3-efb4c74a06f9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1fe11a1a-b4d0-46f5-89cd-501ceff49317',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116858) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 03 02:32:50.062669 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5fcf063b-7db8-4b50-b8c5-dcafb232bf9a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:50.062669 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5fcf063b-7db8-4b50-b8c5-dcafb232bf9a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:50.072564 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5fcf063b-7db8-4b50-b8c5-dcafb232bf9a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:50.073266 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5fcf063b-7db8-4b50-b8c5-dcafb232bf9a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:50.074863 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5fcf063b-7db8-4b50-b8c5-dcafb232bf9a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:50.075487 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5fcf063b-7db8-4b50-b8c5-dcafb232bf9a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:50.102904 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ab63f86a-1224-4059-9bd3-efb4c74a06f9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.111438 Mar 03 02:32:50.103570 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 148/301] 10.222.0.30 () {60 vars in 1146 bytes} [Thu Mar 3 02:32:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 03 02:32:50.114128 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6e6ae21f-d96e-4d61-a030-40f1be05ad23 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:50.114735 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6e6ae21f-d96e-4d61-a030-40f1be05ad23 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:50.325190 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6e6ae21f-d96e-4d61-a030-40f1be05ad23 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:50.336809 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6e6ae21f-d96e-4d61-a030-40f1be05ad23 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1219 microversion: 2.1 time: 0.224236 Mar 03 02:32:50.337357 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 149/302] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:50 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1219 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:50.366059 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [req-8c2aaa8e-0f3b-47c6-aa6b-43ebe1344c63 req-841739cd-cdc6-48d2-9522-37c7156d750f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0df5e3af-dfd2-431d-83af-1a2a02019651", "tag": "92ff8971-ee17-4845-81d7-3a348747a57d"}]} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:32:50.387563 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-8c2aaa8e-0f3b-47c6-aa6b-43ebe1344c63 req-841739cd-cdc6-48d2-9522-37c7156d750f service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:50.388388 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-8c2aaa8e-0f3b-47c6-aa6b-43ebe1344c63 req-841739cd-cdc6-48d2-9522-37c7156d750f service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:50.422133 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.compute.server_external_events [req-8c2aaa8e-0f3b-47c6-aa6b-43ebe1344c63 req-841739cd-cdc6-48d2-9522-37c7156d750f service nova] Creating event network-changed:92ff8971-ee17-4845-81d7-3a348747a57d for instance 0df5e3af-dfd2-431d-83af-1a2a02019651 on hv-cinder-81977 Mar 03 02:32:50.429771 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [req-8c2aaa8e-0f3b-47c6-aa6b-43ebe1344c63 req-841739cd-cdc6-48d2-9522-37c7156d750f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077357 Mar 03 02:32:50.430616 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 150/303] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:32:50.438123 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1b4d4983-3cfa-4fa0-86c4-19acb22aa1ff tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:50.439336 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1b4d4983-3cfa-4fa0-86c4-19acb22aa1ff tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:50.450004 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1b4d4983-3cfa-4fa0-86c4-19acb22aa1ff tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:50.450652 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1b4d4983-3cfa-4fa0-86c4-19acb22aa1ff tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:50.451879 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1b4d4983-3cfa-4fa0-86c4-19acb22aa1ff tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:50.452761 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1b4d4983-3cfa-4fa0-86c4-19acb22aa1ff tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:50.489171 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5fcf063b-7db8-4b50-b8c5-dcafb232bf9a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:50.502877 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5fcf063b-7db8-4b50-b8c5-dcafb232bf9a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1359 microversion: 2.1 time: 0.446873 Mar 03 02:32:50.504881 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 154/304] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:50 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1359 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:50.516140 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6921915a-691f-46d2-b0b4-ca8e6af4498b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4bdc59df-0108-461f-b95d-8441f4400460"}} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:32:50.518117 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6921915a-691f-46d2-b0b4-ca8e6af4498b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 530afc76-5f4b-470c-a4fe-6ecb6f5dbb97] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:50.525857 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6921915a-691f-46d2-b0b4-ca8e6af4498b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:50.526486 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6921915a-691f-46d2-b0b4-ca8e6af4498b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:50.528470 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6921915a-691f-46d2-b0b4-ca8e6af4498b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:50.529220 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6921915a-691f-46d2-b0b4-ca8e6af4498b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:50.647091 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.wsgi [None req-6921915a-691f-46d2-b0b4-ca8e6af4498b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] HTTP exception thrown: Invalid volume: volume 4bdc59df-0108-461f-b95d-8441f4400460 is already attached to instances: 530afc76-5f4b-470c-a4fe-6ecb6f5dbb97 Mar 03 02:32:50.647843 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6921915a-691f-46d2-b0b4-ca8e6af4498b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Returning 400 to user: Invalid volume: volume 4bdc59df-0108-461f-b95d-8441f4400460 is already attached to instances: 530afc76-5f4b-470c-a4fe-6ecb6f5dbb97 {{(pid=116859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:32:50.649186 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6921915a-691f-46d2-b0b4-ca8e6af4498b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "POST /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.141833 Mar 03 02:32:50.649897 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 155/305] 10.222.0.30 () {60 vars in 1322 bytes} [Thu Mar 3 02:32:50 2022] POST /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97/os-volume_attachments => generated 174 bytes in 144 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 03 02:32:50.657654 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f33ea484-235e-4e41-ab22-83c8cb84b9ce tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:50.658973 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f33ea484-235e-4e41-ab22-83c8cb84b9ce tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:50.673426 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f33ea484-235e-4e41-ab22-83c8cb84b9ce tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:50.674226 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f33ea484-235e-4e41-ab22-83c8cb84b9ce tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:50.679400 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f33ea484-235e-4e41-ab22-83c8cb84b9ce tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:50.679400 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f33ea484-235e-4e41-ab22-83c8cb84b9ce tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:50.895878 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f33ea484-235e-4e41-ab22-83c8cb84b9ce tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:50.910069 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f33ea484-235e-4e41-ab22-83c8cb84b9ce tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1266 microversion: 2.1 time: 0.258041 Mar 03 02:32:50.910973 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 156/306] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:50 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1266 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:50.915966 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-acaedf07-9286-4574-aeb5-f49a056dc1c2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:50.916658 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-acaedf07-9286-4574-aeb5-f49a056dc1c2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 530afc76-5f4b-470c-a4fe-6ecb6f5dbb97] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:50.925410 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-acaedf07-9286-4574-aeb5-f49a056dc1c2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:50.926033 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-acaedf07-9286-4574-aeb5-f49a056dc1c2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:50.926769 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-acaedf07-9286-4574-aeb5-f49a056dc1c2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:50.927272 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-acaedf07-9286-4574-aeb5-f49a056dc1c2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:51.026417 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1b4d4983-3cfa-4fa0-86c4-19acb22aa1ff tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:51.035527 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1b4d4983-3cfa-4fa0-86c4-19acb22aa1ff tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1520 microversion: 2.1 time: 0.602987 Mar 03 02:32:51.039373 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 151/307] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:50 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1520 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:51.053368 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.objects.instance [None req-acaedf07-9286-4574-aeb5-f49a056dc1c2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lazy-loading 'services' on Instance uuid 530afc76-5f4b-470c-a4fe-6ecb6f5dbb97 {{(pid=116859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 03 02:32:51.064333 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-72fd5925-8362-4db6-983c-329620e6f032 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:51.069912 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-72fd5925-8362-4db6-983c-329620e6f032 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:51.087932 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-72fd5925-8362-4db6-983c-329620e6f032 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:51.088773 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-72fd5925-8362-4db6-983c-329620e6f032 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:51.091139 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-72fd5925-8362-4db6-983c-329620e6f032 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:51.091809 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-72fd5925-8362-4db6-983c-329620e6f032 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:51.164219 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-acaedf07-9286-4574-aeb5-f49a056dc1c2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "DELETE /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97/os-volume_attachments/4bdc59df-0108-461f-b95d-8441f4400460" status: 202 len: 0 microversion: 2.1 time: 0.251802 Mar 03 02:32:51.165118 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 157/308] 10.222.0.30 () {58 vars in 1415 bytes} [Thu Mar 3 02:32:50 2022] DELETE /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97/os-volume_attachments/4bdc59df-0108-461f-b95d-8441f4400460 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 03 02:32:51.176051 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-bedbc2ba-5a34-4cbb-9619-ee3885c7b884 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:51.177516 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-bedbc2ba-5a34-4cbb-9619-ee3885c7b884 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 530afc76-5f4b-470c-a4fe-6ecb6f5dbb97] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:51.190148 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bedbc2ba-5a34-4cbb-9619-ee3885c7b884 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:51.190726 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bedbc2ba-5a34-4cbb-9619-ee3885c7b884 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:51.191532 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bedbc2ba-5a34-4cbb-9619-ee3885c7b884 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:51.191994 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bedbc2ba-5a34-4cbb-9619-ee3885c7b884 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:51.237983 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-bedbc2ba-5a34-4cbb-9619-ee3885c7b884 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066705 Mar 03 02:32:51.239640 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 158/309] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:32:51 2022] GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:32:51.354703 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c74939c7-e98b-4566-be9a-d0e2e2d10d40 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:51.356931 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c74939c7-e98b-4566-be9a-d0e2e2d10d40 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:51.363060 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c74939c7-e98b-4566-be9a-d0e2e2d10d40 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:51.364145 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c74939c7-e98b-4566-be9a-d0e2e2d10d40 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:51.365245 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c74939c7-e98b-4566-be9a-d0e2e2d10d40 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:51.365878 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c74939c7-e98b-4566-be9a-d0e2e2d10d40 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:51.432802 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c74939c7-e98b-4566-be9a-d0e2e2d10d40 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:51.441136 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c74939c7-e98b-4566-be9a-d0e2e2d10d40 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1271 microversion: 2.1 time: 0.090378 Mar 03 02:32:51.441713 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 159/310] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:51 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1271 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:32:51.453354 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-72fd5925-8362-4db6-983c-329620e6f032 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:51.462490 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-72fd5925-8362-4db6-983c-329620e6f032 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:51.465158 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-72fd5925-8362-4db6-983c-329620e6f032 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:51.467137 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-72fd5925-8362-4db6-983c-329620e6f032 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1725 microversion: 2.20 time: 0.423515 Mar 03 02:32:51.467731 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 152/311] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:32:51 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1725 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:32:51.521731 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3670fc26-8c24-43ca-a7ac-76b8e1568b76 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:51.522508 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3670fc26-8c24-43ca-a7ac-76b8e1568b76 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:51.530416 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3670fc26-8c24-43ca-a7ac-76b8e1568b76 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:51.531006 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3670fc26-8c24-43ca-a7ac-76b8e1568b76 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:51.531921 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3670fc26-8c24-43ca-a7ac-76b8e1568b76 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:51.532488 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3670fc26-8c24-43ca-a7ac-76b8e1568b76 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:51.671526 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3670fc26-8c24-43ca-a7ac-76b8e1568b76 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:51.678994 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3670fc26-8c24-43ca-a7ac-76b8e1568b76 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1359 microversion: 2.1 time: 0.161573 Mar 03 02:32:51.679717 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 160/312] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:51 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:51.930631 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3bc67940-5a8f-4071-96a6-dafda87b8f9f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:51.931239 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3bc67940-5a8f-4071-96a6-dafda87b8f9f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:51.938588 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3bc67940-5a8f-4071-96a6-dafda87b8f9f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:51.939066 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3bc67940-5a8f-4071-96a6-dafda87b8f9f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:51.939903 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3bc67940-5a8f-4071-96a6-dafda87b8f9f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:51.940347 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3bc67940-5a8f-4071-96a6-dafda87b8f9f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:52.059353 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5222b63b-b2c7-4e1e-ad50-7a2857077ccb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:52.060078 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5222b63b-b2c7-4e1e-ad50-7a2857077ccb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:52.066296 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5222b63b-b2c7-4e1e-ad50-7a2857077ccb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:52.066848 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5222b63b-b2c7-4e1e-ad50-7a2857077ccb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:52.067789 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5222b63b-b2c7-4e1e-ad50-7a2857077ccb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:52.068321 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5222b63b-b2c7-4e1e-ad50-7a2857077ccb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:52.209390 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5222b63b-b2c7-4e1e-ad50-7a2857077ccb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:52.221008 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5222b63b-b2c7-4e1e-ad50-7a2857077ccb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1520 microversion: 2.1 time: 0.167179 Mar 03 02:32:52.223707 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 161/313] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:52 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:52.249512 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-20074ad7-700e-4a65-949c-1596d7075b46 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:52.250697 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-20074ad7-700e-4a65-949c-1596d7075b46 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 530afc76-5f4b-470c-a4fe-6ecb6f5dbb97] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:52.256768 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-20074ad7-700e-4a65-949c-1596d7075b46 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:52.257223 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-20074ad7-700e-4a65-949c-1596d7075b46 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:52.258228 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-20074ad7-700e-4a65-949c-1596d7075b46 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:52.258661 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-20074ad7-700e-4a65-949c-1596d7075b46 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:52.287666 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-20074ad7-700e-4a65-949c-1596d7075b46 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042740 Mar 03 02:32:52.288241 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 162/314] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:32:52 2022] GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:32:52.298492 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-3bc67940-5a8f-4071-96a6-dafda87b8f9f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:52.306984 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3bc67940-5a8f-4071-96a6-dafda87b8f9f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1453 microversion: 2.1 time: 0.379972 Mar 03 02:32:52.307525 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 153/315] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:51 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1453 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:52.329057 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9424b036-8cab-4156-8103-a1ccd22962d4 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:52.329664 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9424b036-8cab-4156-8103-a1ccd22962d4 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:52.335468 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9424b036-8cab-4156-8103-a1ccd22962d4 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:52.335953 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9424b036-8cab-4156-8103-a1ccd22962d4 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:52.336748 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9424b036-8cab-4156-8103-a1ccd22962d4 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:52.337182 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9424b036-8cab-4156-8103-a1ccd22962d4 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:52.459404 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-efad23e3-5b90-4184-b579-113db3de315d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:52.460035 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-efad23e3-5b90-4184-b579-113db3de315d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:52.469267 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-efad23e3-5b90-4184-b579-113db3de315d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:52.469717 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-efad23e3-5b90-4184-b579-113db3de315d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:52.470502 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-efad23e3-5b90-4184-b579-113db3de315d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:52.470929 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-efad23e3-5b90-4184-b579-113db3de315d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:52.490895 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9424b036-8cab-4156-8103-a1ccd22962d4 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:52.518378 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9424b036-8cab-4156-8103-a1ccd22962d4 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1453 microversion: 2.1 time: 0.193247 Mar 03 02:32:52.519000 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 163/316] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:52 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1453 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:52.531557 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7d81e2ac-c58e-495a-ac1a-b03f04335fe2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:52.532236 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7d81e2ac-c58e-495a-ac1a-b03f04335fe2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:52.539584 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7d81e2ac-c58e-495a-ac1a-b03f04335fe2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:52.539803 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7d81e2ac-c58e-495a-ac1a-b03f04335fe2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:52.540823 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7d81e2ac-c58e-495a-ac1a-b03f04335fe2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:52.541445 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7d81e2ac-c58e-495a-ac1a-b03f04335fe2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:52.667925 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-efad23e3-5b90-4184-b579-113db3de315d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:52.677984 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-efad23e3-5b90-4184-b579-113db3de315d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1277 microversion: 2.1 time: 0.223191 Mar 03 02:32:52.688650 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 154/317] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:52 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1277 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:32:52.697650 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-270e2bdd-5e87-440a-89f8-7f78bc331258 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:52.699858 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-270e2bdd-5e87-440a-89f8-7f78bc331258 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:52.709394 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-270e2bdd-5e87-440a-89f8-7f78bc331258 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:52.709866 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-270e2bdd-5e87-440a-89f8-7f78bc331258 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:52.711271 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-270e2bdd-5e87-440a-89f8-7f78bc331258 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:52.711947 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-270e2bdd-5e87-440a-89f8-7f78bc331258 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:52.719842 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-7d81e2ac-c58e-495a-ac1a-b03f04335fe2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:52.731806 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-7d81e2ac-c58e-495a-ac1a-b03f04335fe2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:52.733875 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-7d81e2ac-c58e-495a-ac1a-b03f04335fe2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:52.735416 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7d81e2ac-c58e-495a-ac1a-b03f04335fe2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1725 microversion: 2.20 time: 0.215431 Mar 03 02:32:52.736051 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 164/318] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:32:52 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:32:52.981438 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-270e2bdd-5e87-440a-89f8-7f78bc331258 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:52.990213 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-270e2bdd-5e87-440a-89f8-7f78bc331258 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1359 microversion: 2.1 time: 0.297205 Mar 03 02:32:52.993692 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 155/319] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:52 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1359 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:53.241011 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a51538bd-68d6-470d-b085-7b31fea08beb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:53.241684 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a51538bd-68d6-470d-b085-7b31fea08beb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:53.249159 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a51538bd-68d6-470d-b085-7b31fea08beb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:53.250045 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a51538bd-68d6-470d-b085-7b31fea08beb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:53.251289 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a51538bd-68d6-470d-b085-7b31fea08beb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:53.251289 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a51538bd-68d6-470d-b085-7b31fea08beb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:53.300153 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0cff7b7e-458e-4eeb-b25e-fc7a3904aa93 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:53.301711 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0cff7b7e-458e-4eeb-b25e-fc7a3904aa93 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 530afc76-5f4b-470c-a4fe-6ecb6f5dbb97] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:53.311908 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0cff7b7e-458e-4eeb-b25e-fc7a3904aa93 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:53.312684 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0cff7b7e-458e-4eeb-b25e-fc7a3904aa93 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:53.314065 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0cff7b7e-458e-4eeb-b25e-fc7a3904aa93 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:53.314961 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0cff7b7e-458e-4eeb-b25e-fc7a3904aa93 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:53.358468 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0cff7b7e-458e-4eeb-b25e-fc7a3904aa93 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063231 Mar 03 02:32:53.359378 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 156/320] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:32:53 2022] GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:32:53.557623 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a51538bd-68d6-470d-b085-7b31fea08beb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:53.565480 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a51538bd-68d6-470d-b085-7b31fea08beb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1500 microversion: 2.1 time: 0.328384 Mar 03 02:32:53.566064 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 165/321] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:53 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1500 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:53.585877 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e17113d0-ed2a-46f4-9224-bd2c7ecdc13f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7900ba9a-2c21-4ed3-bc79-69280876b98b"}} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:32:53.587048 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e17113d0-ed2a-46f4-9224-bd2c7ecdc13f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:53.595154 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e17113d0-ed2a-46f4-9224-bd2c7ecdc13f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:53.596299 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e17113d0-ed2a-46f4-9224-bd2c7ecdc13f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:53.597540 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e17113d0-ed2a-46f4-9224-bd2c7ecdc13f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:53.598157 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e17113d0-ed2a-46f4-9224-bd2c7ecdc13f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:53.634317 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.wsgi [None req-e17113d0-ed2a-46f4-9224-bd2c7ecdc13f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] HTTP exception thrown: Cannot 'attach_volume' instance 0b9116d7-0099-4dfe-b678-192ce74500eb while it is in vm_state rescued Mar 03 02:32:53.636088 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e17113d0-ed2a-46f4-9224-bd2c7ecdc13f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Returning 409 to user: Cannot 'attach_volume' instance 0b9116d7-0099-4dfe-b678-192ce74500eb while it is in vm_state rescued {{(pid=116858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:32:53.638064 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e17113d0-ed2a-46f4-9224-bd2c7ecdc13f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "POST /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.056834 Mar 03 02:32:53.640280 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 157/322] 10.222.0.30 () {60 vars in 1322 bytes} [Thu Mar 3 02:32:53 2022] POST /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 152 bytes in 60 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 03 02:32:53.648658 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f27fca23-04e4-480f-baf4-90adff081e6b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:32:53.649256 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f27fca23-04e4-480f-baf4-90adff081e6b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:53.656729 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f27fca23-04e4-480f-baf4-90adff081e6b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:53.657270 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f27fca23-04e4-480f-baf4-90adff081e6b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:53.658161 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f27fca23-04e4-480f-baf4-90adff081e6b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:53.658668 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f27fca23-04e4-480f-baf4-90adff081e6b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:53.695130 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-eca0977a-4a1b-42ef-a91d-90010b430fa0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:53.695773 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-eca0977a-4a1b-42ef-a91d-90010b430fa0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:53.706957 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-eca0977a-4a1b-42ef-a91d-90010b430fa0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:53.709590 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-eca0977a-4a1b-42ef-a91d-90010b430fa0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:53.711809 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-eca0977a-4a1b-42ef-a91d-90010b430fa0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:53.712478 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-eca0977a-4a1b-42ef-a91d-90010b430fa0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:53.750787 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f27fca23-04e4-480f-baf4-90adff081e6b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "POST /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/action" status: 202 len: 0 microversion: 2.1 time: 0.105819 Mar 03 02:32:53.751724 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 166/323] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Mar 3 02:32:53 2022] POST /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 03 02:32:53.758611 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ca8d4213-c580-4a67-9378-3312051e86df tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:53.759425 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ca8d4213-c580-4a67-9378-3312051e86df tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:53.766642 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ca8d4213-c580-4a67-9378-3312051e86df tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:53.767231 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ca8d4213-c580-4a67-9378-3312051e86df tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:53.768523 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ca8d4213-c580-4a67-9378-3312051e86df tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:53.769199 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ca8d4213-c580-4a67-9378-3312051e86df tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:54.032638 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ca8d4213-c580-4a67-9378-3312051e86df tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:54.040830 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ca8d4213-c580-4a67-9378-3312051e86df tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:54.042816 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ca8d4213-c580-4a67-9378-3312051e86df tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:54.043767 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ca8d4213-c580-4a67-9378-3312051e86df tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1725 microversion: 2.20 time: 0.290204 Mar 03 02:32:54.044900 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 167/324] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:32:53 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1725 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:32:54.055284 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-91d58a48-19b9-4627-8b65-6a5f6e2c4a0f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:54.055908 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-91d58a48-19b9-4627-8b65-6a5f6e2c4a0f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:54.067519 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-91d58a48-19b9-4627-8b65-6a5f6e2c4a0f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:54.068141 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-91d58a48-19b9-4627-8b65-6a5f6e2c4a0f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:54.069069 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-91d58a48-19b9-4627-8b65-6a5f6e2c4a0f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:54.069748 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-91d58a48-19b9-4627-8b65-6a5f6e2c4a0f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:54.130802 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-eca0977a-4a1b-42ef-a91d-90010b430fa0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:54.139448 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-eca0977a-4a1b-42ef-a91d-90010b430fa0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1319 microversion: 2.1 time: 0.447956 Mar 03 02:32:54.140634 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 158/325] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:53 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1319 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:32:54.149795 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [req-9f6ea225-1e97-410a-8688-72cae5d86482 req-aa7ccc92-806c-4aee-92a7-a79e65e04862 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26ff8756-bd0b-464a-9c28-75b4ee57f99d", "tag": "0d56e3ed-0aa9-416f-96fa-02638da911ee"}]} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:32:54.160943 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-9f6ea225-1e97-410a-8688-72cae5d86482 req-aa7ccc92-806c-4aee-92a7-a79e65e04862 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:54.161696 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-9f6ea225-1e97-410a-8688-72cae5d86482 req-aa7ccc92-806c-4aee-92a7-a79e65e04862 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:54.174367 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.compute.server_external_events [req-9f6ea225-1e97-410a-8688-72cae5d86482 req-aa7ccc92-806c-4aee-92a7-a79e65e04862 service nova] Creating event network-changed:0d56e3ed-0aa9-416f-96fa-02638da911ee for instance 26ff8756-bd0b-464a-9c28-75b4ee57f99d on hv-cinder-81977 Mar 03 02:32:54.182440 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [req-9f6ea225-1e97-410a-8688-72cae5d86482 req-aa7ccc92-806c-4aee-92a7-a79e65e04862 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037700 Mar 03 02:32:54.182440 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 159/326] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:32:54.187862 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5287d630-4e63-4019-b766-5117a522a784 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:54.188438 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5287d630-4e63-4019-b766-5117a522a784 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:54.194531 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5287d630-4e63-4019-b766-5117a522a784 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:54.194995 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5287d630-4e63-4019-b766-5117a522a784 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:54.195822 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5287d630-4e63-4019-b766-5117a522a784 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:54.196268 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5287d630-4e63-4019-b766-5117a522a784 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:54.349615 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-91d58a48-19b9-4627-8b65-6a5f6e2c4a0f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:54.360692 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-91d58a48-19b9-4627-8b65-6a5f6e2c4a0f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1508 microversion: 2.1 time: 0.314830 Mar 03 02:32:54.361443 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 168/327] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:54 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1508 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:54.375474 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0028dbaf-0aa3-4f25-befc-12ba1186e1b0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:54.377285 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0028dbaf-0aa3-4f25-befc-12ba1186e1b0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 530afc76-5f4b-470c-a4fe-6ecb6f5dbb97] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:54.383914 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0028dbaf-0aa3-4f25-befc-12ba1186e1b0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:54.384427 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0028dbaf-0aa3-4f25-befc-12ba1186e1b0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:54.385589 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0028dbaf-0aa3-4f25-befc-12ba1186e1b0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:54.386218 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0028dbaf-0aa3-4f25-befc-12ba1186e1b0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:54.420126 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0028dbaf-0aa3-4f25-befc-12ba1186e1b0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053455 Mar 03 02:32:54.420712 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 169/328] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:32:54 2022] GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:32:54.846676 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5287d630-4e63-4019-b766-5117a522a784 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:54.854645 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5287d630-4e63-4019-b766-5117a522a784 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1359 microversion: 2.1 time: 0.671181 Mar 03 02:32:54.864430 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 160/329] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:54 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1359 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:55.056899 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [req-cd8d8964-2289-4755-b6dd-ce3d114cb487 req-91061a56-234a-492c-8380-a820f0dcf43f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4ca9b17-c039-4bdc-9a51-c1351edaf4d3", "tag": "3a27027e-071e-47ba-b741-f3a6273ab83f"}]} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:32:55.064921 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b7d9fece-615d-47bc-8dad-369d7a151e80 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:55.065546 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b7d9fece-615d-47bc-8dad-369d7a151e80 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:55.070824 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-cd8d8964-2289-4755-b6dd-ce3d114cb487 req-91061a56-234a-492c-8380-a820f0dcf43f service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:55.073066 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b7d9fece-615d-47bc-8dad-369d7a151e80 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:55.073552 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b7d9fece-615d-47bc-8dad-369d7a151e80 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:55.075363 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b7d9fece-615d-47bc-8dad-369d7a151e80 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:55.075940 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b7d9fece-615d-47bc-8dad-369d7a151e80 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:55.082728 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-cd8d8964-2289-4755-b6dd-ce3d114cb487 req-91061a56-234a-492c-8380-a820f0dcf43f service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:55.109708 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.compute.server_external_events [req-cd8d8964-2289-4755-b6dd-ce3d114cb487 req-91061a56-234a-492c-8380-a820f0dcf43f service nova] Creating event network-changed:3a27027e-071e-47ba-b741-f3a6273ab83f for instance b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 on hv-cinder-81977 Mar 03 02:32:55.120316 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [req-cd8d8964-2289-4755-b6dd-ce3d114cb487 req-91061a56-234a-492c-8380-a820f0dcf43f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067048 Mar 03 02:32:55.122521 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 170/330] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:32:55.162684 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b6389b43-b4aa-4c08-a669-47bd971c2b68 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:55.170299 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b6389b43-b4aa-4c08-a669-47bd971c2b68 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:55.179034 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b6389b43-b4aa-4c08-a669-47bd971c2b68 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:55.180184 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b6389b43-b4aa-4c08-a669-47bd971c2b68 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:55.181448 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b6389b43-b4aa-4c08-a669-47bd971c2b68 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:55.182100 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b6389b43-b4aa-4c08-a669-47bd971c2b68 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:55.360250 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b6389b43-b4aa-4c08-a669-47bd971c2b68 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:55.369232 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b6389b43-b4aa-4c08-a669-47bd971c2b68 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1319 microversion: 2.1 time: 0.212903 Mar 03 02:32:55.371000 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 171/331] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:55 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:32:55.395847 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2f2b2d00-0ad8-4c9e-87c2-1404884de91d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:55.396765 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2f2b2d00-0ad8-4c9e-87c2-1404884de91d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:55.407306 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f2b2d00-0ad8-4c9e-87c2-1404884de91d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:55.408035 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f2b2d00-0ad8-4c9e-87c2-1404884de91d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:55.409104 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f2b2d00-0ad8-4c9e-87c2-1404884de91d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:55.410192 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f2b2d00-0ad8-4c9e-87c2-1404884de91d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:55.505053 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b7d9fece-615d-47bc-8dad-369d7a151e80 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:55.520069 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b7d9fece-615d-47bc-8dad-369d7a151e80 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:55.522542 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b7d9fece-615d-47bc-8dad-369d7a151e80 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:55.528875 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b7d9fece-615d-47bc-8dad-369d7a151e80 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1725 microversion: 2.20 time: 0.467817 Mar 03 02:32:55.540331 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 161/332] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:32:55 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1725 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:32:55.555962 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-bbb729b8-30d1-407c-a31e-9b28a192d5d7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:55.557705 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-bbb729b8-30d1-407c-a31e-9b28a192d5d7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 530afc76-5f4b-470c-a4fe-6ecb6f5dbb97] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:55.573513 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bbb729b8-30d1-407c-a31e-9b28a192d5d7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:55.574596 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bbb729b8-30d1-407c-a31e-9b28a192d5d7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:55.575420 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bbb729b8-30d1-407c-a31e-9b28a192d5d7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:55.576069 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bbb729b8-30d1-407c-a31e-9b28a192d5d7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:55.616777 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-bbb729b8-30d1-407c-a31e-9b28a192d5d7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074678 Mar 03 02:32:55.618398 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 162/333] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:32:55 2022] GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:32:55.628453 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2f2b2d00-0ad8-4c9e-87c2-1404884de91d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:55.637580 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2f2b2d00-0ad8-4c9e-87c2-1404884de91d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1508 microversion: 2.1 time: 0.251296 Mar 03 02:32:55.638436 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 172/334] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:55 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1508 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:55.872330 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8a3927d5-a968-4cae-8f5e-962ffe219ebf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:55.872947 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8a3927d5-a968-4cae-8f5e-962ffe219ebf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:55.880617 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8a3927d5-a968-4cae-8f5e-962ffe219ebf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:55.881304 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8a3927d5-a968-4cae-8f5e-962ffe219ebf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:55.882329 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8a3927d5-a968-4cae-8f5e-962ffe219ebf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:55.883121 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8a3927d5-a968-4cae-8f5e-962ffe219ebf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:56.299950 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8a3927d5-a968-4cae-8f5e-962ffe219ebf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:56.307518 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8a3927d5-a968-4cae-8f5e-962ffe219ebf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1359 microversion: 2.1 time: 0.439897 Mar 03 02:32:56.308778 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 163/335] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:55 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1359 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:56.391831 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a06df6f8-af8a-4457-9fa6-22f68e1590f2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:56.393294 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a06df6f8-af8a-4457-9fa6-22f68e1590f2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:56.400172 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a06df6f8-af8a-4457-9fa6-22f68e1590f2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:56.400994 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a06df6f8-af8a-4457-9fa6-22f68e1590f2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:56.402224 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a06df6f8-af8a-4457-9fa6-22f68e1590f2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:56.402926 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a06df6f8-af8a-4457-9fa6-22f68e1590f2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:56.546813 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a06df6f8-af8a-4457-9fa6-22f68e1590f2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:56.548822 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-586734cf-2c65-443e-874f-47322ccfae03 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:56.549909 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-586734cf-2c65-443e-874f-47322ccfae03 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:56.556098 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a06df6f8-af8a-4457-9fa6-22f68e1590f2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1319 microversion: 2.1 time: 0.170496 Mar 03 02:32:56.556458 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-586734cf-2c65-443e-874f-47322ccfae03 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:56.556993 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 173/336] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:56 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:56.557133 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-586734cf-2c65-443e-874f-47322ccfae03 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:56.558478 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-586734cf-2c65-443e-874f-47322ccfae03 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:56.558963 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-586734cf-2c65-443e-874f-47322ccfae03 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:56.628886 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-cbbbdef4-e2f7-466d-865c-be59f4b600d5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:56.630160 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-cbbbdef4-e2f7-466d-865c-be59f4b600d5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 530afc76-5f4b-470c-a4fe-6ecb6f5dbb97] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:56.639499 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cbbbdef4-e2f7-466d-865c-be59f4b600d5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:56.640107 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cbbbdef4-e2f7-466d-865c-be59f4b600d5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:56.640911 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cbbbdef4-e2f7-466d-865c-be59f4b600d5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:56.641364 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cbbbdef4-e2f7-466d-865c-be59f4b600d5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:56.673945 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-cbbbdef4-e2f7-466d-865c-be59f4b600d5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049057 Mar 03 02:32:56.674523 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 174/337] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:32:56 2022] GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:32:56.678960 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-50aacf66-385e-4305-ac3d-572ebdb2811d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:56.679525 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-50aacf66-385e-4305-ac3d-572ebdb2811d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:56.689512 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-50aacf66-385e-4305-ac3d-572ebdb2811d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:56.690152 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-50aacf66-385e-4305-ac3d-572ebdb2811d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:56.691504 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-50aacf66-385e-4305-ac3d-572ebdb2811d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:56.691987 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-50aacf66-385e-4305-ac3d-572ebdb2811d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:56.713011 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-586734cf-2c65-443e-874f-47322ccfae03 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:56.720984 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-586734cf-2c65-443e-874f-47322ccfae03 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:56.722485 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-586734cf-2c65-443e-874f-47322ccfae03 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:56.723720 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-586734cf-2c65-443e-874f-47322ccfae03 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1725 microversion: 2.20 time: 0.179283 Mar 03 02:32:56.724470 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 164/338] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:32:56 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:32:56.865091 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-50aacf66-385e-4305-ac3d-572ebdb2811d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:56.873529 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-50aacf66-385e-4305-ac3d-572ebdb2811d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1508 microversion: 2.1 time: 0.197991 Mar 03 02:32:56.874146 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 175/339] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:56 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1508 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:57.326058 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-30cdc949-aa71-4bee-8242-25c72b962568 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:57.326661 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-30cdc949-aa71-4bee-8242-25c72b962568 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:57.333286 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-30cdc949-aa71-4bee-8242-25c72b962568 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:57.333779 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-30cdc949-aa71-4bee-8242-25c72b962568 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:57.334624 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-30cdc949-aa71-4bee-8242-25c72b962568 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:57.335130 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-30cdc949-aa71-4bee-8242-25c72b962568 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:57.471676 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-30cdc949-aa71-4bee-8242-25c72b962568 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:57.479124 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-30cdc949-aa71-4bee-8242-25c72b962568 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1359 microversion: 2.1 time: 0.157195 Mar 03 02:32:57.479707 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 165/340] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:57 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:57.577928 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a1af5494-6caa-4b13-aafb-ddbbc4988752 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:57.578453 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a1af5494-6caa-4b13-aafb-ddbbc4988752 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:57.586033 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a1af5494-6caa-4b13-aafb-ddbbc4988752 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:57.586687 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a1af5494-6caa-4b13-aafb-ddbbc4988752 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:57.587785 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a1af5494-6caa-4b13-aafb-ddbbc4988752 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:57.588277 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a1af5494-6caa-4b13-aafb-ddbbc4988752 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:57.690353 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ace60f1e-168c-4e4f-b8f4-40fb7dc7576c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:57.695194 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ace60f1e-168c-4e4f-b8f4-40fb7dc7576c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 530afc76-5f4b-470c-a4fe-6ecb6f5dbb97] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:57.705402 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ace60f1e-168c-4e4f-b8f4-40fb7dc7576c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:57.706721 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ace60f1e-168c-4e4f-b8f4-40fb7dc7576c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:57.707811 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ace60f1e-168c-4e4f-b8f4-40fb7dc7576c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:57.708318 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ace60f1e-168c-4e4f-b8f4-40fb7dc7576c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:57.753381 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a1af5494-6caa-4b13-aafb-ddbbc4988752 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:57.757757 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ace60f1e-168c-4e4f-b8f4-40fb7dc7576c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076447 Mar 03 02:32:57.762275 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 166/341] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:32:57 2022] GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:32:57.764065 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-89c3fc49-e231-4fa7-90d5-579e8cec6667 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:57.764661 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-89c3fc49-e231-4fa7-90d5-579e8cec6667 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:57.765343 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a1af5494-6caa-4b13-aafb-ddbbc4988752 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1319 microversion: 2.1 time: 0.191624 Mar 03 02:32:57.766010 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 176/342] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:57 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:57.770676 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-89c3fc49-e231-4fa7-90d5-579e8cec6667 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:57.771136 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-89c3fc49-e231-4fa7-90d5-579e8cec6667 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:57.772027 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-89c3fc49-e231-4fa7-90d5-579e8cec6667 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:57.772444 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-89c3fc49-e231-4fa7-90d5-579e8cec6667 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:57.892798 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4b574230-12f7-446a-88ed-fbe2d1b048f0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:57.893412 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4b574230-12f7-446a-88ed-fbe2d1b048f0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:57.900676 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4b574230-12f7-446a-88ed-fbe2d1b048f0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:57.901134 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4b574230-12f7-446a-88ed-fbe2d1b048f0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:57.902509 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4b574230-12f7-446a-88ed-fbe2d1b048f0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:57.902940 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4b574230-12f7-446a-88ed-fbe2d1b048f0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:57.923839 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-89c3fc49-e231-4fa7-90d5-579e8cec6667 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:57.932476 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-89c3fc49-e231-4fa7-90d5-579e8cec6667 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:57.934391 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-89c3fc49-e231-4fa7-90d5-579e8cec6667 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:57.935648 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-89c3fc49-e231-4fa7-90d5-579e8cec6667 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1725 microversion: 2.20 time: 0.176043 Mar 03 02:32:57.939746 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 167/343] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:32:57 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:32:58.057667 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4b574230-12f7-446a-88ed-fbe2d1b048f0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:58.065620 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4b574230-12f7-446a-88ed-fbe2d1b048f0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1508 microversion: 2.1 time: 0.176642 Mar 03 02:32:58.066235 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 177/344] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:57 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1508 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:32:58.495936 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d90e96ed-56fa-4e17-adb4-249e8706a705 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:58.496544 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d90e96ed-56fa-4e17-adb4-249e8706a705 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:58.502864 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d90e96ed-56fa-4e17-adb4-249e8706a705 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:58.503290 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d90e96ed-56fa-4e17-adb4-249e8706a705 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:58.504099 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d90e96ed-56fa-4e17-adb4-249e8706a705 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:58.504535 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d90e96ed-56fa-4e17-adb4-249e8706a705 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:58.633684 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d90e96ed-56fa-4e17-adb4-249e8706a705 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:58.641926 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d90e96ed-56fa-4e17-adb4-249e8706a705 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1359 microversion: 2.1 time: 0.150156 Mar 03 02:32:58.642487 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 168/345] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:58 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:58.771107 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-716860d0-4f72-4775-9473-fcec427b7db7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:58.772308 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-716860d0-4f72-4775-9473-fcec427b7db7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 530afc76-5f4b-470c-a4fe-6ecb6f5dbb97] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:58.779340 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-716860d0-4f72-4775-9473-fcec427b7db7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:58.780125 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-716860d0-4f72-4775-9473-fcec427b7db7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:58.781286 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-716860d0-4f72-4775-9473-fcec427b7db7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:58.781814 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-716860d0-4f72-4775-9473-fcec427b7db7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:58.783392 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-77874035-60b4-4186-b74b-8dd8a8342a4a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:58.784294 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-77874035-60b4-4186-b74b-8dd8a8342a4a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:58.795754 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-77874035-60b4-4186-b74b-8dd8a8342a4a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:58.796675 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-77874035-60b4-4186-b74b-8dd8a8342a4a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:58.797890 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-77874035-60b4-4186-b74b-8dd8a8342a4a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:58.798633 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-77874035-60b4-4186-b74b-8dd8a8342a4a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:58.834620 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-716860d0-4f72-4775-9473-fcec427b7db7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067841 Mar 03 02:32:58.835199 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 178/346] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:32:58 2022] GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 03 02:32:58.843024 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-565d3d88-42e4-4c63-a901-053055f4bd83 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:32:58.849346 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-565d3d88-42e4-4c63-a901-053055f4bd83 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:58.849804 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-565d3d88-42e4-4c63-a901-053055f4bd83 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:58.917527 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-565d3d88-42e4-4c63-a901-053055f4bd83 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Going to try to stop instance {{(pid=116859) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 03 02:32:58.965115 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-77874035-60b4-4186-b74b-8dd8a8342a4a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:58.973202 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-565d3d88-42e4-4c63-a901-053055f4bd83 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "POST /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/action" status: 202 len: 0 microversion: 2.1 time: 0.136541 Mar 03 02:32:58.976958 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-77874035-60b4-4186-b74b-8dd8a8342a4a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1319 microversion: 2.1 time: 0.195965 Mar 03 02:32:58.977112 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 179/347] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Mar 3 02:32:58 2022] POST /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 03 02:32:58.980548 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 169/348] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:58 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:32:58.981730 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-23f78917-623f-4476-aa99-384b50baf522 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:58.982730 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-23f78917-623f-4476-aa99-384b50baf522 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:58.985510 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c6da9721-73a1-48ce-aa50-28ebf958e255 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:58.987039 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c6da9721-73a1-48ce-aa50-28ebf958e255 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:58.993195 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-23f78917-623f-4476-aa99-384b50baf522 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:58.994000 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-23f78917-623f-4476-aa99-384b50baf522 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:58.995099 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-23f78917-623f-4476-aa99-384b50baf522 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:58.995944 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-23f78917-623f-4476-aa99-384b50baf522 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:59.004342 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c6da9721-73a1-48ce-aa50-28ebf958e255 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:59.004826 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c6da9721-73a1-48ce-aa50-28ebf958e255 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:59.005925 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c6da9721-73a1-48ce-aa50-28ebf958e255 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:59.006129 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c6da9721-73a1-48ce-aa50-28ebf958e255 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:59.155908 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-23f78917-623f-4476-aa99-384b50baf522 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:59.165618 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-23f78917-623f-4476-aa99-384b50baf522 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:59.168830 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-23f78917-623f-4476-aa99-384b50baf522 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:59.170574 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-23f78917-623f-4476-aa99-384b50baf522 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1725 microversion: 2.20 time: 0.195117 Mar 03 02:32:59.171303 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 180/349] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:32:58 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1725 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:32:59.176078 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-98feb810-d9b6-4cb5-abb8-b85a1c8c965e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-895555005", "imageRef": "1fe11a1a-b4d0-46f5-89cd-501ceff49317", "flavorRef": "452", "networks": [{"uuid": "d9d2edb4-611d-4e02-94de-0b7e65f130ad"}]}} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:32:59.178389 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c6da9721-73a1-48ce-aa50-28ebf958e255 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:59.187234 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c6da9721-73a1-48ce-aa50-28ebf958e255 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1720 microversion: 2.1 time: 0.205600 Mar 03 02:32:59.188472 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 170/350] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:58 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1720 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:59.194114 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a36a09d6-01e0-4189-ae76-5525d9131d86 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:59.194904 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a36a09d6-01e0-4189-ae76-5525d9131d86 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:59.204987 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a36a09d6-01e0-4189-ae76-5525d9131d86 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:59.205377 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a36a09d6-01e0-4189-ae76-5525d9131d86 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:59.206462 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a36a09d6-01e0-4189-ae76-5525d9131d86 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:59.206982 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a36a09d6-01e0-4189-ae76-5525d9131d86 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:59.254782 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.network.neutron [None req-98feb810-d9b6-4cb5-abb8-b85a1c8c965e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] validate_networks() for [('d9d2edb4-611d-4e02-94de-0b7e65f130ad', None, None, None, None, None)] {{(pid=116859) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 03 02:32:59.367797 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a36a09d6-01e0-4189-ae76-5525d9131d86 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:59.377046 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a36a09d6-01e0-4189-ae76-5525d9131d86 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1514 microversion: 2.1 time: 0.187581 Mar 03 02:32:59.377824 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 171/351] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:59 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1514 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:59.478755 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [req-40e1b203-51da-4bdd-afcf-9a64eb009b08 req-ca71b564-023e-41c0-8ab5-78a1f570b907 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0df5e3af-dfd2-431d-83af-1a2a02019651", "name": "network-vif-plugged", "status": "completed", "tag": "92ff8971-ee17-4845-81d7-3a348747a57d"}]} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:32:59.495949 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-40e1b203-51da-4bdd-afcf-9a64eb009b08 req-ca71b564-023e-41c0-8ab5-78a1f570b907 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:59.497513 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-40e1b203-51da-4bdd-afcf-9a64eb009b08 req-ca71b564-023e-41c0-8ab5-78a1f570b907 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:59.514173 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.compute.server_external_events [req-40e1b203-51da-4bdd-afcf-9a64eb009b08 req-ca71b564-023e-41c0-8ab5-78a1f570b907 service nova] Creating event network-vif-plugged:92ff8971-ee17-4845-81d7-3a348747a57d for instance 0df5e3af-dfd2-431d-83af-1a2a02019651 on hv-cinder-81977 Mar 03 02:32:59.521866 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [req-40e1b203-51da-4bdd-afcf-9a64eb009b08 req-ca71b564-023e-41c0-8ab5-78a1f570b907 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049459 Mar 03 02:32:59.523573 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 172/352] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:32:59.660525 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a5647ba4-7ef8-4c22-95a3-091434340584 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:59.661851 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a5647ba4-7ef8-4c22-95a3-091434340584 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:59.671289 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a5647ba4-7ef8-4c22-95a3-091434340584 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:59.671836 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a5647ba4-7ef8-4c22-95a3-091434340584 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:59.673005 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a5647ba4-7ef8-4c22-95a3-091434340584 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:59.673501 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a5647ba4-7ef8-4c22-95a3-091434340584 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:59.755223 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-98feb810-d9b6-4cb5-abb8-b85a1c8c965e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Flavor limits 0:0:0 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 03 02:32:59.755737 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-98feb810-d9b6-4cb5-abb8-b85a1c8c965e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Image limits 0:0:0 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 03 02:32:59.756258 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-98feb810-d9b6-4cb5-abb8-b85a1c8c965e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Flavor pref 0:0:0 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 03 02:32:59.756783 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-98feb810-d9b6-4cb5-abb8-b85a1c8c965e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Image pref 0:0:0 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 03 02:32:59.757202 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-98feb810-d9b6-4cb5-abb8-b85a1c8c965e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 03 02:32:59.767907 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-98feb810-d9b6-4cb5-abb8-b85a1c8c965e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:59.768361 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-98feb810-d9b6-4cb5-abb8-b85a1c8c965e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:59.769290 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-98feb810-d9b6-4cb5-abb8-b85a1c8c965e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:32:59.769943 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-98feb810-d9b6-4cb5-abb8-b85a1c8c965e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:32:59.790356 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.quota [None req-98feb810-d9b6-4cb5-abb8-b85a1c8c965e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Getting quotas for project 2e235fd949e6494eb47967914074be06. Resources: {'instances', 'ram', 'cores'} {{(pid=116859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 03 02:32:59.796075 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.quota [None req-98feb810-d9b6-4cb5-abb8-b85a1c8c965e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Getting quotas for user 76da7e26281640968c429d04efb3dd3e and project 2e235fd949e6494eb47967914074be06. Resources: {'instances', 'ram', 'cores'} {{(pid=116859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 03 02:32:59.810788 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-98feb810-d9b6-4cb5-abb8-b85a1c8c965e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Going to run 1 instances... {{(pid=116859) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 03 02:32:59.813407 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-98feb810-d9b6-4cb5-abb8-b85a1c8c965e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1fe11a1a-b4d0-46f5-89cd-501ceff49317',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 03 02:32:59.858167 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-98feb810-d9b6-4cb5-abb8-b85a1c8c965e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.685569 Mar 03 02:32:59.859100 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 181/353] 10.222.0.30 () {60 vars in 1146 bytes} [Thu Mar 3 02:32:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 03 02:32:59.869039 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-af5170da-a1a4-4c1e-bd2b-36c97414b51b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:59.869792 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-af5170da-a1a4-4c1e-bd2b-36c97414b51b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:32:59.908944 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a5647ba4-7ef8-4c22-95a3-091434340584 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:59.916926 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a5647ba4-7ef8-4c22-95a3-091434340584 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1359 microversion: 2.1 time: 0.261481 Mar 03 02:32:59.918081 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 173/354] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:59 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1359 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:32:59.931208 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-af5170da-a1a4-4c1e-bd2b-36c97414b51b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:32:59.940143 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-af5170da-a1a4-4c1e-bd2b-36c97414b51b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1217 microversion: 2.1 time: 0.075205 Mar 03 02:32:59.941135 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 182/355] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:59 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1217 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:32:59.993257 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9ce55f45-6435-41f9-b9ee-ff1f550c4527 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:32:59.993911 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9ce55f45-6435-41f9-b9ee-ff1f550c4527 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:00.000605 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9ce55f45-6435-41f9-b9ee-ff1f550c4527 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:00.001053 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9ce55f45-6435-41f9-b9ee-ff1f550c4527 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:00.001845 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9ce55f45-6435-41f9-b9ee-ff1f550c4527 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:00.002276 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9ce55f45-6435-41f9-b9ee-ff1f550c4527 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:00.148297 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9ce55f45-6435-41f9-b9ee-ff1f550c4527 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:00.156974 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9ce55f45-6435-41f9-b9ee-ff1f550c4527 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1319 microversion: 2.1 time: 0.167470 Mar 03 02:33:00.157632 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 174/356] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:32:59 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:00.188665 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-667b9081-a7f4-45e9-8109-21fe25588964 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:00.189357 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-667b9081-a7f4-45e9-8109-21fe25588964 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:00.196500 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-667b9081-a7f4-45e9-8109-21fe25588964 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:00.197127 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-667b9081-a7f4-45e9-8109-21fe25588964 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:00.198094 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-667b9081-a7f4-45e9-8109-21fe25588964 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:00.198701 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-667b9081-a7f4-45e9-8109-21fe25588964 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:00.205235 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-96d73603-b23f-4bba-a303-d10bc486d498 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:00.205967 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-96d73603-b23f-4bba-a303-d10bc486d498 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:00.212587 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-96d73603-b23f-4bba-a303-d10bc486d498 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:00.213126 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-96d73603-b23f-4bba-a303-d10bc486d498 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:00.214718 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-96d73603-b23f-4bba-a303-d10bc486d498 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:00.215291 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-96d73603-b23f-4bba-a303-d10bc486d498 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:00.367431 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-667b9081-a7f4-45e9-8109-21fe25588964 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:00.381837 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-667b9081-a7f4-45e9-8109-21fe25588964 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:00.383437 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-667b9081-a7f4-45e9-8109-21fe25588964 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:00.384665 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-667b9081-a7f4-45e9-8109-21fe25588964 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1725 microversion: 2.20 time: 0.200317 Mar 03 02:33:00.385517 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-96d73603-b23f-4bba-a303-d10bc486d498 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:00.385649 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 183/357] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:00 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1725 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:33:00.403130 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-96d73603-b23f-4bba-a303-d10bc486d498 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1720 microversion: 2.1 time: 0.201717 Mar 03 02:33:00.404155 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 175/358] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:00 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1720 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:33:00.768329 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f4eb36c6-59a2-49c9-a550-8312da8126e9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:00.768929 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f4eb36c6-59a2-49c9-a550-8312da8126e9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:00.774677 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f4eb36c6-59a2-49c9-a550-8312da8126e9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:00.775126 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f4eb36c6-59a2-49c9-a550-8312da8126e9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:00.775933 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f4eb36c6-59a2-49c9-a550-8312da8126e9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:00.776366 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f4eb36c6-59a2-49c9-a550-8312da8126e9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:00.916676 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f4eb36c6-59a2-49c9-a550-8312da8126e9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:00.925007 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f4eb36c6-59a2-49c9-a550-8312da8126e9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1514 microversion: 2.1 time: 0.160409 Mar 03 02:33:00.925571 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 184/359] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:00 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:00.935813 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-826c117b-6a4d-4871-a9dc-1c22af9e5ad5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:00.936686 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-826c117b-6a4d-4871-a9dc-1c22af9e5ad5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:00.941304 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d9a00aed-defd-4ca7-b53b-6e70852492c8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "48041a70-94bf-454e-997d-6645136166b5"}} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:33:00.942469 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d9a00aed-defd-4ca7-b53b-6e70852492c8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:00.943715 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-826c117b-6a4d-4871-a9dc-1c22af9e5ad5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:00.944238 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-826c117b-6a4d-4871-a9dc-1c22af9e5ad5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:00.945237 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-826c117b-6a4d-4871-a9dc-1c22af9e5ad5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:00.945776 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-826c117b-6a4d-4871-a9dc-1c22af9e5ad5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:00.948413 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d9a00aed-defd-4ca7-b53b-6e70852492c8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:00.949016 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d9a00aed-defd-4ca7-b53b-6e70852492c8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:00.949974 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d9a00aed-defd-4ca7-b53b-6e70852492c8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:00.950407 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d9a00aed-defd-4ca7-b53b-6e70852492c8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:01.108318 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-826c117b-6a4d-4871-a9dc-1c22af9e5ad5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:01.116334 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-826c117b-6a4d-4871-a9dc-1c22af9e5ad5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1359 microversion: 2.1 time: 0.184879 Mar 03 02:33:01.126438 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 176/360] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:00 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:01.138622 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-30e91c76-09fd-4884-b403-f77277791bbe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:01.139426 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-30e91c76-09fd-4884-b403-f77277791bbe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:01.147307 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-30e91c76-09fd-4884-b403-f77277791bbe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:01.147748 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-30e91c76-09fd-4884-b403-f77277791bbe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:01.148700 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-30e91c76-09fd-4884-b403-f77277791bbe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:01.149209 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-30e91c76-09fd-4884-b403-f77277791bbe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:01.233066 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-30e91c76-09fd-4884-b403-f77277791bbe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:01.249842 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-30e91c76-09fd-4884-b403-f77277791bbe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1277 microversion: 2.1 time: 0.126014 Mar 03 02:33:01.250676 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 177/361] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:01 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1277 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:01.264413 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-03399762-9583-474d-b22f-003cefc2a83e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:01.265197 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-03399762-9583-474d-b22f-003cefc2a83e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:01.270763 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d9a00aed-defd-4ca7-b53b-6e70852492c8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "POST /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.332858 Mar 03 02:33:01.276296 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 185/362] 10.222.0.30 () {60 vars in 1322 bytes} [Thu Mar 3 02:33:00 2022] POST /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 194 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:33:01.276467 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-03399762-9583-474d-b22f-003cefc2a83e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:01.276467 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-03399762-9583-474d-b22f-003cefc2a83e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:01.276467 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-03399762-9583-474d-b22f-003cefc2a83e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:01.276467 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-03399762-9583-474d-b22f-003cefc2a83e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:01.407313 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-96454a4c-3d06-4bd8-a96d-d549bb56f091 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:01.408059 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-96454a4c-3d06-4bd8-a96d-d549bb56f091 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:01.414565 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-96454a4c-3d06-4bd8-a96d-d549bb56f091 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:01.415263 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-96454a4c-3d06-4bd8-a96d-d549bb56f091 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:01.417032 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-96454a4c-3d06-4bd8-a96d-d549bb56f091 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:01.417560 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-96454a4c-3d06-4bd8-a96d-d549bb56f091 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:01.563107 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-96454a4c-3d06-4bd8-a96d-d549bb56f091 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:01.571350 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-96454a4c-3d06-4bd8-a96d-d549bb56f091 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:01.572880 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-96454a4c-3d06-4bd8-a96d-d549bb56f091 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:01.574251 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-96454a4c-3d06-4bd8-a96d-d549bb56f091 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1725 microversion: 2.20 time: 0.172399 Mar 03 02:33:01.575023 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 186/363] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:01 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:33:01.579660 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2f906dc8-5e8f-4bbd-b241-e126aeb6bde9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:01.580263 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2f906dc8-5e8f-4bbd-b241-e126aeb6bde9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:01.586677 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f906dc8-5e8f-4bbd-b241-e126aeb6bde9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:01.587125 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f906dc8-5e8f-4bbd-b241-e126aeb6bde9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:01.587944 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f906dc8-5e8f-4bbd-b241-e126aeb6bde9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:01.588381 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f906dc8-5e8f-4bbd-b241-e126aeb6bde9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:01.724695 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2f906dc8-5e8f-4bbd-b241-e126aeb6bde9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:01.733493 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2f906dc8-5e8f-4bbd-b241-e126aeb6bde9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1720 microversion: 2.1 time: 0.157297 Mar 03 02:33:01.734052 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 187/364] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:01 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:01.771796 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-03399762-9583-474d-b22f-003cefc2a83e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:01.779801 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-03399762-9583-474d-b22f-003cefc2a83e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1319 microversion: 2.1 time: 0.528056 Mar 03 02:33:01.780671 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 178/365] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:01 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1319 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:02.134159 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-57e9eeb1-0989-4af1-9049-b163fd3c4580 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:02.134771 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-57e9eeb1-0989-4af1-9049-b163fd3c4580 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:02.146668 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-57e9eeb1-0989-4af1-9049-b163fd3c4580 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:02.146874 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-57e9eeb1-0989-4af1-9049-b163fd3c4580 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:02.148361 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-57e9eeb1-0989-4af1-9049-b163fd3c4580 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:02.148866 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-57e9eeb1-0989-4af1-9049-b163fd3c4580 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:02.268366 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f20334db-c814-491f-9320-e6e9697ba7b1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:02.268910 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f20334db-c814-491f-9320-e6e9697ba7b1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:02.277476 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f20334db-c814-491f-9320-e6e9697ba7b1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:02.278013 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f20334db-c814-491f-9320-e6e9697ba7b1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:02.278885 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f20334db-c814-491f-9320-e6e9697ba7b1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:02.279471 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f20334db-c814-491f-9320-e6e9697ba7b1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:02.348199 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-57e9eeb1-0989-4af1-9049-b163fd3c4580 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:02.357696 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-57e9eeb1-0989-4af1-9049-b163fd3c4580 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1359 microversion: 2.1 time: 0.227321 Mar 03 02:33:02.358878 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 188/366] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:02 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1359 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:02.569995 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f20334db-c814-491f-9320-e6e9697ba7b1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:02.577557 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f20334db-c814-491f-9320-e6e9697ba7b1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1317 microversion: 2.1 time: 0.313756 Mar 03 02:33:02.578212 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 179/367] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:02 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1317 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:33:02.594432 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1ac3cbca-b111-4805-9367-8b2c76bc3455 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:02.595158 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1ac3cbca-b111-4805-9367-8b2c76bc3455 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:02.601813 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1ac3cbca-b111-4805-9367-8b2c76bc3455 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:02.602372 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1ac3cbca-b111-4805-9367-8b2c76bc3455 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:02.603505 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1ac3cbca-b111-4805-9367-8b2c76bc3455 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:02.604072 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1ac3cbca-b111-4805-9367-8b2c76bc3455 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:02.741290 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1ac3cbca-b111-4805-9367-8b2c76bc3455 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:02.750955 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1ac3cbca-b111-4805-9367-8b2c76bc3455 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:02.751103 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e4963621-a39d-4bbf-bd3f-e38e11f63f68 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:02.751409 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e4963621-a39d-4bbf-bd3f-e38e11f63f68 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:02.752449 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1ac3cbca-b111-4805-9367-8b2c76bc3455 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:02.753732 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1ac3cbca-b111-4805-9367-8b2c76bc3455 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1725 microversion: 2.20 time: 0.163266 Mar 03 02:33:02.754399 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 189/368] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:02 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:33:02.757743 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e4963621-a39d-4bbf-bd3f-e38e11f63f68 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:02.758190 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e4963621-a39d-4bbf-bd3f-e38e11f63f68 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:02.758973 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e4963621-a39d-4bbf-bd3f-e38e11f63f68 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:02.759401 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e4963621-a39d-4bbf-bd3f-e38e11f63f68 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:02.797521 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2140aa96-9459-486f-a6fa-75f8375328de tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:02.798447 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2140aa96-9459-486f-a6fa-75f8375328de tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:02.806229 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2140aa96-9459-486f-a6fa-75f8375328de tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:02.806731 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2140aa96-9459-486f-a6fa-75f8375328de tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:02.807540 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2140aa96-9459-486f-a6fa-75f8375328de tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:02.808050 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2140aa96-9459-486f-a6fa-75f8375328de tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:02.946167 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2140aa96-9459-486f-a6fa-75f8375328de tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:02.954000 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2140aa96-9459-486f-a6fa-75f8375328de tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1319 microversion: 2.1 time: 0.161060 Mar 03 02:33:02.954579 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 190/369] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:02 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:33:02.975853 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e4963621-a39d-4bbf-bd3f-e38e11f63f68 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:02.984535 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e4963621-a39d-4bbf-bd3f-e38e11f63f68 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1720 microversion: 2.1 time: 0.237866 Mar 03 02:33:02.985277 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 180/370] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:02 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1720 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:33:03.040618 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [req-422b6335-232a-43ad-9fea-82f6905dc358 req-10a2f149-3a31-40f5-a68b-29cf57b72b7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e1ff924-aedc-41f0-84df-c1ba81e1a936", "tag": "d0bef6ed-58b8-4206-9b29-ca505fda1e79"}]} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:33:03.054473 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-422b6335-232a-43ad-9fea-82f6905dc358 req-10a2f149-3a31-40f5-a68b-29cf57b72b7f service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:03.054473 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-422b6335-232a-43ad-9fea-82f6905dc358 req-10a2f149-3a31-40f5-a68b-29cf57b72b7f service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:03.066724 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.compute.server_external_events [req-422b6335-232a-43ad-9fea-82f6905dc358 req-10a2f149-3a31-40f5-a68b-29cf57b72b7f service nova] Creating event network-changed:d0bef6ed-58b8-4206-9b29-ca505fda1e79 for instance 9e1ff924-aedc-41f0-84df-c1ba81e1a936 on hv-cinder-81977 Mar 03 02:33:03.071300 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [req-422b6335-232a-43ad-9fea-82f6905dc358 req-10a2f149-3a31-40f5-a68b-29cf57b72b7f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034804 Mar 03 02:33:03.071940 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 191/371] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:33:03.259734 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [req-84c82c0f-984e-464e-841d-d78177c20cac req-50b57aba-6aed-45ae-b0ca-d104cf33ce11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26ff8756-bd0b-464a-9c28-75b4ee57f99d", "name": "network-vif-plugged", "status": "completed", "tag": "0d56e3ed-0aa9-416f-96fa-02638da911ee"}]} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:33:03.269088 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-84c82c0f-984e-464e-841d-d78177c20cac req-50b57aba-6aed-45ae-b0ca-d104cf33ce11 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:03.270222 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-84c82c0f-984e-464e-841d-d78177c20cac req-50b57aba-6aed-45ae-b0ca-d104cf33ce11 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:03.283855 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.compute.server_external_events [req-84c82c0f-984e-464e-841d-d78177c20cac req-50b57aba-6aed-45ae-b0ca-d104cf33ce11 service nova] Creating event network-vif-plugged:0d56e3ed-0aa9-416f-96fa-02638da911ee for instance 26ff8756-bd0b-464a-9c28-75b4ee57f99d on hv-cinder-81977 Mar 03 02:33:03.288667 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [req-84c82c0f-984e-464e-841d-d78177c20cac req-50b57aba-6aed-45ae-b0ca-d104cf33ce11 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032802 Mar 03 02:33:03.289265 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 181/372] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:33:03.376361 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c5588410-225b-44f9-84ac-35bfb4091657 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:03.377025 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c5588410-225b-44f9-84ac-35bfb4091657 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:03.383660 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c5588410-225b-44f9-84ac-35bfb4091657 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:03.384131 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c5588410-225b-44f9-84ac-35bfb4091657 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:03.384931 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c5588410-225b-44f9-84ac-35bfb4091657 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:03.385376 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c5588410-225b-44f9-84ac-35bfb4091657 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:03.569745 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c5588410-225b-44f9-84ac-35bfb4091657 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:03.579145 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c5588410-225b-44f9-84ac-35bfb4091657 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1549 microversion: 2.1 time: 0.208365 Mar 03 02:33:03.597404 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0a5a8ea2-e02d-4745-a4eb-66fb5c5253ac tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:03.598104 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0a5a8ea2-e02d-4745-a4eb-66fb5c5253ac tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:03.600885 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 192/373] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:03 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1549 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:03.605712 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-226d82af-200a-4672-a4a3-cdd010c8d9f0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:03.605991 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0a5a8ea2-e02d-4745-a4eb-66fb5c5253ac tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:03.606311 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-226d82af-200a-4672-a4a3-cdd010c8d9f0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:03.606426 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0a5a8ea2-e02d-4745-a4eb-66fb5c5253ac tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:03.607213 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0a5a8ea2-e02d-4745-a4eb-66fb5c5253ac tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:03.607674 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0a5a8ea2-e02d-4745-a4eb-66fb5c5253ac tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:03.612706 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-226d82af-200a-4672-a4a3-cdd010c8d9f0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:03.612706 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-226d82af-200a-4672-a4a3-cdd010c8d9f0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:03.613461 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-226d82af-200a-4672-a4a3-cdd010c8d9f0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:03.613911 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-226d82af-200a-4672-a4a3-cdd010c8d9f0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:03.759145 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-226d82af-200a-4672-a4a3-cdd010c8d9f0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:03.760414 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0a5a8ea2-e02d-4745-a4eb-66fb5c5253ac tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:03.767826 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0a5a8ea2-e02d-4745-a4eb-66fb5c5253ac tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1549 microversion: 2.1 time: 0.174515 Mar 03 02:33:03.768396 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 182/374] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:03 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1549 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:03.769565 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-226d82af-200a-4672-a4a3-cdd010c8d9f0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1317 microversion: 2.1 time: 0.167637 Mar 03 02:33:03.770127 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 193/375] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:03 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:03.772827 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-beb55e44-7317-4815-b6c1-85328aa2f0d8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:03.773425 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-beb55e44-7317-4815-b6c1-85328aa2f0d8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:03.779382 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-beb55e44-7317-4815-b6c1-85328aa2f0d8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:03.779873 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-beb55e44-7317-4815-b6c1-85328aa2f0d8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:03.780764 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-beb55e44-7317-4815-b6c1-85328aa2f0d8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:03.781083 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-beb55e44-7317-4815-b6c1-85328aa2f0d8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:03.783265 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-34c16dc1-6159-40b1-a35f-3c83b03900f4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:03.786670 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-34c16dc1-6159-40b1-a35f-3c83b03900f4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:03.787428 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-34c16dc1-6159-40b1-a35f-3c83b03900f4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Searching by: {'deleted': False, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5'} {{(pid=116859) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 03 02:33:03.794556 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-34c16dc1-6159-40b1-a35f-3c83b03900f4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:03.794994 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-34c16dc1-6159-40b1-a35f-3c83b03900f4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:03.796283 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-34c16dc1-6159-40b1-a35f-3c83b03900f4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:03.796722 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-34c16dc1-6159-40b1-a35f-3c83b03900f4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:03.918495 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.multi_cell_list [None req-34c16dc1-6159-40b1-a35f-3c83b03900f4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116859) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 03 02:33:03.958615 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-beb55e44-7317-4815-b6c1-85328aa2f0d8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:03.967383 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-beb55e44-7317-4815-b6c1-85328aa2f0d8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:03.968909 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-beb55e44-7317-4815-b6c1-85328aa2f0d8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:03.970292 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-beb55e44-7317-4815-b6c1-85328aa2f0d8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1725 microversion: 2.20 time: 0.201004 Mar 03 02:33:03.970845 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 183/376] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:03 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1725 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:33:03.975515 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-57c1ecd5-80e4-419c-8dd8-605f9d9c8d84 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:03.976155 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-57c1ecd5-80e4-419c-8dd8-605f9d9c8d84 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:03.983218 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-57c1ecd5-80e4-419c-8dd8-605f9d9c8d84 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:03.983709 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-57c1ecd5-80e4-419c-8dd8-605f9d9c8d84 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:03.984502 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-57c1ecd5-80e4-419c-8dd8-605f9d9c8d84 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:03.984975 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-57c1ecd5-80e4-419c-8dd8-605f9d9c8d84 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:04.019834 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-34c16dc1-6159-40b1-a35f-3c83b03900f4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.240072 Mar 03 02:33:04.020418 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 194/377] 10.222.0.30 () {58 vars in 1124 bytes} [Thu Mar 3 02:33:03 2022] GET /compute/v2.1/servers => generated 343 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:33:04.024858 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a6d5e303-74aa-4ea8-a7c1-197ebb9041be tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:04.025632 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a6d5e303-74aa-4ea8-a7c1-197ebb9041be tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:04.032437 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a6d5e303-74aa-4ea8-a7c1-197ebb9041be tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:04.032883 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a6d5e303-74aa-4ea8-a7c1-197ebb9041be tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:04.033661 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a6d5e303-74aa-4ea8-a7c1-197ebb9041be tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:04.034094 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a6d5e303-74aa-4ea8-a7c1-197ebb9041be tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:04.166972 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a6d5e303-74aa-4ea8-a7c1-197ebb9041be tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:04.175995 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a6d5e303-74aa-4ea8-a7c1-197ebb9041be tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1720 microversion: 2.1 time: 0.154586 Mar 03 02:33:04.176568 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 195/378] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:04 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:04.181018 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a09ff25c-779d-4dbb-83cb-eee5a5d8f4e3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:04.182074 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a09ff25c-779d-4dbb-83cb-eee5a5d8f4e3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:04.188639 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a09ff25c-779d-4dbb-83cb-eee5a5d8f4e3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:04.189092 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a09ff25c-779d-4dbb-83cb-eee5a5d8f4e3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:04.189883 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a09ff25c-779d-4dbb-83cb-eee5a5d8f4e3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:04.190320 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a09ff25c-779d-4dbb-83cb-eee5a5d8f4e3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:04.249644 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-57c1ecd5-80e4-419c-8dd8-605f9d9c8d84 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:04.257263 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-57c1ecd5-80e4-419c-8dd8-605f9d9c8d84 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1319 microversion: 2.1 time: 0.285189 Mar 03 02:33:04.257944 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 184/379] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:03 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1319 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:04.324562 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a09ff25c-779d-4dbb-83cb-eee5a5d8f4e3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:04.332244 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a09ff25c-779d-4dbb-83cb-eee5a5d8f4e3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1549 microversion: 2.1 time: 0.154670 Mar 03 02:33:04.332823 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 196/380] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:04 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:04.788262 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f5af097c-e55d-4fa9-8bde-cfbe9765fbc0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:04.789273 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f5af097c-e55d-4fa9-8bde-cfbe9765fbc0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:04.795727 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f5af097c-e55d-4fa9-8bde-cfbe9765fbc0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:04.796301 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f5af097c-e55d-4fa9-8bde-cfbe9765fbc0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:04.797149 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f5af097c-e55d-4fa9-8bde-cfbe9765fbc0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:04.797591 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f5af097c-e55d-4fa9-8bde-cfbe9765fbc0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:04.935498 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f5af097c-e55d-4fa9-8bde-cfbe9765fbc0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:04.942744 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f5af097c-e55d-4fa9-8bde-cfbe9765fbc0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1317 microversion: 2.1 time: 0.158401 Mar 03 02:33:04.943307 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 185/381] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:04 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:04.989935 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-80387328-fd61-4742-a683-06933011981f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:04.990689 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-80387328-fd61-4742-a683-06933011981f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:04.998534 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-80387328-fd61-4742-a683-06933011981f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:04.999178 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-80387328-fd61-4742-a683-06933011981f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:05.000305 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-80387328-fd61-4742-a683-06933011981f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:05.000852 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-80387328-fd61-4742-a683-06933011981f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:05.154671 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-80387328-fd61-4742-a683-06933011981f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:05.162311 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-80387328-fd61-4742-a683-06933011981f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:05.163858 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-80387328-fd61-4742-a683-06933011981f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:05.165007 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-80387328-fd61-4742-a683-06933011981f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1725 microversion: 2.20 time: 0.180046 Mar 03 02:33:05.165592 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 197/382] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:04 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:33:05.193384 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-044b57a0-c0a0-4a03-b2b9-05048c01a477 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:05.193901 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-044b57a0-c0a0-4a03-b2b9-05048c01a477 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:05.200285 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-044b57a0-c0a0-4a03-b2b9-05048c01a477 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:05.200742 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-044b57a0-c0a0-4a03-b2b9-05048c01a477 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:05.201525 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-044b57a0-c0a0-4a03-b2b9-05048c01a477 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:05.201968 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-044b57a0-c0a0-4a03-b2b9-05048c01a477 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:05.274407 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c8ba7fe7-ad3e-4770-850a-679f6c47c921 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:05.275004 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c8ba7fe7-ad3e-4770-850a-679f6c47c921 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:05.281818 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c8ba7fe7-ad3e-4770-850a-679f6c47c921 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:05.282261 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c8ba7fe7-ad3e-4770-850a-679f6c47c921 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:05.283033 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c8ba7fe7-ad3e-4770-850a-679f6c47c921 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:05.283459 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c8ba7fe7-ad3e-4770-850a-679f6c47c921 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:05.335113 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-044b57a0-c0a0-4a03-b2b9-05048c01a477 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:05.343110 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-044b57a0-c0a0-4a03-b2b9-05048c01a477 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1720 microversion: 2.1 time: 0.153629 Mar 03 02:33:05.343708 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 186/383] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:05 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:05.416762 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c8ba7fe7-ad3e-4770-850a-679f6c47c921 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:05.424406 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c8ba7fe7-ad3e-4770-850a-679f6c47c921 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1319 microversion: 2.1 time: 0.153846 Mar 03 02:33:05.424969 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 198/384] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:05 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:33:05.833937 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-627307ac-0c4d-49df-acee-382b45e4cc23 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f2e36cca-2705-4b40-8b08-2a93f505f2f6"}} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:33:05.835353 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-627307ac-0c4d-49df-acee-382b45e4cc23 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:05.841778 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-627307ac-0c4d-49df-acee-382b45e4cc23 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:05.842227 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-627307ac-0c4d-49df-acee-382b45e4cc23 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:05.842994 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-627307ac-0c4d-49df-acee-382b45e4cc23 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:05.843427 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-627307ac-0c4d-49df-acee-382b45e4cc23 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:05.961122 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-090df8f5-888e-4c72-b441-733aa3eb07b8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:05.961736 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-090df8f5-888e-4c72-b441-733aa3eb07b8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:05.967859 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-090df8f5-888e-4c72-b441-733aa3eb07b8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:05.968312 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-090df8f5-888e-4c72-b441-733aa3eb07b8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:05.969159 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-090df8f5-888e-4c72-b441-733aa3eb07b8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:05.969641 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-090df8f5-888e-4c72-b441-733aa3eb07b8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:06.110307 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-627307ac-0c4d-49df-acee-382b45e4cc23 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "POST /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280207 Mar 03 02:33:06.110953 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 187/385] 10.222.0.30 () {60 vars in 1322 bytes} [Thu Mar 3 02:33:05 2022] POST /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:33:06.129534 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-090df8f5-888e-4c72-b441-733aa3eb07b8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:06.139576 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-090df8f5-888e-4c72-b441-733aa3eb07b8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1317 microversion: 2.1 time: 0.182280 Mar 03 02:33:06.140264 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 199/386] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:05 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:33:06.183319 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e09305cf-3aed-4cae-b427-e72f6fd96949 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:06.184038 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e09305cf-3aed-4cae-b427-e72f6fd96949 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:06.190185 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e09305cf-3aed-4cae-b427-e72f6fd96949 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:06.190637 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e09305cf-3aed-4cae-b427-e72f6fd96949 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:06.191428 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e09305cf-3aed-4cae-b427-e72f6fd96949 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:06.191887 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e09305cf-3aed-4cae-b427-e72f6fd96949 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:06.339964 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e09305cf-3aed-4cae-b427-e72f6fd96949 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:06.347992 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e09305cf-3aed-4cae-b427-e72f6fd96949 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:06.349462 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e09305cf-3aed-4cae-b427-e72f6fd96949 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:06.350603 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e09305cf-3aed-4cae-b427-e72f6fd96949 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1725 microversion: 2.20 time: 0.172023 Mar 03 02:33:06.351157 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 188/387] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:06 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:33:06.363596 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d3b263ef-5d36-4fc1-95ac-40478a5845a2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:06.364306 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d3b263ef-5d36-4fc1-95ac-40478a5845a2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:06.370297 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d3b263ef-5d36-4fc1-95ac-40478a5845a2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:06.371009 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d3b263ef-5d36-4fc1-95ac-40478a5845a2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:06.371908 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d3b263ef-5d36-4fc1-95ac-40478a5845a2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:06.372347 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d3b263ef-5d36-4fc1-95ac-40478a5845a2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:06.441507 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7d1e8fe9-8f0a-4eee-b2c0-69a2696bd10b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:06.442182 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7d1e8fe9-8f0a-4eee-b2c0-69a2696bd10b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:06.447883 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7d1e8fe9-8f0a-4eee-b2c0-69a2696bd10b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:06.448853 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7d1e8fe9-8f0a-4eee-b2c0-69a2696bd10b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:06.449700 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7d1e8fe9-8f0a-4eee-b2c0-69a2696bd10b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:06.450193 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7d1e8fe9-8f0a-4eee-b2c0-69a2696bd10b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:06.506222 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d3b263ef-5d36-4fc1-95ac-40478a5845a2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:06.514581 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d3b263ef-5d36-4fc1-95ac-40478a5845a2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1720 microversion: 2.1 time: 0.155037 Mar 03 02:33:06.515143 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 200/388] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:06 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:06.582871 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-7d1e8fe9-8f0a-4eee-b2c0-69a2696bd10b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:06.590909 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7d1e8fe9-8f0a-4eee-b2c0-69a2696bd10b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1319 microversion: 2.1 time: 0.153302 Mar 03 02:33:06.591747 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 189/389] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:06 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:33:07.156923 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c68d81ab-85e0-4f1d-a61e-38e8069b286b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:07.157526 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c68d81ab-85e0-4f1d-a61e-38e8069b286b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:07.163782 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c68d81ab-85e0-4f1d-a61e-38e8069b286b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:07.164229 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c68d81ab-85e0-4f1d-a61e-38e8069b286b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:07.165000 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c68d81ab-85e0-4f1d-a61e-38e8069b286b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:07.165437 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c68d81ab-85e0-4f1d-a61e-38e8069b286b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:07.300304 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c68d81ab-85e0-4f1d-a61e-38e8069b286b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:07.307633 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c68d81ab-85e0-4f1d-a61e-38e8069b286b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1317 microversion: 2.1 time: 0.155132 Mar 03 02:33:07.308671 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 201/390] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:07 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:07.370062 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2a8c885b-fe65-42a6-8dae-58e8b7f7f3c6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:07.371238 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2a8c885b-fe65-42a6-8dae-58e8b7f7f3c6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:07.377531 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2a8c885b-fe65-42a6-8dae-58e8b7f7f3c6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:07.377978 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2a8c885b-fe65-42a6-8dae-58e8b7f7f3c6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:07.378777 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2a8c885b-fe65-42a6-8dae-58e8b7f7f3c6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:07.379208 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2a8c885b-fe65-42a6-8dae-58e8b7f7f3c6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:07.507484 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2a8c885b-fe65-42a6-8dae-58e8b7f7f3c6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:07.516076 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2a8c885b-fe65-42a6-8dae-58e8b7f7f3c6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:07.517556 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2a8c885b-fe65-42a6-8dae-58e8b7f7f3c6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:07.518690 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2a8c885b-fe65-42a6-8dae-58e8b7f7f3c6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1725 microversion: 2.20 time: 0.152526 Mar 03 02:33:07.519265 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 190/391] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:07 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:33:07.533504 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b6f75379-afcf-4186-abd6-486cdc73c2d4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:07.534132 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b6f75379-afcf-4186-abd6-486cdc73c2d4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:07.539883 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b6f75379-afcf-4186-abd6-486cdc73c2d4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:07.540339 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b6f75379-afcf-4186-abd6-486cdc73c2d4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:07.541112 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b6f75379-afcf-4186-abd6-486cdc73c2d4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:07.541549 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b6f75379-afcf-4186-abd6-486cdc73c2d4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:07.608145 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-700b6878-b6cf-4108-859a-121fdedb4f04 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:07.608754 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-700b6878-b6cf-4108-859a-121fdedb4f04 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:07.614489 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-700b6878-b6cf-4108-859a-121fdedb4f04 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:07.614946 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-700b6878-b6cf-4108-859a-121fdedb4f04 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:07.615754 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-700b6878-b6cf-4108-859a-121fdedb4f04 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:07.616195 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-700b6878-b6cf-4108-859a-121fdedb4f04 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:07.689384 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b6f75379-afcf-4186-abd6-486cdc73c2d4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:07.705773 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b6f75379-afcf-4186-abd6-486cdc73c2d4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1720 microversion: 2.1 time: 0.176095 Mar 03 02:33:07.706496 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 202/392] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:07 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1720 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:07.767753 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-700b6878-b6cf-4108-859a-121fdedb4f04 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:07.775183 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-700b6878-b6cf-4108-859a-121fdedb4f04 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1319 microversion: 2.1 time: 0.171705 Mar 03 02:33:07.775869 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 191/393] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:07 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:33:08.324316 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b99b28d8-9aa8-498f-8116-f28bcdaa8938 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:08.324919 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b99b28d8-9aa8-498f-8116-f28bcdaa8938 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:08.331127 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b99b28d8-9aa8-498f-8116-f28bcdaa8938 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:08.331573 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b99b28d8-9aa8-498f-8116-f28bcdaa8938 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:08.332370 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b99b28d8-9aa8-498f-8116-f28bcdaa8938 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:08.332809 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b99b28d8-9aa8-498f-8116-f28bcdaa8938 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:08.465642 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b99b28d8-9aa8-498f-8116-f28bcdaa8938 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:08.472828 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b99b28d8-9aa8-498f-8116-f28bcdaa8938 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1317 microversion: 2.1 time: 0.152406 Mar 03 02:33:08.473390 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 203/394] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:08 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:08.535923 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-67a2f75b-5c60-4ae1-918b-1620bf7fc88f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:08.536439 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-67a2f75b-5c60-4ae1-918b-1620bf7fc88f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:08.542678 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-67a2f75b-5c60-4ae1-918b-1620bf7fc88f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:08.543125 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-67a2f75b-5c60-4ae1-918b-1620bf7fc88f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:08.543917 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-67a2f75b-5c60-4ae1-918b-1620bf7fc88f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:08.544347 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-67a2f75b-5c60-4ae1-918b-1620bf7fc88f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:08.673719 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-67a2f75b-5c60-4ae1-918b-1620bf7fc88f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:08.681326 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-67a2f75b-5c60-4ae1-918b-1620bf7fc88f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:08.682895 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-67a2f75b-5c60-4ae1-918b-1620bf7fc88f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:08.684081 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-67a2f75b-5c60-4ae1-918b-1620bf7fc88f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1725 microversion: 2.20 time: 0.152191 Mar 03 02:33:08.684825 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 192/395] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:08 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:33:08.722237 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-07bfa573-c2dd-42f4-9244-5f547b2c39c2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:08.722858 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-07bfa573-c2dd-42f4-9244-5f547b2c39c2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:08.728829 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-07bfa573-c2dd-42f4-9244-5f547b2c39c2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:08.729277 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-07bfa573-c2dd-42f4-9244-5f547b2c39c2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:08.730555 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-07bfa573-c2dd-42f4-9244-5f547b2c39c2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:08.731019 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-07bfa573-c2dd-42f4-9244-5f547b2c39c2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:08.794030 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2aa8765c-0ca6-4190-9287-c474fbc754fe tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:08.794559 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2aa8765c-0ca6-4190-9287-c474fbc754fe tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:08.801758 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2aa8765c-0ca6-4190-9287-c474fbc754fe tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:08.802202 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2aa8765c-0ca6-4190-9287-c474fbc754fe tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:08.802985 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2aa8765c-0ca6-4190-9287-c474fbc754fe tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:08.803416 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2aa8765c-0ca6-4190-9287-c474fbc754fe tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:08.870038 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-07bfa573-c2dd-42f4-9244-5f547b2c39c2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:08.878834 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-07bfa573-c2dd-42f4-9244-5f547b2c39c2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1720 microversion: 2.1 time: 0.160419 Mar 03 02:33:08.879415 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 204/396] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:08 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:08.936687 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2aa8765c-0ca6-4190-9287-c474fbc754fe tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:08.943871 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2aa8765c-0ca6-4190-9287-c474fbc754fe tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1319 microversion: 2.1 time: 0.154274 Mar 03 02:33:08.944439 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 193/397] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:08 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:33:09.489730 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8915e4a2-8080-4330-8cd5-c8a73ed0ecfe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:09.490329 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8915e4a2-8080-4330-8cd5-c8a73ed0ecfe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:09.496868 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8915e4a2-8080-4330-8cd5-c8a73ed0ecfe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:09.497311 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8915e4a2-8080-4330-8cd5-c8a73ed0ecfe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:09.498082 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8915e4a2-8080-4330-8cd5-c8a73ed0ecfe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:09.498511 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8915e4a2-8080-4330-8cd5-c8a73ed0ecfe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:09.625912 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8915e4a2-8080-4330-8cd5-c8a73ed0ecfe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:09.633125 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8915e4a2-8080-4330-8cd5-c8a73ed0ecfe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1317 microversion: 2.1 time: 0.147212 Mar 03 02:33:09.633696 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 205/398] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:09 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:09.702845 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-fedb89e7-7269-4f2d-9671-05d08575999b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:09.703464 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-fedb89e7-7269-4f2d-9671-05d08575999b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:09.709343 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fedb89e7-7269-4f2d-9671-05d08575999b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:09.709788 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fedb89e7-7269-4f2d-9671-05d08575999b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:09.710581 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fedb89e7-7269-4f2d-9671-05d08575999b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:09.711011 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fedb89e7-7269-4f2d-9671-05d08575999b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:09.844306 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-fedb89e7-7269-4f2d-9671-05d08575999b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:09.851971 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-fedb89e7-7269-4f2d-9671-05d08575999b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:09.853485 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-fedb89e7-7269-4f2d-9671-05d08575999b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:09.855280 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-fedb89e7-7269-4f2d-9671-05d08575999b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1725 microversion: 2.20 time: 0.156431 Mar 03 02:33:09.855947 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 194/399] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:09 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:33:09.896973 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0734a838-7b99-482c-8d1e-bf1d114976e1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:09.897543 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0734a838-7b99-482c-8d1e-bf1d114976e1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:09.904481 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0734a838-7b99-482c-8d1e-bf1d114976e1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:09.904957 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0734a838-7b99-482c-8d1e-bf1d114976e1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:09.905769 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0734a838-7b99-482c-8d1e-bf1d114976e1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:09.906288 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0734a838-7b99-482c-8d1e-bf1d114976e1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:09.962092 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-42f6ced9-959e-49c7-96fb-273ea9fa14bc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:09.962904 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-42f6ced9-959e-49c7-96fb-273ea9fa14bc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:09.970177 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-42f6ced9-959e-49c7-96fb-273ea9fa14bc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:09.970622 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-42f6ced9-959e-49c7-96fb-273ea9fa14bc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:09.971410 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-42f6ced9-959e-49c7-96fb-273ea9fa14bc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:09.971980 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-42f6ced9-959e-49c7-96fb-273ea9fa14bc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:10.056893 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0734a838-7b99-482c-8d1e-bf1d114976e1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:10.066665 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0734a838-7b99-482c-8d1e-bf1d114976e1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1720 microversion: 2.1 time: 0.173714 Mar 03 02:33:10.067488 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 206/400] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:09 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1720 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:10.125614 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-42f6ced9-959e-49c7-96fb-273ea9fa14bc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:10.133081 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-42f6ced9-959e-49c7-96fb-273ea9fa14bc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1319 microversion: 2.1 time: 0.175813 Mar 03 02:33:10.133679 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 195/401] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:09 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:10.650053 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c75d4028-936b-406f-800b-c868f8eb360f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:10.650795 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c75d4028-936b-406f-800b-c868f8eb360f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:10.657190 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c75d4028-936b-406f-800b-c868f8eb360f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:10.657642 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c75d4028-936b-406f-800b-c868f8eb360f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:10.658422 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c75d4028-936b-406f-800b-c868f8eb360f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:10.658866 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c75d4028-936b-406f-800b-c868f8eb360f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:10.789119 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c75d4028-936b-406f-800b-c868f8eb360f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:10.797190 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c75d4028-936b-406f-800b-c868f8eb360f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1317 microversion: 2.1 time: 0.150891 Mar 03 02:33:10.797978 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 207/402] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:10 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:10.874079 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6e70d8d5-af0b-4d58-8761-1c70c54418ed tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:10.874674 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6e70d8d5-af0b-4d58-8761-1c70c54418ed tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:10.881041 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6e70d8d5-af0b-4d58-8761-1c70c54418ed tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:10.881533 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6e70d8d5-af0b-4d58-8761-1c70c54418ed tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:10.882347 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6e70d8d5-af0b-4d58-8761-1c70c54418ed tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:10.882813 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6e70d8d5-af0b-4d58-8761-1c70c54418ed tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:11.015240 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6e70d8d5-af0b-4d58-8761-1c70c54418ed tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:11.023001 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6e70d8d5-af0b-4d58-8761-1c70c54418ed tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:11.024545 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6e70d8d5-af0b-4d58-8761-1c70c54418ed tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:11.025698 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6e70d8d5-af0b-4d58-8761-1c70c54418ed tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1725 microversion: 2.20 time: 0.156262 Mar 03 02:33:11.026263 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 196/403] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:10 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:33:11.085438 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-149181c5-95ad-4fc5-bd09-6b834f2c3c43 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:11.086037 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-149181c5-95ad-4fc5-bd09-6b834f2c3c43 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:11.092915 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-149181c5-95ad-4fc5-bd09-6b834f2c3c43 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:11.093363 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-149181c5-95ad-4fc5-bd09-6b834f2c3c43 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:11.094129 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-149181c5-95ad-4fc5-bd09-6b834f2c3c43 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:11.094595 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-149181c5-95ad-4fc5-bd09-6b834f2c3c43 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:11.150189 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-bbcd96c5-f282-4a6b-80e5-bd7fe9dc6554 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:11.150792 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-bbcd96c5-f282-4a6b-80e5-bd7fe9dc6554 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:11.157294 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bbcd96c5-f282-4a6b-80e5-bd7fe9dc6554 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:11.157735 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bbcd96c5-f282-4a6b-80e5-bd7fe9dc6554 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:11.158515 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bbcd96c5-f282-4a6b-80e5-bd7fe9dc6554 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:11.158946 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bbcd96c5-f282-4a6b-80e5-bd7fe9dc6554 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:11.225250 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-149181c5-95ad-4fc5-bd09-6b834f2c3c43 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:11.234360 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-149181c5-95ad-4fc5-bd09-6b834f2c3c43 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1720 microversion: 2.1 time: 0.152722 Mar 03 02:33:11.234939 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 208/404] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:11 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:11.292878 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-bbcd96c5-f282-4a6b-80e5-bd7fe9dc6554 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:11.300147 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-bbcd96c5-f282-4a6b-80e5-bd7fe9dc6554 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1507 microversion: 2.1 time: 0.153780 Mar 03 02:33:11.300710 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 197/405] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:11 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:33:11.815181 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-469dcb3f-4acb-4770-be68-70b1590c8fc1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:11.815866 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-469dcb3f-4acb-4770-be68-70b1590c8fc1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:11.822191 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-469dcb3f-4acb-4770-be68-70b1590c8fc1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:11.822667 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-469dcb3f-4acb-4770-be68-70b1590c8fc1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:11.824337 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-469dcb3f-4acb-4770-be68-70b1590c8fc1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:11.824835 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-469dcb3f-4acb-4770-be68-70b1590c8fc1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:11.966280 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-469dcb3f-4acb-4770-be68-70b1590c8fc1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:11.973783 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-469dcb3f-4acb-4770-be68-70b1590c8fc1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1317 microversion: 2.1 time: 0.162609 Mar 03 02:33:11.974421 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 209/406] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:11 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:12.044577 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b4b4bc5f-609f-439d-aae1-c987bf8c7e5c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:12.045198 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b4b4bc5f-609f-439d-aae1-c987bf8c7e5c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:12.051729 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b4b4bc5f-609f-439d-aae1-c987bf8c7e5c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:12.052181 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b4b4bc5f-609f-439d-aae1-c987bf8c7e5c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:12.052963 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b4b4bc5f-609f-439d-aae1-c987bf8c7e5c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:12.053725 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b4b4bc5f-609f-439d-aae1-c987bf8c7e5c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:12.195287 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b4b4bc5f-609f-439d-aae1-c987bf8c7e5c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:12.204570 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b4b4bc5f-609f-439d-aae1-c987bf8c7e5c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:12.206059 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b4b4bc5f-609f-439d-aae1-c987bf8c7e5c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:12.207207 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b4b4bc5f-609f-439d-aae1-c987bf8c7e5c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1725 microversion: 2.20 time: 0.166811 Mar 03 02:33:12.207849 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 198/407] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:12 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:33:12.252108 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-aa30d46f-5e19-4edd-9e7f-2babdda79b00 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:12.252766 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-aa30d46f-5e19-4edd-9e7f-2babdda79b00 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:12.259310 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aa30d46f-5e19-4edd-9e7f-2babdda79b00 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:12.259810 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aa30d46f-5e19-4edd-9e7f-2babdda79b00 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:12.260602 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aa30d46f-5e19-4edd-9e7f-2babdda79b00 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:12.261089 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aa30d46f-5e19-4edd-9e7f-2babdda79b00 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:12.393748 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-aa30d46f-5e19-4edd-9e7f-2babdda79b00 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:12.401891 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-aa30d46f-5e19-4edd-9e7f-2babdda79b00 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1720 microversion: 2.1 time: 0.153653 Mar 03 02:33:12.402472 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 210/408] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:12 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:12.990024 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d0a069f6-9c31-436a-a21a-248d119e7df5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:12.990615 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d0a069f6-9c31-436a-a21a-248d119e7df5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:12.997618 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d0a069f6-9c31-436a-a21a-248d119e7df5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:12.998018 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d0a069f6-9c31-436a-a21a-248d119e7df5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:12.998781 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d0a069f6-9c31-436a-a21a-248d119e7df5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:12.999220 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d0a069f6-9c31-436a-a21a-248d119e7df5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:13.136913 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d0a069f6-9c31-436a-a21a-248d119e7df5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:13.143993 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d0a069f6-9c31-436a-a21a-248d119e7df5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1317 microversion: 2.1 time: 0.157751 Mar 03 02:33:13.144586 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 199/409] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:12 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:13.224737 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1a47b5ac-4ee2-427a-88ad-2fed0477679f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:13.225342 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1a47b5ac-4ee2-427a-88ad-2fed0477679f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:13.232454 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1a47b5ac-4ee2-427a-88ad-2fed0477679f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:13.232984 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1a47b5ac-4ee2-427a-88ad-2fed0477679f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:13.233989 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1a47b5ac-4ee2-427a-88ad-2fed0477679f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:13.234524 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1a47b5ac-4ee2-427a-88ad-2fed0477679f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:13.373080 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1a47b5ac-4ee2-427a-88ad-2fed0477679f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:13.381307 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1a47b5ac-4ee2-427a-88ad-2fed0477679f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:13.382885 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1a47b5ac-4ee2-427a-88ad-2fed0477679f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:13.384109 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1a47b5ac-4ee2-427a-88ad-2fed0477679f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1725 microversion: 2.20 time: 0.163315 Mar 03 02:33:13.384694 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 211/410] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:13 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:33:13.419572 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e2cfa94e-e813-49a9-9a51-3203a0d54a22 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:13.420195 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e2cfa94e-e813-49a9-9a51-3203a0d54a22 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:13.425992 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e2cfa94e-e813-49a9-9a51-3203a0d54a22 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:13.426436 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e2cfa94e-e813-49a9-9a51-3203a0d54a22 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:13.427206 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e2cfa94e-e813-49a9-9a51-3203a0d54a22 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:13.427659 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e2cfa94e-e813-49a9-9a51-3203a0d54a22 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:13.577762 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e2cfa94e-e813-49a9-9a51-3203a0d54a22 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:13.586364 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e2cfa94e-e813-49a9-9a51-3203a0d54a22 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1720 microversion: 2.1 time: 0.171252 Mar 03 02:33:13.586968 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 200/411] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:13 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:13.712757 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [req-98b085c3-3147-4ba2-afdf-4d09c0b66e20 req-2bdaa896-44b7-4ad9-81b2-8fed7fa7bc48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e1ff924-aedc-41f0-84df-c1ba81e1a936", "name": "network-vif-plugged", "status": "completed", "tag": "d0bef6ed-58b8-4206-9b29-ca505fda1e79"}]} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:33:13.721724 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-98b085c3-3147-4ba2-afdf-4d09c0b66e20 req-2bdaa896-44b7-4ad9-81b2-8fed7fa7bc48 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:13.722175 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-98b085c3-3147-4ba2-afdf-4d09c0b66e20 req-2bdaa896-44b7-4ad9-81b2-8fed7fa7bc48 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:13.733358 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.compute.server_external_events [req-98b085c3-3147-4ba2-afdf-4d09c0b66e20 req-2bdaa896-44b7-4ad9-81b2-8fed7fa7bc48 service nova] Creating event network-vif-plugged:d0bef6ed-58b8-4206-9b29-ca505fda1e79 for instance 9e1ff924-aedc-41f0-84df-c1ba81e1a936 on hv-cinder-81977 Mar 03 02:33:13.739685 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [req-98b085c3-3147-4ba2-afdf-4d09c0b66e20 req-2bdaa896-44b7-4ad9-81b2-8fed7fa7bc48 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030496 Mar 03 02:33:13.740820 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 212/412] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:33:14.162213 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2a4662c2-109c-4eb4-ab62-3f041a047fbb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:14.162837 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2a4662c2-109c-4eb4-ab62-3f041a047fbb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:14.169860 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2a4662c2-109c-4eb4-ab62-3f041a047fbb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:14.170306 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2a4662c2-109c-4eb4-ab62-3f041a047fbb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:14.171098 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2a4662c2-109c-4eb4-ab62-3f041a047fbb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:14.171531 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2a4662c2-109c-4eb4-ab62-3f041a047fbb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:14.310299 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2a4662c2-109c-4eb4-ab62-3f041a047fbb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:14.317665 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2a4662c2-109c-4eb4-ab62-3f041a047fbb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1317 microversion: 2.1 time: 0.159191 Mar 03 02:33:14.318311 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 201/413] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:14 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:33:14.404082 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5b04a912-9211-464a-a105-7294ce7a4683 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:14.404777 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5b04a912-9211-464a-a105-7294ce7a4683 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:14.411360 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5b04a912-9211-464a-a105-7294ce7a4683 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:14.411844 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5b04a912-9211-464a-a105-7294ce7a4683 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:14.412668 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5b04a912-9211-464a-a105-7294ce7a4683 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:14.413105 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5b04a912-9211-464a-a105-7294ce7a4683 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:14.546013 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5b04a912-9211-464a-a105-7294ce7a4683 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:14.553732 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5b04a912-9211-464a-a105-7294ce7a4683 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:14.555236 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5b04a912-9211-464a-a105-7294ce7a4683 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:14.556405 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5b04a912-9211-464a-a105-7294ce7a4683 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1725 microversion: 2.20 time: 0.157861 Mar 03 02:33:14.556964 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 213/414] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:14 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:33:14.603817 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4e0fdaa5-7c70-4291-a85d-e4c08ffe8cad tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:14.604754 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4e0fdaa5-7c70-4291-a85d-e4c08ffe8cad tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:14.611097 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4e0fdaa5-7c70-4291-a85d-e4c08ffe8cad tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:14.611634 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4e0fdaa5-7c70-4291-a85d-e4c08ffe8cad tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:14.612455 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4e0fdaa5-7c70-4291-a85d-e4c08ffe8cad tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:14.612936 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4e0fdaa5-7c70-4291-a85d-e4c08ffe8cad tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:14.752577 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4e0fdaa5-7c70-4291-a85d-e4c08ffe8cad tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:14.760475 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4e0fdaa5-7c70-4291-a85d-e4c08ffe8cad tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1720 microversion: 2.1 time: 0.160898 Mar 03 02:33:14.761979 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 202/415] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:14 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:15.334209 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-293b4a02-c311-46a1-a193-136bf35a9ec1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:15.334818 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-293b4a02-c311-46a1-a193-136bf35a9ec1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:15.341629 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-293b4a02-c311-46a1-a193-136bf35a9ec1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:15.342111 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-293b4a02-c311-46a1-a193-136bf35a9ec1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:15.342926 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-293b4a02-c311-46a1-a193-136bf35a9ec1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:15.343356 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-293b4a02-c311-46a1-a193-136bf35a9ec1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:15.481813 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-293b4a02-c311-46a1-a193-136bf35a9ec1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:15.489016 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-293b4a02-c311-46a1-a193-136bf35a9ec1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1317 microversion: 2.1 time: 0.158600 Mar 03 02:33:15.489710 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 214/416] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:15 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:15.574521 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-05c128fb-74cc-4a2f-96d8-72ac2e76bd6c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:15.575234 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-05c128fb-74cc-4a2f-96d8-72ac2e76bd6c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:15.581480 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-05c128fb-74cc-4a2f-96d8-72ac2e76bd6c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:15.582383 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-05c128fb-74cc-4a2f-96d8-72ac2e76bd6c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:15.583174 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-05c128fb-74cc-4a2f-96d8-72ac2e76bd6c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:15.583624 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-05c128fb-74cc-4a2f-96d8-72ac2e76bd6c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:15.779091 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-966a7d79-090f-49f7-8512-3abdff932219 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:15.779947 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-966a7d79-090f-49f7-8512-3abdff932219 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:15.789478 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-966a7d79-090f-49f7-8512-3abdff932219 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:15.790220 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-05c128fb-74cc-4a2f-96d8-72ac2e76bd6c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:15.790757 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-966a7d79-090f-49f7-8512-3abdff932219 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:15.793519 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-966a7d79-090f-49f7-8512-3abdff932219 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:15.796668 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-966a7d79-090f-49f7-8512-3abdff932219 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:15.802617 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-05c128fb-74cc-4a2f-96d8-72ac2e76bd6c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:15.804240 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-05c128fb-74cc-4a2f-96d8-72ac2e76bd6c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:15.805679 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-05c128fb-74cc-4a2f-96d8-72ac2e76bd6c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1746 microversion: 2.20 time: 0.235317 Mar 03 02:33:15.806567 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 203/417] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:15 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1746 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:33:15.997428 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-966a7d79-090f-49f7-8512-3abdff932219 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:16.008632 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-966a7d79-090f-49f7-8512-3abdff932219 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1720 microversion: 2.1 time: 0.233936 Mar 03 02:33:16.009335 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 215/418] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:15 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1720 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:16.506426 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-38ea415d-4415-4e5e-933a-d13e5e893f2f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:16.507035 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-38ea415d-4415-4e5e-933a-d13e5e893f2f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:16.513198 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-38ea415d-4415-4e5e-933a-d13e5e893f2f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:16.513646 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-38ea415d-4415-4e5e-933a-d13e5e893f2f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:16.514438 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-38ea415d-4415-4e5e-933a-d13e5e893f2f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:16.514876 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-38ea415d-4415-4e5e-933a-d13e5e893f2f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:16.649115 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-38ea415d-4415-4e5e-933a-d13e5e893f2f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:16.657307 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-38ea415d-4415-4e5e-933a-d13e5e893f2f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1506 microversion: 2.1 time: 0.154845 Mar 03 02:33:16.657870 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 204/419] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:16 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:16.825094 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6eb55d2a-3cbc-4742-aa70-844ad5940e85 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:16.825709 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6eb55d2a-3cbc-4742-aa70-844ad5940e85 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:16.832223 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6eb55d2a-3cbc-4742-aa70-844ad5940e85 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:16.832689 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6eb55d2a-3cbc-4742-aa70-844ad5940e85 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:16.833549 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6eb55d2a-3cbc-4742-aa70-844ad5940e85 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:16.833987 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6eb55d2a-3cbc-4742-aa70-844ad5940e85 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:16.985400 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-6eb55d2a-3cbc-4742-aa70-844ad5940e85 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:16.993432 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-6eb55d2a-3cbc-4742-aa70-844ad5940e85 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:16.994938 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-6eb55d2a-3cbc-4742-aa70-844ad5940e85 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:16.997172 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6eb55d2a-3cbc-4742-aa70-844ad5940e85 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1746 microversion: 2.20 time: 0.176396 Mar 03 02:33:16.997732 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 216/420] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:16 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1746 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:33:17.026233 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a5d1f2b5-3021-43e4-a721-b7a414bd6586 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:17.026830 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a5d1f2b5-3021-43e4-a721-b7a414bd6586 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:17.032797 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a5d1f2b5-3021-43e4-a721-b7a414bd6586 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:17.033244 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a5d1f2b5-3021-43e4-a721-b7a414bd6586 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:17.034020 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a5d1f2b5-3021-43e4-a721-b7a414bd6586 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:17.034454 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a5d1f2b5-3021-43e4-a721-b7a414bd6586 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:17.170786 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a5d1f2b5-3021-43e4-a721-b7a414bd6586 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:17.178895 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a5d1f2b5-3021-43e4-a721-b7a414bd6586 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1720 microversion: 2.1 time: 0.156529 Mar 03 02:33:17.179460 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 205/421] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:17 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:17.990380 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4575d1a1-3165-400d-bc0b-79a94443a752 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "795f3920-97fc-4bcf-a649-ea1751089ed7"}} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:33:17.991479 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4575d1a1-3165-400d-bc0b-79a94443a752 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:17.998320 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4575d1a1-3165-400d-bc0b-79a94443a752 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:17.998770 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4575d1a1-3165-400d-bc0b-79a94443a752 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:17.999557 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4575d1a1-3165-400d-bc0b-79a94443a752 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:18.000186 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4575d1a1-3165-400d-bc0b-79a94443a752 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:18.020704 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e3f80886-58f5-4749-b108-12fd9fc869e1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:18.022620 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e3f80886-58f5-4749-b108-12fd9fc869e1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:18.029380 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e3f80886-58f5-4749-b108-12fd9fc869e1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:18.030036 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e3f80886-58f5-4749-b108-12fd9fc869e1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:18.030843 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e3f80886-58f5-4749-b108-12fd9fc869e1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:18.031286 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e3f80886-58f5-4749-b108-12fd9fc869e1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:18.176954 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e3f80886-58f5-4749-b108-12fd9fc869e1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:18.185707 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e3f80886-58f5-4749-b108-12fd9fc869e1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:18.188138 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e3f80886-58f5-4749-b108-12fd9fc869e1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:18.188854 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e3f80886-58f5-4749-b108-12fd9fc869e1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1746 microversion: 2.20 time: 0.177297 Mar 03 02:33:18.189422 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 206/422] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:18 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1746 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:33:18.198795 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d192ee5b-620e-461f-a1f8-0687491914cf tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:18.199432 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d192ee5b-620e-461f-a1f8-0687491914cf tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:18.216302 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d192ee5b-620e-461f-a1f8-0687491914cf tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:18.216826 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d192ee5b-620e-461f-a1f8-0687491914cf tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:18.220654 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d192ee5b-620e-461f-a1f8-0687491914cf tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:18.221194 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d192ee5b-620e-461f-a1f8-0687491914cf tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:18.322909 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4575d1a1-3165-400d-bc0b-79a94443a752 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "POST /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.336292 Mar 03 02:33:18.343738 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 217/423] 10.222.0.30 () {60 vars in 1322 bytes} [Thu Mar 3 02:33:17 2022] POST /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 194 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:33:18.402038 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d192ee5b-620e-461f-a1f8-0687491914cf tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:18.410738 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d192ee5b-620e-461f-a1f8-0687491914cf tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1720 microversion: 2.1 time: 0.218975 Mar 03 02:33:18.411316 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 207/424] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:18 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1720 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:33:19.211228 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-875d9255-f847-4962-8e4c-cba12119a069 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:19.211974 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-875d9255-f847-4962-8e4c-cba12119a069 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:19.224249 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-875d9255-f847-4962-8e4c-cba12119a069 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:19.225090 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-875d9255-f847-4962-8e4c-cba12119a069 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:19.226329 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-875d9255-f847-4962-8e4c-cba12119a069 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:19.226753 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-875d9255-f847-4962-8e4c-cba12119a069 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:19.404002 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2049ebf8-a4f1-4d20-a3c7-d029ca7a1e62 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:33:19.405704 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2049ebf8-a4f1-4d20-a3c7-d029ca7a1e62 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:19.416637 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2049ebf8-a4f1-4d20-a3c7-d029ca7a1e62 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:19.418173 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2049ebf8-a4f1-4d20-a3c7-d029ca7a1e62 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:19.419237 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2049ebf8-a4f1-4d20-a3c7-d029ca7a1e62 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:19.420117 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2049ebf8-a4f1-4d20-a3c7-d029ca7a1e62 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:19.452512 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.objects.instance [None req-2049ebf8-a4f1-4d20-a3c7-d029ca7a1e62 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lazy-loading 'flavor' on Instance uuid 0b9116d7-0099-4dfe-b678-192ce74500eb {{(pid=116858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 03 02:33:19.481942 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-875d9255-f847-4962-8e4c-cba12119a069 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:19.500891 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-875d9255-f847-4962-8e4c-cba12119a069 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:19.502786 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-875d9255-f847-4962-8e4c-cba12119a069 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:19.504343 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-875d9255-f847-4962-8e4c-cba12119a069 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1741 microversion: 2.20 time: 0.298056 Mar 03 02:33:19.506815 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 218/425] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:19 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1741 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:33:19.512189 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e56919fd-d728-472c-8a2c-fbdcd2304aa8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:19.513062 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e56919fd-d728-472c-8a2c-fbdcd2304aa8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:19.525912 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e56919fd-d728-472c-8a2c-fbdcd2304aa8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:19.527628 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e56919fd-d728-472c-8a2c-fbdcd2304aa8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:19.529707 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e56919fd-d728-472c-8a2c-fbdcd2304aa8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:19.530300 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e56919fd-d728-472c-8a2c-fbdcd2304aa8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:19.661509 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2049ebf8-a4f1-4d20-a3c7-d029ca7a1e62 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "POST /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/action" status: 200 len: 32 microversion: 2.1 time: 0.262966 Mar 03 02:33:19.663076 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 208/426] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Mar 3 02:33:19 2022] POST /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/action => generated 32 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 03 02:33:19.673601 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b5e7f946-7913-4cac-a6ba-bbca7d482ea7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:19.689208 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b5e7f946-7913-4cac-a6ba-bbca7d482ea7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:19.701632 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b5e7f946-7913-4cac-a6ba-bbca7d482ea7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:19.702564 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b5e7f946-7913-4cac-a6ba-bbca7d482ea7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:19.703586 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b5e7f946-7913-4cac-a6ba-bbca7d482ea7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:19.704251 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b5e7f946-7913-4cac-a6ba-bbca7d482ea7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:19.704734 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e56919fd-d728-472c-8a2c-fbdcd2304aa8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:19.713318 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e56919fd-d728-472c-8a2c-fbdcd2304aa8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1720 microversion: 2.1 time: 0.204992 Mar 03 02:33:19.715330 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 219/427] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:19 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1720 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:19.846461 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [req-7000d9cb-b19a-436f-9e7f-7844580ed5ea req-c0f7bbb1-2efe-450c-957d-92f37080193a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7a0db60-ea15-44e4-a1ca-41531a1aa5c3", "name": "network-vif-plugged", "status": "completed", "tag": "9d68d852-474d-4287-a7c4-83666d7f71d4"}]} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:33:19.857291 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-7000d9cb-b19a-436f-9e7f-7844580ed5ea req-c0f7bbb1-2efe-450c-957d-92f37080193a service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:19.858331 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-7000d9cb-b19a-436f-9e7f-7844580ed5ea req-c0f7bbb1-2efe-450c-957d-92f37080193a service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:19.878625 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.compute.server_external_events [req-7000d9cb-b19a-436f-9e7f-7844580ed5ea req-c0f7bbb1-2efe-450c-957d-92f37080193a service nova] Creating event network-vif-plugged:9d68d852-474d-4287-a7c4-83666d7f71d4 for instance f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 on hv-cinder-81977 Mar 03 02:33:19.885204 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [req-7000d9cb-b19a-436f-9e7f-7844580ed5ea req-c0f7bbb1-2efe-450c-957d-92f37080193a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043962 Mar 03 02:33:19.888435 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 220/428] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:33:19.932931 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b5e7f946-7913-4cac-a6ba-bbca7d482ea7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:19.946407 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b5e7f946-7913-4cac-a6ba-bbca7d482ea7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1566 microversion: 2.1 time: 0.277125 Mar 03 02:33:19.946994 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 209/429] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:19 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1566 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:20.527399 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0eb412bc-1d56-48fc-a2bc-8c5b743cdc2e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:20.528239 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0eb412bc-1d56-48fc-a2bc-8c5b743cdc2e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:20.538527 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0eb412bc-1d56-48fc-a2bc-8c5b743cdc2e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:20.539211 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0eb412bc-1d56-48fc-a2bc-8c5b743cdc2e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:20.540028 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0eb412bc-1d56-48fc-a2bc-8c5b743cdc2e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:20.540462 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0eb412bc-1d56-48fc-a2bc-8c5b743cdc2e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:20.702430 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0eb412bc-1d56-48fc-a2bc-8c5b743cdc2e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:20.711365 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0eb412bc-1d56-48fc-a2bc-8c5b743cdc2e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:20.712884 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0eb412bc-1d56-48fc-a2bc-8c5b743cdc2e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:20.714984 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0eb412bc-1d56-48fc-a2bc-8c5b743cdc2e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1741 microversion: 2.20 time: 0.192913 Mar 03 02:33:20.716110 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 221/430] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:20 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1741 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:33:20.734219 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ed719b9d-34c8-4393-ae1f-e21b6c05bd27 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:20.735829 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ed719b9d-34c8-4393-ae1f-e21b6c05bd27 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:20.747356 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ed719b9d-34c8-4393-ae1f-e21b6c05bd27 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:20.747837 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ed719b9d-34c8-4393-ae1f-e21b6c05bd27 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:20.748630 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ed719b9d-34c8-4393-ae1f-e21b6c05bd27 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:20.749063 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ed719b9d-34c8-4393-ae1f-e21b6c05bd27 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:20.929358 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ed719b9d-34c8-4393-ae1f-e21b6c05bd27 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:20.938384 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ed719b9d-34c8-4393-ae1f-e21b6c05bd27 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1720 microversion: 2.1 time: 0.210123 Mar 03 02:33:20.938979 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 210/431] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:20 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1720 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:33:20.964159 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c337a0f3-9fa8-460d-85a8-f92e0d45d07f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:20.964797 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c337a0f3-9fa8-460d-85a8-f92e0d45d07f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:20.970627 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c337a0f3-9fa8-460d-85a8-f92e0d45d07f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:20.971073 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c337a0f3-9fa8-460d-85a8-f92e0d45d07f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:20.972515 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c337a0f3-9fa8-460d-85a8-f92e0d45d07f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:20.973127 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c337a0f3-9fa8-460d-85a8-f92e0d45d07f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:21.130078 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c337a0f3-9fa8-460d-85a8-f92e0d45d07f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:21.139935 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c337a0f3-9fa8-460d-85a8-f92e0d45d07f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1566 microversion: 2.1 time: 0.179599 Mar 03 02:33:21.140749 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 222/432] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:20 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1566 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:21.734549 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-69097d1d-ce80-4c11-b919-fa04cb74692a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:21.735893 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-69097d1d-ce80-4c11-b919-fa04cb74692a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:21.742480 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-69097d1d-ce80-4c11-b919-fa04cb74692a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:21.745652 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-69097d1d-ce80-4c11-b919-fa04cb74692a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:21.746815 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-69097d1d-ce80-4c11-b919-fa04cb74692a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:21.747487 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-69097d1d-ce80-4c11-b919-fa04cb74692a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:21.941487 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-69097d1d-ce80-4c11-b919-fa04cb74692a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:21.951367 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-69097d1d-ce80-4c11-b919-fa04cb74692a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:21.953236 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-69097d1d-ce80-4c11-b919-fa04cb74692a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:21.955074 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-69097d1d-ce80-4c11-b919-fa04cb74692a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1741 microversion: 2.20 time: 0.225934 Mar 03 02:33:21.955803 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 211/433] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:21 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1741 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:33:21.967364 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d55f4dfd-bb5b-4352-abc6-099bf1162cd2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:21.968008 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d55f4dfd-bb5b-4352-abc6-099bf1162cd2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:21.974365 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d55f4dfd-bb5b-4352-abc6-099bf1162cd2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:21.974818 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d55f4dfd-bb5b-4352-abc6-099bf1162cd2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:21.975683 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d55f4dfd-bb5b-4352-abc6-099bf1162cd2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:21.976065 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d55f4dfd-bb5b-4352-abc6-099bf1162cd2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:22.135231 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d55f4dfd-bb5b-4352-abc6-099bf1162cd2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:22.144489 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d55f4dfd-bb5b-4352-abc6-099bf1162cd2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1720 microversion: 2.1 time: 0.191753 Mar 03 02:33:22.145521 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 223/434] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:21 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1720 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:22.157568 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5a2285b8-ff30-4fff-99ed-9bff910c70bf tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:22.158643 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5a2285b8-ff30-4fff-99ed-9bff910c70bf tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:22.170502 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5a2285b8-ff30-4fff-99ed-9bff910c70bf tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:22.171342 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5a2285b8-ff30-4fff-99ed-9bff910c70bf tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:22.174161 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5a2285b8-ff30-4fff-99ed-9bff910c70bf tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:22.175040 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5a2285b8-ff30-4fff-99ed-9bff910c70bf tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:22.352300 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5a2285b8-ff30-4fff-99ed-9bff910c70bf tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:22.361153 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5a2285b8-ff30-4fff-99ed-9bff910c70bf tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1566 microversion: 2.1 time: 0.207587 Mar 03 02:33:22.362037 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 212/435] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:22 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1566 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:33:22.973824 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-aee624b9-cae9-4c54-92ed-1dff7fbed8a1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:22.974358 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-aee624b9-cae9-4c54-92ed-1dff7fbed8a1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:22.980566 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aee624b9-cae9-4c54-92ed-1dff7fbed8a1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:22.981353 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aee624b9-cae9-4c54-92ed-1dff7fbed8a1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:22.982194 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aee624b9-cae9-4c54-92ed-1dff7fbed8a1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:22.982667 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aee624b9-cae9-4c54-92ed-1dff7fbed8a1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:23.138849 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-aee624b9-cae9-4c54-92ed-1dff7fbed8a1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:23.147797 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-aee624b9-cae9-4c54-92ed-1dff7fbed8a1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:23.149885 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-aee624b9-cae9-4c54-92ed-1dff7fbed8a1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:23.151490 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-aee624b9-cae9-4c54-92ed-1dff7fbed8a1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1741 microversion: 2.20 time: 0.181596 Mar 03 02:33:23.152734 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 224/436] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:22 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1741 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:33:23.163876 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e3776358-3784-4a66-8b65-c7da58ba28d9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:23.164536 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e3776358-3784-4a66-8b65-c7da58ba28d9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:23.171305 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e3776358-3784-4a66-8b65-c7da58ba28d9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:23.171813 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e3776358-3784-4a66-8b65-c7da58ba28d9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:23.172757 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e3776358-3784-4a66-8b65-c7da58ba28d9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:23.173267 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e3776358-3784-4a66-8b65-c7da58ba28d9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:23.362361 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e3776358-3784-4a66-8b65-c7da58ba28d9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:23.374955 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e3776358-3784-4a66-8b65-c7da58ba28d9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1720 microversion: 2.1 time: 0.214947 Mar 03 02:33:23.378296 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4e89c44c-851e-4a63-aa8b-ec7feb94afba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:23.378693 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 213/437] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:23 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1720 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:23.378966 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4e89c44c-851e-4a63-aa8b-ec7feb94afba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:23.391474 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4e89c44c-851e-4a63-aa8b-ec7feb94afba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:23.391474 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4e89c44c-851e-4a63-aa8b-ec7feb94afba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:23.391474 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4e89c44c-851e-4a63-aa8b-ec7feb94afba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:23.391474 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4e89c44c-851e-4a63-aa8b-ec7feb94afba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:23.571704 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4e89c44c-851e-4a63-aa8b-ec7feb94afba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:23.585995 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4e89c44c-851e-4a63-aa8b-ec7feb94afba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1566 microversion: 2.1 time: 0.211563 Mar 03 02:33:23.587101 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 225/438] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:23 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1566 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:33:24.172549 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-88885256-cc0f-4240-92e9-7c6d17290cb4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:24.173293 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-88885256-cc0f-4240-92e9-7c6d17290cb4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:24.183022 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-88885256-cc0f-4240-92e9-7c6d17290cb4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:24.184407 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-88885256-cc0f-4240-92e9-7c6d17290cb4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:24.185578 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-88885256-cc0f-4240-92e9-7c6d17290cb4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:24.186014 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-88885256-cc0f-4240-92e9-7c6d17290cb4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:24.347169 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-88885256-cc0f-4240-92e9-7c6d17290cb4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:24.357713 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-88885256-cc0f-4240-92e9-7c6d17290cb4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:24.359414 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-88885256-cc0f-4240-92e9-7c6d17290cb4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:24.369527 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-88885256-cc0f-4240-92e9-7c6d17290cb4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1741 microversion: 2.20 time: 0.192049 Mar 03 02:33:24.381364 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 214/439] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:24 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1741 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:33:24.395622 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a3be621d-a24b-4420-9bfe-17f46f0d6d1a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:24.396302 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a3be621d-a24b-4420-9bfe-17f46f0d6d1a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:24.403282 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a3be621d-a24b-4420-9bfe-17f46f0d6d1a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:24.404824 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a3be621d-a24b-4420-9bfe-17f46f0d6d1a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:24.405743 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a3be621d-a24b-4420-9bfe-17f46f0d6d1a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:24.406394 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a3be621d-a24b-4420-9bfe-17f46f0d6d1a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:24.596677 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a3be621d-a24b-4420-9bfe-17f46f0d6d1a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:24.605856 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a3be621d-a24b-4420-9bfe-17f46f0d6d1a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1720 microversion: 2.1 time: 0.215748 Mar 03 02:33:24.606091 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6fce66a2-6b7f-44c5-86d6-b36ed98103d8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:24.606699 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 226/440] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:24 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1720 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:24.606821 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6fce66a2-6b7f-44c5-86d6-b36ed98103d8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:24.633695 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6fce66a2-6b7f-44c5-86d6-b36ed98103d8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:24.634184 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6fce66a2-6b7f-44c5-86d6-b36ed98103d8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:24.635000 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6fce66a2-6b7f-44c5-86d6-b36ed98103d8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:24.635441 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6fce66a2-6b7f-44c5-86d6-b36ed98103d8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:24.793615 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6fce66a2-6b7f-44c5-86d6-b36ed98103d8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:24.802027 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6fce66a2-6b7f-44c5-86d6-b36ed98103d8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1566 microversion: 2.1 time: 0.201547 Mar 03 02:33:24.802597 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 215/441] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:24 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1566 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:33:25.391455 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-41562a5c-c1a1-46ce-b485-27c63556864f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:25.392576 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-41562a5c-c1a1-46ce-b485-27c63556864f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:25.401449 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-41562a5c-c1a1-46ce-b485-27c63556864f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:25.402182 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-41562a5c-c1a1-46ce-b485-27c63556864f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:25.402689 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-41562a5c-c1a1-46ce-b485-27c63556864f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:25.403163 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-41562a5c-c1a1-46ce-b485-27c63556864f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:25.560726 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-41562a5c-c1a1-46ce-b485-27c63556864f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:25.570493 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-41562a5c-c1a1-46ce-b485-27c63556864f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:25.572150 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-41562a5c-c1a1-46ce-b485-27c63556864f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:25.574017 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-41562a5c-c1a1-46ce-b485-27c63556864f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1741 microversion: 2.20 time: 0.188361 Mar 03 02:33:25.574924 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 227/442] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:25 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1741 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:33:25.624540 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a94d361b-0fe0-4cac-93c9-8c10f8da5c3d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:25.625887 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a94d361b-0fe0-4cac-93c9-8c10f8da5c3d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:25.632447 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a94d361b-0fe0-4cac-93c9-8c10f8da5c3d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:25.633672 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a94d361b-0fe0-4cac-93c9-8c10f8da5c3d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:25.634759 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a94d361b-0fe0-4cac-93c9-8c10f8da5c3d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:25.635394 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a94d361b-0fe0-4cac-93c9-8c10f8da5c3d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:25.827875 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-03ed330b-b069-4b41-a755-a9cbd1806b29 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:25.828891 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-03ed330b-b069-4b41-a755-a9cbd1806b29 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:25.839923 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-03ed330b-b069-4b41-a755-a9cbd1806b29 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:25.840746 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-03ed330b-b069-4b41-a755-a9cbd1806b29 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:25.842145 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-03ed330b-b069-4b41-a755-a9cbd1806b29 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:25.842925 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-03ed330b-b069-4b41-a755-a9cbd1806b29 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:25.866772 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a94d361b-0fe0-4cac-93c9-8c10f8da5c3d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:25.881522 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a94d361b-0fe0-4cac-93c9-8c10f8da5c3d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1697 microversion: 2.1 time: 0.261888 Mar 03 02:33:25.891944 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 216/443] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:25 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1697 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:25.910952 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5818754e-598a-4db1-9340-4340bc9975b7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:33:25.920076 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5818754e-598a-4db1-9340-4340bc9975b7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:25.920794 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5818754e-598a-4db1-9340-4340bc9975b7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:26.039005 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5818754e-598a-4db1-9340-4340bc9975b7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Going to try to start instance {{(pid=116858) start /opt/stack/nova/nova/compute/api.py:2730}} Mar 03 02:33:26.093523 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5818754e-598a-4db1-9340-4340bc9975b7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "POST /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/action" status: 202 len: 0 microversion: 2.1 time: 0.188728 Mar 03 02:33:26.096896 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 217/444] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Mar 3 02:33:25 2022] POST /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 03 02:33:26.102650 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-95a26a36-93de-4269-bfa6-e2481a2007ed tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:26.103329 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-95a26a36-93de-4269-bfa6-e2481a2007ed tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:26.104105 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-03ed330b-b069-4b41-a755-a9cbd1806b29 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:26.111033 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-95a26a36-93de-4269-bfa6-e2481a2007ed tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:26.111492 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-95a26a36-93de-4269-bfa6-e2481a2007ed tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:26.112312 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-95a26a36-93de-4269-bfa6-e2481a2007ed tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:26.112747 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-95a26a36-93de-4269-bfa6-e2481a2007ed tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:26.114749 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-03ed330b-b069-4b41-a755-a9cbd1806b29 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1566 microversion: 2.1 time: 0.294684 Mar 03 02:33:26.115807 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 228/445] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:25 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1566 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:26.360634 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-95a26a36-93de-4269-bfa6-e2481a2007ed tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:26.376677 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-95a26a36-93de-4269-bfa6-e2481a2007ed tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1706 microversion: 2.1 time: 0.277909 Mar 03 02:33:26.377298 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 218/446] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:26 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1706 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:26.595206 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c13c8a6b-19c6-457a-8f9e-f4f0712ffad6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:26.595852 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c13c8a6b-19c6-457a-8f9e-f4f0712ffad6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:26.602858 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c13c8a6b-19c6-457a-8f9e-f4f0712ffad6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:26.603355 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c13c8a6b-19c6-457a-8f9e-f4f0712ffad6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:26.604780 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c13c8a6b-19c6-457a-8f9e-f4f0712ffad6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:26.605441 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c13c8a6b-19c6-457a-8f9e-f4f0712ffad6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:26.777278 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-65f1f244-3c16-46ed-8228-eb858f4148ed tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:26.777892 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-65f1f244-3c16-46ed-8228-eb858f4148ed tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:26.785190 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-65f1f244-3c16-46ed-8228-eb858f4148ed tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:26.785679 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-65f1f244-3c16-46ed-8228-eb858f4148ed tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:26.786808 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-65f1f244-3c16-46ed-8228-eb858f4148ed tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:26.787256 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-65f1f244-3c16-46ed-8228-eb858f4148ed tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:26.806361 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c13c8a6b-19c6-457a-8f9e-f4f0712ffad6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:26.819163 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c13c8a6b-19c6-457a-8f9e-f4f0712ffad6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:26.820693 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c13c8a6b-19c6-457a-8f9e-f4f0712ffad6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:26.828068 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c13c8a6b-19c6-457a-8f9e-f4f0712ffad6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1741 microversion: 2.20 time: 0.236810 Mar 03 02:33:26.831226 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 229/447] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:26 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1741 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:33:27.134823 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-722ab320-4136-4cf8-b2f0-577ba1aef000 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:27.136374 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-722ab320-4136-4cf8-b2f0-577ba1aef000 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:27.144377 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-722ab320-4136-4cf8-b2f0-577ba1aef000 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:27.145350 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-722ab320-4136-4cf8-b2f0-577ba1aef000 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:27.146498 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-722ab320-4136-4cf8-b2f0-577ba1aef000 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:27.147199 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-722ab320-4136-4cf8-b2f0-577ba1aef000 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:27.335729 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-722ab320-4136-4cf8-b2f0-577ba1aef000 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:27.344773 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-65f1f244-3c16-46ed-8228-eb858f4148ed tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:27.345343 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-722ab320-4136-4cf8-b2f0-577ba1aef000 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1566 microversion: 2.1 time: 0.215007 Mar 03 02:33:27.346223 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 230/448] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:27 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1566 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:33:27.353356 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-65f1f244-3c16-46ed-8228-eb858f4148ed tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1595 microversion: 2.1 time: 0.580332 Mar 03 02:33:27.356090 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 219/449] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:26 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1595 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:33:27.396656 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8e7626c0-6c28-4c1f-8978-a85784327731 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:27.397318 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8e7626c0-6c28-4c1f-8978-a85784327731 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:27.407993 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8e7626c0-6c28-4c1f-8978-a85784327731 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:27.409400 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8e7626c0-6c28-4c1f-8978-a85784327731 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:27.411581 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8e7626c0-6c28-4c1f-8978-a85784327731 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:27.412162 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8e7626c0-6c28-4c1f-8978-a85784327731 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:27.571680 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8e7626c0-6c28-4c1f-8978-a85784327731 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:27.583008 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8e7626c0-6c28-4c1f-8978-a85784327731 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1706 microversion: 2.1 time: 0.191262 Mar 03 02:33:27.585902 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 231/450] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:27 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1706 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:27.874545 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6b421a43-ade6-44bc-9645-e4eadec63f4a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:27.876062 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6b421a43-ade6-44bc-9645-e4eadec63f4a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:27.888228 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6b421a43-ade6-44bc-9645-e4eadec63f4a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:27.890660 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6b421a43-ade6-44bc-9645-e4eadec63f4a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:27.892612 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6b421a43-ade6-44bc-9645-e4eadec63f4a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:27.893310 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6b421a43-ade6-44bc-9645-e4eadec63f4a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:28.177454 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6b421a43-ade6-44bc-9645-e4eadec63f4a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:28.187370 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6b421a43-ade6-44bc-9645-e4eadec63f4a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:28.189083 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6b421a43-ade6-44bc-9645-e4eadec63f4a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:28.190246 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6b421a43-ade6-44bc-9645-e4eadec63f4a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1741 microversion: 2.20 time: 0.329432 Mar 03 02:33:28.190838 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 220/451] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:27 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1741 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:33:28.368797 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-961148f5-012e-4ac1-b6df-763a52192725 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:28.369598 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-961148f5-012e-4ac1-b6df-763a52192725 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:28.384396 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-961148f5-012e-4ac1-b6df-763a52192725 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:28.386065 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-961148f5-012e-4ac1-b6df-763a52192725 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:28.388603 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-961148f5-012e-4ac1-b6df-763a52192725 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:28.389052 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-961148f5-012e-4ac1-b6df-763a52192725 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:28.543267 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-961148f5-012e-4ac1-b6df-763a52192725 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:28.551548 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-961148f5-012e-4ac1-b6df-763a52192725 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1566 microversion: 2.1 time: 0.189020 Mar 03 02:33:28.552349 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 232/452] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:28 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1566 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:28.607963 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-578a9bac-df9c-4820-947c-210196d89a31 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:28.608723 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-578a9bac-df9c-4820-947c-210196d89a31 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:28.615891 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-578a9bac-df9c-4820-947c-210196d89a31 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:28.616675 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-578a9bac-df9c-4820-947c-210196d89a31 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:28.617633 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-578a9bac-df9c-4820-947c-210196d89a31 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:28.618294 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-578a9bac-df9c-4820-947c-210196d89a31 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:28.949980 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-578a9bac-df9c-4820-947c-210196d89a31 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:28.957724 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-578a9bac-df9c-4820-947c-210196d89a31 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1706 microversion: 2.1 time: 0.354189 Mar 03 02:33:28.958318 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 221/453] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:28 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1706 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:29.210424 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3ba61700-c1fd-47f3-bd6b-d979785d1db7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:29.211128 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3ba61700-c1fd-47f3-bd6b-d979785d1db7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:29.217515 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3ba61700-c1fd-47f3-bd6b-d979785d1db7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:29.218033 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3ba61700-c1fd-47f3-bd6b-d979785d1db7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:29.218882 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3ba61700-c1fd-47f3-bd6b-d979785d1db7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:29.219385 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3ba61700-c1fd-47f3-bd6b-d979785d1db7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:29.361532 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3ba61700-c1fd-47f3-bd6b-d979785d1db7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:29.369173 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3ba61700-c1fd-47f3-bd6b-d979785d1db7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:29.371700 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3ba61700-c1fd-47f3-bd6b-d979785d1db7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:29.372855 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3ba61700-c1fd-47f3-bd6b-d979785d1db7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1741 microversion: 2.20 time: 0.166293 Mar 03 02:33:29.373414 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 233/454] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:29 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1741 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:33:29.569400 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-35d47435-f7ba-4fc1-9161-21afd41a83f8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:29.570063 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-35d47435-f7ba-4fc1-9161-21afd41a83f8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:29.577319 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-35d47435-f7ba-4fc1-9161-21afd41a83f8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:29.577941 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-35d47435-f7ba-4fc1-9161-21afd41a83f8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:29.579024 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-35d47435-f7ba-4fc1-9161-21afd41a83f8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:29.579761 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-35d47435-f7ba-4fc1-9161-21afd41a83f8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:29.975553 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2117d1bd-54f4-401b-bee0-9a75b11cde57 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:29.976100 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2117d1bd-54f4-401b-bee0-9a75b11cde57 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:29.980917 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-35d47435-f7ba-4fc1-9161-21afd41a83f8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:29.989478 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2117d1bd-54f4-401b-bee0-9a75b11cde57 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:29.989924 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2117d1bd-54f4-401b-bee0-9a75b11cde57 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:29.990713 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2117d1bd-54f4-401b-bee0-9a75b11cde57 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:29.991148 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2117d1bd-54f4-401b-bee0-9a75b11cde57 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:30.004446 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-35d47435-f7ba-4fc1-9161-21afd41a83f8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1566 microversion: 2.1 time: 0.438394 Mar 03 02:33:30.006020 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 222/455] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:29 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1566 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:30.098732 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [req-2adbfe4b-eea8-42c7-ba1e-6c8f0d16ce0f req-dea2a2a5-d3b3-419a-a4cc-8ff328909424 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0df5e3af-dfd2-431d-83af-1a2a02019651", "tag": "92ff8971-ee17-4845-81d7-3a348747a57d"}]} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:33:30.129447 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-2adbfe4b-eea8-42c7-ba1e-6c8f0d16ce0f req-dea2a2a5-d3b3-419a-a4cc-8ff328909424 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:30.130580 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-2adbfe4b-eea8-42c7-ba1e-6c8f0d16ce0f req-dea2a2a5-d3b3-419a-a4cc-8ff328909424 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:30.156329 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.compute.server_external_events [req-2adbfe4b-eea8-42c7-ba1e-6c8f0d16ce0f req-dea2a2a5-d3b3-419a-a4cc-8ff328909424 service nova] Creating event network-changed:92ff8971-ee17-4845-81d7-3a348747a57d for instance 0df5e3af-dfd2-431d-83af-1a2a02019651 on hv-cinder-81977 Mar 03 02:33:30.168546 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [req-2adbfe4b-eea8-42c7-ba1e-6c8f0d16ce0f req-dea2a2a5-d3b3-419a-a4cc-8ff328909424 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084369 Mar 03 02:33:30.174788 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 223/456] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:33:30.364270 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2117d1bd-54f4-401b-bee0-9a75b11cde57 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:30.374330 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2117d1bd-54f4-401b-bee0-9a75b11cde57 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1710 microversion: 2.1 time: 0.403147 Mar 03 02:33:30.375367 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 234/457] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:29 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1710 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:33:30.392962 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-90e14403-88d1-4c24-aef2-ca02ecc3165c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:30.393675 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-90e14403-88d1-4c24-aef2-ca02ecc3165c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:30.399777 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-90e14403-88d1-4c24-aef2-ca02ecc3165c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:30.400771 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-90e14403-88d1-4c24-aef2-ca02ecc3165c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:30.402168 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-90e14403-88d1-4c24-aef2-ca02ecc3165c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:30.402742 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-90e14403-88d1-4c24-aef2-ca02ecc3165c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:30.827628 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-90e14403-88d1-4c24-aef2-ca02ecc3165c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:30.836086 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-90e14403-88d1-4c24-aef2-ca02ecc3165c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:30.838688 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-90e14403-88d1-4c24-aef2-ca02ecc3165c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:30.841409 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-90e14403-88d1-4c24-aef2-ca02ecc3165c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1723 microversion: 2.20 time: 0.453651 Mar 03 02:33:30.842648 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 224/458] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:30 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1723 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:33:31.024518 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-848ac85d-800b-450b-9912-90e91934d61b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:31.025568 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-848ac85d-800b-450b-9912-90e91934d61b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:31.033074 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-848ac85d-800b-450b-9912-90e91934d61b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:31.033633 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-848ac85d-800b-450b-9912-90e91934d61b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:31.034507 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-848ac85d-800b-450b-9912-90e91934d61b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:31.035113 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-848ac85d-800b-450b-9912-90e91934d61b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:31.235529 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-848ac85d-800b-450b-9912-90e91934d61b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:31.248762 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-848ac85d-800b-450b-9912-90e91934d61b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1566 microversion: 2.1 time: 0.228349 Mar 03 02:33:31.249746 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 235/459] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:31 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1566 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:31.639443 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-bde161ee-59ea-47a9-8911-f3eaa7d286e6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1980320468"}} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:33:31.640307 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-bde161ee-59ea-47a9-8911-f3eaa7d286e6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:31.646515 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bde161ee-59ea-47a9-8911-f3eaa7d286e6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:31.646966 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bde161ee-59ea-47a9-8911-f3eaa7d286e6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:31.647812 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bde161ee-59ea-47a9-8911-f3eaa7d286e6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:31.648242 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bde161ee-59ea-47a9-8911-f3eaa7d286e6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:31.776804 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.network.security_group_api [None req-bde161ee-59ea-47a9-8911-f3eaa7d286e6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Adding security group 2529c8d4-27cd-4a19-9458-9abeafd70446 to port 92ff8971-ee17-4845-81d7-3a348747a57d Mar 03 02:33:31.860908 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c1f5030d-d043-4e88-bee4-ffa0bc9463f0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:31.861503 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c1f5030d-d043-4e88-bee4-ffa0bc9463f0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:31.867334 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c1f5030d-d043-4e88-bee4-ffa0bc9463f0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:31.867816 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c1f5030d-d043-4e88-bee4-ffa0bc9463f0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:31.868590 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c1f5030d-d043-4e88-bee4-ffa0bc9463f0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:31.869019 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c1f5030d-d043-4e88-bee4-ffa0bc9463f0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:32.009873 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c1f5030d-d043-4e88-bee4-ffa0bc9463f0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:32.017673 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c1f5030d-d043-4e88-bee4-ffa0bc9463f0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:32.019185 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c1f5030d-d043-4e88-bee4-ffa0bc9463f0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:32.020363 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c1f5030d-d043-4e88-bee4-ffa0bc9463f0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1723 microversion: 2.20 time: 0.163429 Mar 03 02:33:32.020927 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 236/460] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:31 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:33:32.132271 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-bde161ee-59ea-47a9-8911-f3eaa7d286e6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "POST /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/action" status: 202 len: 0 microversion: 2.1 time: 0.497098 Mar 03 02:33:32.133752 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 225/461] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Mar 3 02:33:31 2022] POST /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/action => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 03 02:33:32.142266 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c46571c1-6e6d-4169-8432-984f43cc655a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:32.142879 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c46571c1-6e6d-4169-8432-984f43cc655a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:32.149517 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c46571c1-6e6d-4169-8432-984f43cc655a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:32.149972 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c46571c1-6e6d-4169-8432-984f43cc655a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:32.150769 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c46571c1-6e6d-4169-8432-984f43cc655a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:32.151806 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c46571c1-6e6d-4169-8432-984f43cc655a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:32.193989 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [req-c3ed4b99-babd-43d0-a7c4-fc3babe79e63 req-ce24f457-60f5-4932-af2a-96fc5c193573 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0df5e3af-dfd2-431d-83af-1a2a02019651", "tag": "92ff8971-ee17-4845-81d7-3a348747a57d"}]} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:33:32.209627 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-c3ed4b99-babd-43d0-a7c4-fc3babe79e63 req-ce24f457-60f5-4932-af2a-96fc5c193573 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:32.210349 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-c3ed4b99-babd-43d0-a7c4-fc3babe79e63 req-ce24f457-60f5-4932-af2a-96fc5c193573 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:32.223029 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.compute.server_external_events [req-c3ed4b99-babd-43d0-a7c4-fc3babe79e63 req-ce24f457-60f5-4932-af2a-96fc5c193573 service nova] Creating event network-changed:92ff8971-ee17-4845-81d7-3a348747a57d for instance 0df5e3af-dfd2-431d-83af-1a2a02019651 on hv-cinder-81977 Mar 03 02:33:32.231935 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [req-c3ed4b99-babd-43d0-a7c4-fc3babe79e63 req-ce24f457-60f5-4932-af2a-96fc5c193573 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041924 Mar 03 02:33:32.233128 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 226/462] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:33:32.267059 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-744edfc8-9da5-4d86-843c-e29eecb762a9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:32.267797 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-744edfc8-9da5-4d86-843c-e29eecb762a9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:32.274426 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-744edfc8-9da5-4d86-843c-e29eecb762a9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:32.274883 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-744edfc8-9da5-4d86-843c-e29eecb762a9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:32.275714 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-744edfc8-9da5-4d86-843c-e29eecb762a9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:32.276686 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-744edfc8-9da5-4d86-843c-e29eecb762a9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:32.372159 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c46571c1-6e6d-4169-8432-984f43cc655a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:32.380321 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c46571c1-6e6d-4169-8432-984f43cc655a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1761 microversion: 2.1 time: 0.241907 Mar 03 02:33:32.381500 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 237/463] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:32 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1761 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:32.574009 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-744edfc8-9da5-4d86-843c-e29eecb762a9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:32.582263 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-744edfc8-9da5-4d86-843c-e29eecb762a9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1566 microversion: 2.1 time: 0.319658 Mar 03 02:33:32.582917 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 227/464] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:32 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1566 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:33:33.038780 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4129f5ea-0460-4371-b62b-d9f341850739 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:33.039382 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4129f5ea-0460-4371-b62b-d9f341850739 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:33.045423 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4129f5ea-0460-4371-b62b-d9f341850739 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:33.045867 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4129f5ea-0460-4371-b62b-d9f341850739 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:33.046668 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4129f5ea-0460-4371-b62b-d9f341850739 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:33.047099 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4129f5ea-0460-4371-b62b-d9f341850739 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:33.178027 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4129f5ea-0460-4371-b62b-d9f341850739 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:33.186335 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4129f5ea-0460-4371-b62b-d9f341850739 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:33.187858 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4129f5ea-0460-4371-b62b-d9f341850739 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:33.189003 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4129f5ea-0460-4371-b62b-d9f341850739 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1723 microversion: 2.20 time: 0.154739 Mar 03 02:33:33.189566 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 238/465] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:33 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:33:33.599526 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9e1d5d3a-a6de-4815-a21d-57bda8a3c0fd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:33.600168 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9e1d5d3a-a6de-4815-a21d-57bda8a3c0fd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:33.607112 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9e1d5d3a-a6de-4815-a21d-57bda8a3c0fd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:33.607557 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9e1d5d3a-a6de-4815-a21d-57bda8a3c0fd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:33.608352 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9e1d5d3a-a6de-4815-a21d-57bda8a3c0fd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:33.608782 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9e1d5d3a-a6de-4815-a21d-57bda8a3c0fd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:33.742740 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9e1d5d3a-a6de-4815-a21d-57bda8a3c0fd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:33.751069 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9e1d5d3a-a6de-4815-a21d-57bda8a3c0fd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1566 microversion: 2.1 time: 0.155388 Mar 03 02:33:33.751663 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 228/466] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:33 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:33.764356 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [req-3fe8f500-ada1-4a3a-b1b2-1c097a01a9ac req-91021278-c0c5-4e21-acaa-69201a5f1a67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7a0db60-ea15-44e4-a1ca-41531a1aa5c3", "name": "network-vif-unplugged", "status": "completed", "tag": "9d68d852-474d-4287-a7c4-83666d7f71d4"}]} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:33:33.772338 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-3fe8f500-ada1-4a3a-b1b2-1c097a01a9ac req-91021278-c0c5-4e21-acaa-69201a5f1a67 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:33.772791 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-3fe8f500-ada1-4a3a-b1b2-1c097a01a9ac req-91021278-c0c5-4e21-acaa-69201a5f1a67 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:33.784489 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.compute.server_external_events [req-3fe8f500-ada1-4a3a-b1b2-1c097a01a9ac req-91021278-c0c5-4e21-acaa-69201a5f1a67 service nova] Creating event network-vif-unplugged:9d68d852-474d-4287-a7c4-83666d7f71d4 for instance f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 on hv-cinder-81977 Mar 03 02:33:33.791059 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [req-3fe8f500-ada1-4a3a-b1b2-1c097a01a9ac req-91021278-c0c5-4e21-acaa-69201a5f1a67 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030438 Mar 03 02:33:33.792300 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 239/467] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:33:34.045532 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8dcf34b9-9dc3-466b-a89b-7bd210b3bfab tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ee166b3-4d10-4902-8276-13a90850bf70", "device": "/dev/sdb"}} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:33:34.047233 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8dcf34b9-9dc3-466b-a89b-7bd210b3bfab tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:34.054332 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8dcf34b9-9dc3-466b-a89b-7bd210b3bfab tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:34.054332 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8dcf34b9-9dc3-466b-a89b-7bd210b3bfab tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:34.055023 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8dcf34b9-9dc3-466b-a89b-7bd210b3bfab tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:34.055640 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8dcf34b9-9dc3-466b-a89b-7bd210b3bfab tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:34.208325 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-76ea020f-9ac7-43b2-af50-a0287a4adaa1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:34.209299 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-76ea020f-9ac7-43b2-af50-a0287a4adaa1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:34.219044 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-76ea020f-9ac7-43b2-af50-a0287a4adaa1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:34.219494 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-76ea020f-9ac7-43b2-af50-a0287a4adaa1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:34.220306 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-76ea020f-9ac7-43b2-af50-a0287a4adaa1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:34.220742 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-76ea020f-9ac7-43b2-af50-a0287a4adaa1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:34.316715 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8dcf34b9-9dc3-466b-a89b-7bd210b3bfab tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "POST /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275170 Mar 03 02:33:34.317393 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 229/468] 10.222.0.30 () {60 vars in 1322 bytes} [Thu Mar 3 02:33:34 2022] POST /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:33:34.368561 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-76ea020f-9ac7-43b2-af50-a0287a4adaa1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:34.379174 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-76ea020f-9ac7-43b2-af50-a0287a4adaa1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:34.380816 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-76ea020f-9ac7-43b2-af50-a0287a4adaa1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:34.382177 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-76ea020f-9ac7-43b2-af50-a0287a4adaa1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1723 microversion: 2.20 time: 0.178211 Mar 03 02:33:34.394875 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 240/469] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:34 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:33:34.569402 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-cd7c7a79-309f-4c75-b770-2c6cbbd01711 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:34.569971 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-cd7c7a79-309f-4c75-b770-2c6cbbd01711 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:34.576694 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cd7c7a79-309f-4c75-b770-2c6cbbd01711 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:34.577136 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cd7c7a79-309f-4c75-b770-2c6cbbd01711 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:34.577906 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cd7c7a79-309f-4c75-b770-2c6cbbd01711 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:34.578339 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cd7c7a79-309f-4c75-b770-2c6cbbd01711 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:34.697904 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.objects.instance [None req-cd7c7a79-309f-4c75-b770-2c6cbbd01711 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lazy-loading 'services' on Instance uuid 9e1ff924-aedc-41f0-84df-c1ba81e1a936 {{(pid=116858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 03 02:33:34.768479 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1d695baa-26ea-4c8e-bec8-ddb83963184e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:34.769087 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1d695baa-26ea-4c8e-bec8-ddb83963184e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:34.775862 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1d695baa-26ea-4c8e-bec8-ddb83963184e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:34.776366 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1d695baa-26ea-4c8e-bec8-ddb83963184e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:34.777178 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1d695baa-26ea-4c8e-bec8-ddb83963184e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:34.777622 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1d695baa-26ea-4c8e-bec8-ddb83963184e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:34.811526 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-cd7c7a79-309f-4c75-b770-2c6cbbd01711 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments/795f3920-97fc-4bcf-a649-ea1751089ed7" status: 202 len: 0 microversion: 2.1 time: 0.246933 Mar 03 02:33:34.812161 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 230/470] 10.222.0.30 () {58 vars in 1415 bytes} [Thu Mar 3 02:33:34 2022] DELETE /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments/795f3920-97fc-4bcf-a649-ea1751089ed7 => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 03 02:33:34.821373 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-be7478d2-afad-4a34-add0-c653073680a8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:34.823728 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-be7478d2-afad-4a34-add0-c653073680a8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:34.830245 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-be7478d2-afad-4a34-add0-c653073680a8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:34.830701 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-be7478d2-afad-4a34-add0-c653073680a8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:34.831723 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-be7478d2-afad-4a34-add0-c653073680a8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:34.832409 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-be7478d2-afad-4a34-add0-c653073680a8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:34.865963 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-be7478d2-afad-4a34-add0-c653073680a8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048598 Mar 03 02:33:34.866737 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 231/471] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:33:34 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:33:34.920983 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1d695baa-26ea-4c8e-bec8-ddb83963184e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:34.928597 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1d695baa-26ea-4c8e-bec8-ddb83963184e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1566 microversion: 2.1 time: 0.164026 Mar 03 02:33:34.929157 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 241/472] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:34 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:35.402026 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-bb0ae0d6-0053-4b71-a8c4-ae4c86642b4b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:35.402636 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-bb0ae0d6-0053-4b71-a8c4-ae4c86642b4b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:35.409184 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bb0ae0d6-0053-4b71-a8c4-ae4c86642b4b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:35.409642 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bb0ae0d6-0053-4b71-a8c4-ae4c86642b4b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:35.410496 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bb0ae0d6-0053-4b71-a8c4-ae4c86642b4b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:35.410934 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bb0ae0d6-0053-4b71-a8c4-ae4c86642b4b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:35.551543 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-bb0ae0d6-0053-4b71-a8c4-ae4c86642b4b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:35.559878 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-bb0ae0d6-0053-4b71-a8c4-ae4c86642b4b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:35.561373 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-bb0ae0d6-0053-4b71-a8c4-ae4c86642b4b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:35.562575 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-bb0ae0d6-0053-4b71-a8c4-ae4c86642b4b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1666 microversion: 2.20 time: 0.165290 Mar 03 02:33:35.563154 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 232/473] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:35 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1666 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:33:35.581095 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-eb59bcab-34fb-491b-9a1a-35c6bf0bd810 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a8c1a58-9dac-4710-bc0b-674fd3b89dbc"}} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:33:35.582126 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-eb59bcab-34fb-491b-9a1a-35c6bf0bd810 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:35.588259 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eb59bcab-34fb-491b-9a1a-35c6bf0bd810 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:35.589396 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eb59bcab-34fb-491b-9a1a-35c6bf0bd810 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:35.590256 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eb59bcab-34fb-491b-9a1a-35c6bf0bd810 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:35.590695 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eb59bcab-34fb-491b-9a1a-35c6bf0bd810 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:35.850884 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-eb59bcab-34fb-491b-9a1a-35c6bf0bd810 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "POST /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.273792 Mar 03 02:33:35.851479 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 242/474] 10.222.0.30 () {62 vars in 1363 bytes} [Thu Mar 3 02:33:35 2022] POST /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments => generated 188 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 03 02:33:35.878157 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4a92ebde-c656-4896-8d6c-60092f004300 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:35.879047 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4a92ebde-c656-4896-8d6c-60092f004300 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:35.884691 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4a92ebde-c656-4896-8d6c-60092f004300 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:35.885140 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4a92ebde-c656-4896-8d6c-60092f004300 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:35.886665 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4a92ebde-c656-4896-8d6c-60092f004300 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:35.887098 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4a92ebde-c656-4896-8d6c-60092f004300 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:35.914409 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4a92ebde-c656-4896-8d6c-60092f004300 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040115 Mar 03 02:33:35.914955 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 233/475] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:33:35 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:33:35.946184 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-bb1af1d8-d7d2-46b6-b1fd-cbd4add38a5e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:35.946795 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-bb1af1d8-d7d2-46b6-b1fd-cbd4add38a5e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:35.953990 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bb1af1d8-d7d2-46b6-b1fd-cbd4add38a5e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:35.954447 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bb1af1d8-d7d2-46b6-b1fd-cbd4add38a5e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:35.955235 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bb1af1d8-d7d2-46b6-b1fd-cbd4add38a5e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:35.955704 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bb1af1d8-d7d2-46b6-b1fd-cbd4add38a5e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:35.962842 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ff22fccb-67da-429c-b3de-b2e35a9afcbc tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:33:35.963456 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ff22fccb-67da-429c-b3de-b2e35a9afcbc tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:35.969803 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ff22fccb-67da-429c-b3de-b2e35a9afcbc tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:35.970251 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ff22fccb-67da-429c-b3de-b2e35a9afcbc tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:35.971034 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ff22fccb-67da-429c-b3de-b2e35a9afcbc tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:35.971466 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ff22fccb-67da-429c-b3de-b2e35a9afcbc tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:36.061568 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ff22fccb-67da-429c-b3de-b2e35a9afcbc tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "POST /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/action" status: 202 len: 0 microversion: 2.20 time: 0.102510 Mar 03 02:33:36.062396 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 234/476] 10.222.0.30 () {62 vars in 1318 bytes} [Thu Mar 3 02:33:35 2022] POST /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Mar 03 02:33:36.070222 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-293ca9d8-6690-4c69-be02-04e5b87e3d74 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:36.070831 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-293ca9d8-6690-4c69-be02-04e5b87e3d74 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:36.077394 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-293ca9d8-6690-4c69-be02-04e5b87e3d74 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:36.077856 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-293ca9d8-6690-4c69-be02-04e5b87e3d74 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:36.078633 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-293ca9d8-6690-4c69-be02-04e5b87e3d74 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:36.079077 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-293ca9d8-6690-4c69-be02-04e5b87e3d74 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:36.100324 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-bb1af1d8-d7d2-46b6-b1fd-cbd4add38a5e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:36.109727 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-bb1af1d8-d7d2-46b6-b1fd-cbd4add38a5e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1566 microversion: 2.1 time: 0.167360 Mar 03 02:33:36.110304 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 243/477] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:35 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:36.215608 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-293ca9d8-6690-4c69-be02-04e5b87e3d74 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:36.223817 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-293ca9d8-6690-4c69-be02-04e5b87e3d74 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:36.225396 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-293ca9d8-6690-4c69-be02-04e5b87e3d74 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:36.226643 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-293ca9d8-6690-4c69-be02-04e5b87e3d74 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1752 microversion: 2.20 time: 0.160267 Mar 03 02:33:36.227216 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 235/478] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:36 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:33:36.926175 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f1a62b07-1b33-4b3f-9740-7caadebdbd0f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:36.927357 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f1a62b07-1b33-4b3f-9740-7caadebdbd0f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:36.933573 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f1a62b07-1b33-4b3f-9740-7caadebdbd0f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:36.934020 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f1a62b07-1b33-4b3f-9740-7caadebdbd0f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:36.934853 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f1a62b07-1b33-4b3f-9740-7caadebdbd0f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:36.935229 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f1a62b07-1b33-4b3f-9740-7caadebdbd0f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:36.964867 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f1a62b07-1b33-4b3f-9740-7caadebdbd0f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042556 Mar 03 02:33:36.965420 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 244/479] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:33:36 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:33:37.127415 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ed515850-c699-4521-bd5c-5736390426a4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:37.128062 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ed515850-c699-4521-bd5c-5736390426a4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:37.135657 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ed515850-c699-4521-bd5c-5736390426a4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:37.136125 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ed515850-c699-4521-bd5c-5736390426a4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:37.136991 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ed515850-c699-4521-bd5c-5736390426a4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:37.137459 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ed515850-c699-4521-bd5c-5736390426a4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:37.247364 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0ba98c47-9051-47be-8dad-922e5d48eb59 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:37.248164 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0ba98c47-9051-47be-8dad-922e5d48eb59 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:37.254036 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0ba98c47-9051-47be-8dad-922e5d48eb59 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:37.254495 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0ba98c47-9051-47be-8dad-922e5d48eb59 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:37.255352 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0ba98c47-9051-47be-8dad-922e5d48eb59 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:37.255820 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0ba98c47-9051-47be-8dad-922e5d48eb59 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:37.273112 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ed515850-c699-4521-bd5c-5736390426a4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:37.281459 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ed515850-c699-4521-bd5c-5736390426a4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1566 microversion: 2.1 time: 0.158187 Mar 03 02:33:37.282037 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 236/480] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:37 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:37.386893 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0ba98c47-9051-47be-8dad-922e5d48eb59 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:37.395098 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0ba98c47-9051-47be-8dad-922e5d48eb59 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:37.396644 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0ba98c47-9051-47be-8dad-922e5d48eb59 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:37.397789 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0ba98c47-9051-47be-8dad-922e5d48eb59 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.156474 Mar 03 02:33:37.398537 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 245/481] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:37 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:33:37.976232 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c1bdc161-31ea-4b3d-8192-33ba6c4673b3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:37.977202 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c1bdc161-31ea-4b3d-8192-33ba6c4673b3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:37.983255 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c1bdc161-31ea-4b3d-8192-33ba6c4673b3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:37.983702 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c1bdc161-31ea-4b3d-8192-33ba6c4673b3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:37.984491 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c1bdc161-31ea-4b3d-8192-33ba6c4673b3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:37.984930 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c1bdc161-31ea-4b3d-8192-33ba6c4673b3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:38.015155 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c1bdc161-31ea-4b3d-8192-33ba6c4673b3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042799 Mar 03 02:33:38.015751 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 237/482] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:33:37 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:33:38.298350 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0d8acd56-d320-46a7-a596-38801ec086a7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:38.298953 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0d8acd56-d320-46a7-a596-38801ec086a7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:38.305307 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0d8acd56-d320-46a7-a596-38801ec086a7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:38.305706 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0d8acd56-d320-46a7-a596-38801ec086a7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:38.306486 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0d8acd56-d320-46a7-a596-38801ec086a7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:38.306924 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0d8acd56-d320-46a7-a596-38801ec086a7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:38.417981 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-fcf27deb-e83b-473d-a910-52d26c170545 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:38.418677 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-fcf27deb-e83b-473d-a910-52d26c170545 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:38.424842 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fcf27deb-e83b-473d-a910-52d26c170545 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:38.425294 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fcf27deb-e83b-473d-a910-52d26c170545 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:38.426074 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fcf27deb-e83b-473d-a910-52d26c170545 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:38.426513 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fcf27deb-e83b-473d-a910-52d26c170545 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:38.438408 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0d8acd56-d320-46a7-a596-38801ec086a7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:38.446181 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0d8acd56-d320-46a7-a596-38801ec086a7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1566 microversion: 2.1 time: 0.151615 Mar 03 02:33:38.446781 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 246/483] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:38 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:38.562837 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-fcf27deb-e83b-473d-a910-52d26c170545 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:38.570976 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-fcf27deb-e83b-473d-a910-52d26c170545 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:38.572514 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-fcf27deb-e83b-473d-a910-52d26c170545 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:38.573838 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-fcf27deb-e83b-473d-a910-52d26c170545 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.160696 Mar 03 02:33:38.574397 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 238/484] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:38 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:33:39.027072 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8c9cf507-6edf-44d2-937f-313e7f4f2858 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:39.028076 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8c9cf507-6edf-44d2-937f-313e7f4f2858 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:39.033904 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8c9cf507-6edf-44d2-937f-313e7f4f2858 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:39.034364 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8c9cf507-6edf-44d2-937f-313e7f4f2858 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:39.035113 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8c9cf507-6edf-44d2-937f-313e7f4f2858 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:39.035542 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8c9cf507-6edf-44d2-937f-313e7f4f2858 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:39.063880 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8c9cf507-6edf-44d2-937f-313e7f4f2858 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041343 Mar 03 02:33:39.064430 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 247/485] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:33:39 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:33:39.463199 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ba193bf6-6db7-4a59-8b2c-f2e7698627c2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:39.464537 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ba193bf6-6db7-4a59-8b2c-f2e7698627c2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:39.470702 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ba193bf6-6db7-4a59-8b2c-f2e7698627c2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:39.471159 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ba193bf6-6db7-4a59-8b2c-f2e7698627c2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:39.471974 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ba193bf6-6db7-4a59-8b2c-f2e7698627c2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:39.472417 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ba193bf6-6db7-4a59-8b2c-f2e7698627c2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:39.592580 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-cb7d5c60-dd73-4738-987c-792359d1565e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:39.593185 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-cb7d5c60-dd73-4738-987c-792359d1565e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:39.599311 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cb7d5c60-dd73-4738-987c-792359d1565e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:39.599805 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cb7d5c60-dd73-4738-987c-792359d1565e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:39.600600 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cb7d5c60-dd73-4738-987c-792359d1565e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:39.601043 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cb7d5c60-dd73-4738-987c-792359d1565e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:39.724637 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ba193bf6-6db7-4a59-8b2c-f2e7698627c2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:39.733359 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ba193bf6-6db7-4a59-8b2c-f2e7698627c2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1566 microversion: 2.1 time: 0.273736 Mar 03 02:33:39.733969 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 239/486] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:39 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1566 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:39.740407 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-cb7d5c60-dd73-4738-987c-792359d1565e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:39.750008 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-cb7d5c60-dd73-4738-987c-792359d1565e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:39.751493 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-cb7d5c60-dd73-4738-987c-792359d1565e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:39.752667 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-cb7d5c60-dd73-4738-987c-792359d1565e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.164704 Mar 03 02:33:39.753224 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 248/487] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:39 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:33:40.075974 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1ab20e10-8997-49a4-8d6c-3230274d1dfe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:40.076894 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1ab20e10-8997-49a4-8d6c-3230274d1dfe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:40.082907 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1ab20e10-8997-49a4-8d6c-3230274d1dfe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:40.083353 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1ab20e10-8997-49a4-8d6c-3230274d1dfe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:40.084169 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1ab20e10-8997-49a4-8d6c-3230274d1dfe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:40.084600 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1ab20e10-8997-49a4-8d6c-3230274d1dfe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:40.114781 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1ab20e10-8997-49a4-8d6c-3230274d1dfe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043864 Mar 03 02:33:40.115349 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 240/488] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:33:40 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:33:40.750921 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-bbcef95a-dd86-4ed4-b0b0-e00b62f3d078 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:40.751531 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-bbcef95a-dd86-4ed4-b0b0-e00b62f3d078 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:40.757903 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bbcef95a-dd86-4ed4-b0b0-e00b62f3d078 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:40.758361 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bbcef95a-dd86-4ed4-b0b0-e00b62f3d078 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:40.759146 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bbcef95a-dd86-4ed4-b0b0-e00b62f3d078 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:40.760371 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bbcef95a-dd86-4ed4-b0b0-e00b62f3d078 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:40.771218 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-14da6a83-8fcd-49fa-89bc-6cab2083e62e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:40.771963 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-14da6a83-8fcd-49fa-89bc-6cab2083e62e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:40.778042 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-14da6a83-8fcd-49fa-89bc-6cab2083e62e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:40.778486 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-14da6a83-8fcd-49fa-89bc-6cab2083e62e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:40.779257 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-14da6a83-8fcd-49fa-89bc-6cab2083e62e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:40.779722 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-14da6a83-8fcd-49fa-89bc-6cab2083e62e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:40.891174 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-bbcef95a-dd86-4ed4-b0b0-e00b62f3d078 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:40.898916 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-bbcef95a-dd86-4ed4-b0b0-e00b62f3d078 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1566 microversion: 2.1 time: 0.151709 Mar 03 02:33:40.899396 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 249/489] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:40 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:40.914860 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-14da6a83-8fcd-49fa-89bc-6cab2083e62e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:40.923913 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-14da6a83-8fcd-49fa-89bc-6cab2083e62e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:40.925408 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-14da6a83-8fcd-49fa-89bc-6cab2083e62e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:40.926557 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-14da6a83-8fcd-49fa-89bc-6cab2083e62e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.159141 Mar 03 02:33:40.927107 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 241/490] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:40 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:33:41.126626 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-61800457-79fa-42da-9566-445051bccb07 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:41.127526 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-61800457-79fa-42da-9566-445051bccb07 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:41.134176 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-61800457-79fa-42da-9566-445051bccb07 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:41.134624 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-61800457-79fa-42da-9566-445051bccb07 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:41.135875 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-61800457-79fa-42da-9566-445051bccb07 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:41.136308 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-61800457-79fa-42da-9566-445051bccb07 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:41.164102 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-61800457-79fa-42da-9566-445051bccb07 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041347 Mar 03 02:33:41.164581 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 250/491] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:33:41 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:33:41.917613 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-cafe7d26-4cad-474f-94e9-633967c98f6e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:41.918395 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-cafe7d26-4cad-474f-94e9-633967c98f6e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:41.926600 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cafe7d26-4cad-474f-94e9-633967c98f6e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:41.927115 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cafe7d26-4cad-474f-94e9-633967c98f6e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:41.927996 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cafe7d26-4cad-474f-94e9-633967c98f6e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:41.928513 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cafe7d26-4cad-474f-94e9-633967c98f6e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:41.944268 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-16dc35ff-1966-48cb-b58b-50c601e1d0d8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:41.945345 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-16dc35ff-1966-48cb-b58b-50c601e1d0d8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:41.952871 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-16dc35ff-1966-48cb-b58b-50c601e1d0d8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:41.953508 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-16dc35ff-1966-48cb-b58b-50c601e1d0d8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:41.955343 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-16dc35ff-1966-48cb-b58b-50c601e1d0d8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:41.956138 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-16dc35ff-1966-48cb-b58b-50c601e1d0d8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:42.072459 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-cafe7d26-4cad-474f-94e9-633967c98f6e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:42.080383 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-cafe7d26-4cad-474f-94e9-633967c98f6e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1566 microversion: 2.1 time: 0.167409 Mar 03 02:33:42.080944 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 242/492] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:41 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:42.093986 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-16dc35ff-1966-48cb-b58b-50c601e1d0d8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:42.102018 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-16dc35ff-1966-48cb-b58b-50c601e1d0d8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:42.103497 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-16dc35ff-1966-48cb-b58b-50c601e1d0d8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:42.105596 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-16dc35ff-1966-48cb-b58b-50c601e1d0d8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.165220 Mar 03 02:33:42.106147 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 251/493] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:41 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:33:42.175403 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-09b8a030-b155-4cf8-850a-eaf5d847351d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:42.176273 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-09b8a030-b155-4cf8-850a-eaf5d847351d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:42.182346 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-09b8a030-b155-4cf8-850a-eaf5d847351d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:42.182800 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-09b8a030-b155-4cf8-850a-eaf5d847351d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:42.183572 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-09b8a030-b155-4cf8-850a-eaf5d847351d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:42.184022 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-09b8a030-b155-4cf8-850a-eaf5d847351d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:42.211181 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-09b8a030-b155-4cf8-850a-eaf5d847351d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039695 Mar 03 02:33:42.211741 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 243/494] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:33:42 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:33:43.098939 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-874f8582-a249-4492-b38e-40c8f0531f0b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:43.099549 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-874f8582-a249-4492-b38e-40c8f0531f0b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:43.106601 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-874f8582-a249-4492-b38e-40c8f0531f0b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:43.107053 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-874f8582-a249-4492-b38e-40c8f0531f0b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:43.107872 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-874f8582-a249-4492-b38e-40c8f0531f0b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:43.108315 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-874f8582-a249-4492-b38e-40c8f0531f0b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:43.124680 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-33330368-36fa-4382-a77c-3a6fc7a3648f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:43.125283 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-33330368-36fa-4382-a77c-3a6fc7a3648f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:43.130935 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-33330368-36fa-4382-a77c-3a6fc7a3648f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:43.131386 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-33330368-36fa-4382-a77c-3a6fc7a3648f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:43.132203 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-33330368-36fa-4382-a77c-3a6fc7a3648f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:43.132644 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-33330368-36fa-4382-a77c-3a6fc7a3648f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:43.244921 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-874f8582-a249-4492-b38e-40c8f0531f0b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:43.253970 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-874f8582-a249-4492-b38e-40c8f0531f0b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1566 microversion: 2.1 time: 0.158999 Mar 03 02:33:43.254545 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 252/495] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:43 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:43.259060 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a3218a08-389d-4b9e-8fba-506c916b6c67 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:43.259986 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a3218a08-389d-4b9e-8fba-506c916b6c67 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:43.266433 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a3218a08-389d-4b9e-8fba-506c916b6c67 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:43.266587 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-33330368-36fa-4382-a77c-3a6fc7a3648f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:43.266889 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a3218a08-389d-4b9e-8fba-506c916b6c67 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:43.267698 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a3218a08-389d-4b9e-8fba-506c916b6c67 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:43.268162 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a3218a08-389d-4b9e-8fba-506c916b6c67 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:43.274664 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-33330368-36fa-4382-a77c-3a6fc7a3648f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:43.276718 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-33330368-36fa-4382-a77c-3a6fc7a3648f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:43.278047 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-33330368-36fa-4382-a77c-3a6fc7a3648f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.158620 Mar 03 02:33:43.278600 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 244/496] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:43 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:33:43.297792 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a3218a08-389d-4b9e-8fba-506c916b6c67 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042212 Mar 03 02:33:43.298359 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 253/497] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:33:43 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:33:44.270842 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f0b20b13-bb43-4f6f-a3d3-ccae3d6ade27 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:44.271453 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f0b20b13-bb43-4f6f-a3d3-ccae3d6ade27 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:44.277780 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f0b20b13-bb43-4f6f-a3d3-ccae3d6ade27 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:44.278231 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f0b20b13-bb43-4f6f-a3d3-ccae3d6ade27 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:44.279040 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f0b20b13-bb43-4f6f-a3d3-ccae3d6ade27 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:44.279476 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f0b20b13-bb43-4f6f-a3d3-ccae3d6ade27 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:44.296065 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3bbb4b24-073d-4968-b8b4-ff5d1a1d6f74 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:44.296703 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3bbb4b24-073d-4968-b8b4-ff5d1a1d6f74 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:44.303035 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3bbb4b24-073d-4968-b8b4-ff5d1a1d6f74 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:44.303553 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3bbb4b24-073d-4968-b8b4-ff5d1a1d6f74 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:44.304786 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3bbb4b24-073d-4968-b8b4-ff5d1a1d6f74 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:44.305278 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3bbb4b24-073d-4968-b8b4-ff5d1a1d6f74 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:44.415395 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f0b20b13-bb43-4f6f-a3d3-ccae3d6ade27 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:44.423873 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f0b20b13-bb43-4f6f-a3d3-ccae3d6ade27 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1566 microversion: 2.1 time: 0.156842 Mar 03 02:33:44.424448 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 245/498] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:44 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:44.429022 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1f4b5455-9af6-43a2-b12d-cb32c56987b6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:44.430045 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1f4b5455-9af6-43a2-b12d-cb32c56987b6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:44.436456 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1f4b5455-9af6-43a2-b12d-cb32c56987b6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:44.436905 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1f4b5455-9af6-43a2-b12d-cb32c56987b6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:44.437692 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1f4b5455-9af6-43a2-b12d-cb32c56987b6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:44.438133 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1f4b5455-9af6-43a2-b12d-cb32c56987b6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:44.438259 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3bbb4b24-073d-4968-b8b4-ff5d1a1d6f74 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:44.446892 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3bbb4b24-073d-4968-b8b4-ff5d1a1d6f74 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:44.449229 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3bbb4b24-073d-4968-b8b4-ff5d1a1d6f74 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:44.450382 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3bbb4b24-073d-4968-b8b4-ff5d1a1d6f74 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.158370 Mar 03 02:33:44.450943 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 254/499] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:44 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:33:44.466692 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1f4b5455-9af6-43a2-b12d-cb32c56987b6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041241 Mar 03 02:33:44.467244 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 246/500] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:33:44 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:33:45.442109 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4959c11b-5138-4704-b0e4-d77e8123c34a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:45.442709 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4959c11b-5138-4704-b0e4-d77e8123c34a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:45.449565 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4959c11b-5138-4704-b0e4-d77e8123c34a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:45.450012 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4959c11b-5138-4704-b0e4-d77e8123c34a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:45.450789 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4959c11b-5138-4704-b0e4-d77e8123c34a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:45.451222 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4959c11b-5138-4704-b0e4-d77e8123c34a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:45.468721 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1233e7c8-a4ef-489f-8241-e4a548cb35bf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:45.469431 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1233e7c8-a4ef-489f-8241-e4a548cb35bf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:45.476766 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1233e7c8-a4ef-489f-8241-e4a548cb35bf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:45.477213 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1233e7c8-a4ef-489f-8241-e4a548cb35bf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:45.477988 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1233e7c8-a4ef-489f-8241-e4a548cb35bf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:45.478419 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1233e7c8-a4ef-489f-8241-e4a548cb35bf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:45.586863 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4959c11b-5138-4704-b0e4-d77e8123c34a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:45.595494 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4959c11b-5138-4704-b0e4-d77e8123c34a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1566 microversion: 2.1 time: 0.157201 Mar 03 02:33:45.605024 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 255/501] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:45 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:45.605024 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4dc0a08f-f10b-45c0-a6b6-902a21b74ae9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:45.605024 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4dc0a08f-f10b-45c0-a6b6-902a21b74ae9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:45.608068 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4dc0a08f-f10b-45c0-a6b6-902a21b74ae9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:45.608511 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4dc0a08f-f10b-45c0-a6b6-902a21b74ae9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:45.609285 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4dc0a08f-f10b-45c0-a6b6-902a21b74ae9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:45.609716 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4dc0a08f-f10b-45c0-a6b6-902a21b74ae9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:45.613655 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1233e7c8-a4ef-489f-8241-e4a548cb35bf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:45.623185 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1233e7c8-a4ef-489f-8241-e4a548cb35bf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:45.624710 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1233e7c8-a4ef-489f-8241-e4a548cb35bf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:45.632521 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1233e7c8-a4ef-489f-8241-e4a548cb35bf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.167019 Mar 03 02:33:45.633115 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 247/502] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:45 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:33:45.639074 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4dc0a08f-f10b-45c0-a6b6-902a21b74ae9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041939 Mar 03 02:33:45.639631 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 256/503] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:33:45 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:33:46.612451 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-fb6616fe-a942-4c09-9c23-633d43748c25 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:46.613058 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-fb6616fe-a942-4c09-9c23-633d43748c25 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:46.619184 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fb6616fe-a942-4c09-9c23-633d43748c25 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:46.619659 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fb6616fe-a942-4c09-9c23-633d43748c25 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:46.620695 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fb6616fe-a942-4c09-9c23-633d43748c25 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:46.621136 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fb6616fe-a942-4c09-9c23-633d43748c25 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:46.650296 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3aecc138-4aa4-42cf-a1e6-29f9a17fe8dc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:46.653513 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3aecc138-4aa4-42cf-a1e6-29f9a17fe8dc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:46.659841 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3aecc138-4aa4-42cf-a1e6-29f9a17fe8dc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:46.660298 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3aecc138-4aa4-42cf-a1e6-29f9a17fe8dc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:46.661091 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3aecc138-4aa4-42cf-a1e6-29f9a17fe8dc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:46.661531 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3aecc138-4aa4-42cf-a1e6-29f9a17fe8dc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:46.690482 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3aecc138-4aa4-42cf-a1e6-29f9a17fe8dc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044065 Mar 03 02:33:46.691041 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 257/504] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:33:46 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:33:46.695413 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-21d89f76-309d-40ba-b034-e843c461caa0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:46.696032 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-21d89f76-309d-40ba-b034-e843c461caa0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:46.702778 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-21d89f76-309d-40ba-b034-e843c461caa0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:46.703225 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-21d89f76-309d-40ba-b034-e843c461caa0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:46.704046 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-21d89f76-309d-40ba-b034-e843c461caa0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:46.704486 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-21d89f76-309d-40ba-b034-e843c461caa0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:46.756073 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-fb6616fe-a942-4c09-9c23-633d43748c25 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:46.764424 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-fb6616fe-a942-4c09-9c23-633d43748c25 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1566 microversion: 2.1 time: 0.155812 Mar 03 02:33:46.764987 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 248/505] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:46 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:46.837549 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-21d89f76-309d-40ba-b034-e843c461caa0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:46.846397 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-21d89f76-309d-40ba-b034-e843c461caa0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:46.847930 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-21d89f76-309d-40ba-b034-e843c461caa0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:46.849082 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-21d89f76-309d-40ba-b034-e843c461caa0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.157129 Mar 03 02:33:46.849637 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 258/506] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:46 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:33:47.702046 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-01e59d0a-e2c6-4838-90ff-d532330d2dc7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:47.702979 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-01e59d0a-e2c6-4838-90ff-d532330d2dc7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:47.709359 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-01e59d0a-e2c6-4838-90ff-d532330d2dc7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:47.709810 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-01e59d0a-e2c6-4838-90ff-d532330d2dc7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:47.710592 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-01e59d0a-e2c6-4838-90ff-d532330d2dc7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:47.711025 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-01e59d0a-e2c6-4838-90ff-d532330d2dc7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:47.739323 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-01e59d0a-e2c6-4838-90ff-d532330d2dc7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041223 Mar 03 02:33:47.739917 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 249/507] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:33:47 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:33:47.782018 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1bfbf7dd-25d0-4819-beee-e17b989be741 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:47.782623 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1bfbf7dd-25d0-4819-beee-e17b989be741 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:47.788783 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1bfbf7dd-25d0-4819-beee-e17b989be741 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:47.789238 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1bfbf7dd-25d0-4819-beee-e17b989be741 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:47.790011 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1bfbf7dd-25d0-4819-beee-e17b989be741 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:47.790446 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1bfbf7dd-25d0-4819-beee-e17b989be741 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:47.868578 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4b4f7b23-5823-4d30-bdf1-7eb7a8b43472 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:47.869355 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4b4f7b23-5823-4d30-bdf1-7eb7a8b43472 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:47.875423 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4b4f7b23-5823-4d30-bdf1-7eb7a8b43472 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:47.875968 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4b4f7b23-5823-4d30-bdf1-7eb7a8b43472 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:47.877164 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4b4f7b23-5823-4d30-bdf1-7eb7a8b43472 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:47.877363 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4b4f7b23-5823-4d30-bdf1-7eb7a8b43472 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:47.927355 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1bfbf7dd-25d0-4819-beee-e17b989be741 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:47.935046 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1bfbf7dd-25d0-4819-beee-e17b989be741 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1566 microversion: 2.1 time: 0.156950 Mar 03 02:33:47.935630 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 259/508] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:47 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:48.007787 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4b4f7b23-5823-4d30-bdf1-7eb7a8b43472 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:48.015987 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4b4f7b23-5823-4d30-bdf1-7eb7a8b43472 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:48.017478 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4b4f7b23-5823-4d30-bdf1-7eb7a8b43472 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:48.018619 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4b4f7b23-5823-4d30-bdf1-7eb7a8b43472 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.154092 Mar 03 02:33:48.019167 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 250/509] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:47 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:33:48.751409 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b741f122-614a-4325-83b7-65b94edf36a9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:48.752344 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b741f122-614a-4325-83b7-65b94edf36a9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:48.758234 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b741f122-614a-4325-83b7-65b94edf36a9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:48.758686 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b741f122-614a-4325-83b7-65b94edf36a9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:48.759468 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b741f122-614a-4325-83b7-65b94edf36a9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:48.759967 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b741f122-614a-4325-83b7-65b94edf36a9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:48.789092 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b741f122-614a-4325-83b7-65b94edf36a9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041779 Mar 03 02:33:48.789759 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 260/510] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:33:48 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:33:48.951156 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6eddfdf8-4312-4abf-9749-be2ecc8ad256 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:48.951796 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6eddfdf8-4312-4abf-9749-be2ecc8ad256 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:48.957984 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6eddfdf8-4312-4abf-9749-be2ecc8ad256 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:48.958442 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6eddfdf8-4312-4abf-9749-be2ecc8ad256 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:48.959224 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6eddfdf8-4312-4abf-9749-be2ecc8ad256 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:48.959695 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6eddfdf8-4312-4abf-9749-be2ecc8ad256 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:49.037381 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d15576ee-53f3-4edf-b34a-9577666e704f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:49.037932 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d15576ee-53f3-4edf-b34a-9577666e704f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:49.044437 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d15576ee-53f3-4edf-b34a-9577666e704f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:49.044896 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d15576ee-53f3-4edf-b34a-9577666e704f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:49.045688 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d15576ee-53f3-4edf-b34a-9577666e704f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:49.046134 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d15576ee-53f3-4edf-b34a-9577666e704f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:49.093497 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6eddfdf8-4312-4abf-9749-be2ecc8ad256 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:49.101322 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6eddfdf8-4312-4abf-9749-be2ecc8ad256 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1566 microversion: 2.1 time: 0.154016 Mar 03 02:33:49.101950 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 251/511] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:48 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:33:49.175935 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d15576ee-53f3-4edf-b34a-9577666e704f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:49.185078 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d15576ee-53f3-4edf-b34a-9577666e704f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:49.186605 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d15576ee-53f3-4edf-b34a-9577666e704f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:49.187841 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d15576ee-53f3-4edf-b34a-9577666e704f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.154481 Mar 03 02:33:49.188399 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 261/512] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:49 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:33:49.800844 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-162cd1bb-82ea-4bb2-b124-14ec20108206 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:49.801760 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-162cd1bb-82ea-4bb2-b124-14ec20108206 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:49.807642 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-162cd1bb-82ea-4bb2-b124-14ec20108206 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:49.808102 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-162cd1bb-82ea-4bb2-b124-14ec20108206 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:49.808883 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-162cd1bb-82ea-4bb2-b124-14ec20108206 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:49.809328 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-162cd1bb-82ea-4bb2-b124-14ec20108206 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:49.837038 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-162cd1bb-82ea-4bb2-b124-14ec20108206 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040195 Mar 03 02:33:49.837588 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 252/513] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:33:49 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:33:50.119164 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-20d51d13-8265-47b1-af73-adf1ea6f68df tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:50.121130 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-20d51d13-8265-47b1-af73-adf1ea6f68df tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:50.127410 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-20d51d13-8265-47b1-af73-adf1ea6f68df tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:50.127895 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-20d51d13-8265-47b1-af73-adf1ea6f68df tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:50.128677 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-20d51d13-8265-47b1-af73-adf1ea6f68df tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:50.129115 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-20d51d13-8265-47b1-af73-adf1ea6f68df tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:50.206150 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ce755fb4-72a8-4aa4-8a4d-c5aabdc23078 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:50.206730 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ce755fb4-72a8-4aa4-8a4d-c5aabdc23078 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:50.212925 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ce755fb4-72a8-4aa4-8a4d-c5aabdc23078 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:50.213512 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ce755fb4-72a8-4aa4-8a4d-c5aabdc23078 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:50.214337 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ce755fb4-72a8-4aa4-8a4d-c5aabdc23078 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:50.214766 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ce755fb4-72a8-4aa4-8a4d-c5aabdc23078 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:50.265494 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-20d51d13-8265-47b1-af73-adf1ea6f68df tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:50.273223 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-20d51d13-8265-47b1-af73-adf1ea6f68df tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1566 microversion: 2.1 time: 0.157863 Mar 03 02:33:50.273795 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 262/514] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:50 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:50.345082 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ce755fb4-72a8-4aa4-8a4d-c5aabdc23078 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:50.353158 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ce755fb4-72a8-4aa4-8a4d-c5aabdc23078 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:50.355359 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ce755fb4-72a8-4aa4-8a4d-c5aabdc23078 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:50.356559 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ce755fb4-72a8-4aa4-8a4d-c5aabdc23078 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.154364 Mar 03 02:33:50.357113 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 253/515] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:50 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:33:50.848774 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a9085aad-b0db-4e5f-9466-5c4157c61036 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:50.849686 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a9085aad-b0db-4e5f-9466-5c4157c61036 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:50.856550 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a9085aad-b0db-4e5f-9466-5c4157c61036 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:50.857030 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a9085aad-b0db-4e5f-9466-5c4157c61036 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:50.857887 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a9085aad-b0db-4e5f-9466-5c4157c61036 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:50.858347 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a9085aad-b0db-4e5f-9466-5c4157c61036 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:50.888075 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a9085aad-b0db-4e5f-9466-5c4157c61036 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043196 Mar 03 02:33:50.888661 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 263/516] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:33:50 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:33:51.290127 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8756e383-3975-421d-98d5-00e4ec27aea5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:51.290762 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8756e383-3975-421d-98d5-00e4ec27aea5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:51.297368 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8756e383-3975-421d-98d5-00e4ec27aea5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:51.297825 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8756e383-3975-421d-98d5-00e4ec27aea5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:51.298611 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8756e383-3975-421d-98d5-00e4ec27aea5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:51.299056 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8756e383-3975-421d-98d5-00e4ec27aea5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:51.374721 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5e6d00c3-aeb4-4e64-b1f7-dc538a06dbca tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:51.375332 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5e6d00c3-aeb4-4e64-b1f7-dc538a06dbca tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:51.381557 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5e6d00c3-aeb4-4e64-b1f7-dc538a06dbca tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:51.382013 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5e6d00c3-aeb4-4e64-b1f7-dc538a06dbca tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:51.382803 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5e6d00c3-aeb4-4e64-b1f7-dc538a06dbca tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:51.383248 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5e6d00c3-aeb4-4e64-b1f7-dc538a06dbca tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:51.429814 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8756e383-3975-421d-98d5-00e4ec27aea5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:51.437703 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8756e383-3975-421d-98d5-00e4ec27aea5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1566 microversion: 2.1 time: 0.151496 Mar 03 02:33:51.438272 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 254/517] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:51 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:51.515910 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5e6d00c3-aeb4-4e64-b1f7-dc538a06dbca tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:51.524013 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5e6d00c3-aeb4-4e64-b1f7-dc538a06dbca tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:51.525546 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5e6d00c3-aeb4-4e64-b1f7-dc538a06dbca tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:51.526663 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5e6d00c3-aeb4-4e64-b1f7-dc538a06dbca tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.156189 Mar 03 02:33:51.527230 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 264/518] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:51 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:33:51.900079 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-af30de63-bf82-4fa8-ac3b-0f23641e5623 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:51.901214 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-af30de63-bf82-4fa8-ac3b-0f23641e5623 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:51.906877 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-af30de63-bf82-4fa8-ac3b-0f23641e5623 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:51.907320 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-af30de63-bf82-4fa8-ac3b-0f23641e5623 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:51.908132 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-af30de63-bf82-4fa8-ac3b-0f23641e5623 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:51.908565 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-af30de63-bf82-4fa8-ac3b-0f23641e5623 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:51.936497 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-af30de63-bf82-4fa8-ac3b-0f23641e5623 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040280 Mar 03 02:33:51.937006 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 255/519] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:33:51 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:33:52.454736 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-dc90236d-b1a9-4ab3-8757-6924c97a7699 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:52.455259 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-dc90236d-b1a9-4ab3-8757-6924c97a7699 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:52.461447 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dc90236d-b1a9-4ab3-8757-6924c97a7699 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:52.461896 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dc90236d-b1a9-4ab3-8757-6924c97a7699 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:52.462663 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dc90236d-b1a9-4ab3-8757-6924c97a7699 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:52.463699 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dc90236d-b1a9-4ab3-8757-6924c97a7699 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:52.545095 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5c54898d-b365-4647-9b2b-5eade35b6df1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:52.545696 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5c54898d-b365-4647-9b2b-5eade35b6df1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:52.551988 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5c54898d-b365-4647-9b2b-5eade35b6df1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:52.552455 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5c54898d-b365-4647-9b2b-5eade35b6df1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:52.553217 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5c54898d-b365-4647-9b2b-5eade35b6df1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:52.553646 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5c54898d-b365-4647-9b2b-5eade35b6df1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:52.593393 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-dc90236d-b1a9-4ab3-8757-6924c97a7699 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:52.601281 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-dc90236d-b1a9-4ab3-8757-6924c97a7699 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1566 microversion: 2.1 time: 0.150374 Mar 03 02:33:52.601863 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 265/520] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:52 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:52.692777 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5c54898d-b365-4647-9b2b-5eade35b6df1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:52.701465 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5c54898d-b365-4647-9b2b-5eade35b6df1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:52.702943 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5c54898d-b365-4647-9b2b-5eade35b6df1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:52.704113 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5c54898d-b365-4647-9b2b-5eade35b6df1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.163541 Mar 03 02:33:52.704677 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 256/521] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:52 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:33:52.947272 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2e0a8514-9e22-49a3-9ad3-6fa28d13f941 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:52.948842 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2e0a8514-9e22-49a3-9ad3-6fa28d13f941 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:52.954761 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2e0a8514-9e22-49a3-9ad3-6fa28d13f941 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:52.955206 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2e0a8514-9e22-49a3-9ad3-6fa28d13f941 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:52.956018 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2e0a8514-9e22-49a3-9ad3-6fa28d13f941 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:52.956451 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2e0a8514-9e22-49a3-9ad3-6fa28d13f941 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:52.983799 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2e0a8514-9e22-49a3-9ad3-6fa28d13f941 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040443 Mar 03 02:33:52.984341 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 266/522] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:33:52 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:33:53.619000 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a880977e-5029-4e43-bd1e-32726303c0b6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:53.620936 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a880977e-5029-4e43-bd1e-32726303c0b6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:53.627454 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a880977e-5029-4e43-bd1e-32726303c0b6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:53.627939 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a880977e-5029-4e43-bd1e-32726303c0b6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:53.628726 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a880977e-5029-4e43-bd1e-32726303c0b6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:53.629163 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a880977e-5029-4e43-bd1e-32726303c0b6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:53.722039 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7d9aae3c-7cbe-421f-b2de-5568cdd9c632 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:53.722646 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7d9aae3c-7cbe-421f-b2de-5568cdd9c632 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:53.729865 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7d9aae3c-7cbe-421f-b2de-5568cdd9c632 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:53.730323 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7d9aae3c-7cbe-421f-b2de-5568cdd9c632 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:53.731113 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7d9aae3c-7cbe-421f-b2de-5568cdd9c632 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:53.731547 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7d9aae3c-7cbe-421f-b2de-5568cdd9c632 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:53.764466 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a880977e-5029-4e43-bd1e-32726303c0b6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:53.772223 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a880977e-5029-4e43-bd1e-32726303c0b6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1566 microversion: 2.1 time: 0.157066 Mar 03 02:33:53.772801 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 257/523] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:53 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:53.866662 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-7d9aae3c-7cbe-421f-b2de-5568cdd9c632 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:53.875070 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-7d9aae3c-7cbe-421f-b2de-5568cdd9c632 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:53.876536 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-7d9aae3c-7cbe-421f-b2de-5568cdd9c632 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:53.877681 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7d9aae3c-7cbe-421f-b2de-5568cdd9c632 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.159454 Mar 03 02:33:53.878219 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 267/524] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:53 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:33:53.995072 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a5c4c043-d8fc-4e7e-bb3d-50902166b969 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:53.996303 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a5c4c043-d8fc-4e7e-bb3d-50902166b969 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:54.002148 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a5c4c043-d8fc-4e7e-bb3d-50902166b969 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:54.002604 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a5c4c043-d8fc-4e7e-bb3d-50902166b969 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:54.003380 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a5c4c043-d8fc-4e7e-bb3d-50902166b969 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:54.003840 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a5c4c043-d8fc-4e7e-bb3d-50902166b969 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:54.032670 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a5c4c043-d8fc-4e7e-bb3d-50902166b969 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041547 Mar 03 02:33:54.033227 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 258/525] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:33:53 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:33:54.788758 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-20fd92a1-73eb-4112-a630-a95e3d3a656e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:54.789386 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-20fd92a1-73eb-4112-a630-a95e3d3a656e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:54.795828 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-20fd92a1-73eb-4112-a630-a95e3d3a656e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:54.796278 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-20fd92a1-73eb-4112-a630-a95e3d3a656e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:54.797099 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-20fd92a1-73eb-4112-a630-a95e3d3a656e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:54.797635 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-20fd92a1-73eb-4112-a630-a95e3d3a656e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:54.895504 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6c68a228-2f9d-4b0b-b3e5-65c13e533c19 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:54.896140 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6c68a228-2f9d-4b0b-b3e5-65c13e533c19 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:54.902403 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6c68a228-2f9d-4b0b-b3e5-65c13e533c19 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:54.902892 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6c68a228-2f9d-4b0b-b3e5-65c13e533c19 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:54.903746 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6c68a228-2f9d-4b0b-b3e5-65c13e533c19 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:54.904190 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6c68a228-2f9d-4b0b-b3e5-65c13e533c19 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:54.928035 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-20fd92a1-73eb-4112-a630-a95e3d3a656e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:54.936512 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-20fd92a1-73eb-4112-a630-a95e3d3a656e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1546 microversion: 2.1 time: 0.151548 Mar 03 02:33:54.937084 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 268/526] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:54 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1546 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:54.952969 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7c4652eb-899e-47f5-9389-d4b23cdde728 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:54.953458 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7c4652eb-899e-47f5-9389-d4b23cdde728 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:54.959156 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7c4652eb-899e-47f5-9389-d4b23cdde728 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:54.959620 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7c4652eb-899e-47f5-9389-d4b23cdde728 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:54.960403 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7c4652eb-899e-47f5-9389-d4b23cdde728 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:54.960864 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7c4652eb-899e-47f5-9389-d4b23cdde728 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:55.038637 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6c68a228-2f9d-4b0b-b3e5-65c13e533c19 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:55.042845 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.wsgi [None req-7c4652eb-899e-47f5-9389-d4b23cdde728 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] HTTP exception thrown: Cannot 'detach_volume' instance 0b9116d7-0099-4dfe-b678-192ce74500eb while it is in vm_state rescued Mar 03 02:33:55.043384 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7c4652eb-899e-47f5-9389-d4b23cdde728 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Returning 409 to user: Cannot 'detach_volume' instance 0b9116d7-0099-4dfe-b678-192ce74500eb while it is in vm_state rescued {{(pid=116859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:33:55.044249 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7c4652eb-899e-47f5-9389-d4b23cdde728 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments/48041a70-94bf-454e-997d-6645136166b5" status: 409 len: 152 microversion: 2.1 time: 0.095234 Mar 03 02:33:55.044802 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 269/527] 10.222.0.30 () {58 vars in 1415 bytes} [Thu Mar 3 02:33:54 2022] DELETE /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments/48041a70-94bf-454e-997d-6645136166b5 => generated 152 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Mar 03 02:33:55.047857 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6c68a228-2f9d-4b0b-b3e5-65c13e533c19 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:55.048658 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6c68a228-2f9d-4b0b-b3e5-65c13e533c19 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:55.049382 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f98a2aba-c5ae-438c-a7b8-b927baa25a87 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:55.049843 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6c68a228-2f9d-4b0b-b3e5-65c13e533c19 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.158242 Mar 03 02:33:55.055804 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f98a2aba-c5ae-438c-a7b8-b927baa25a87 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:55.056503 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 259/528] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:54 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:33:55.056503 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ee81675c-a94c-484b-ab21-c14617bbe5bd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:33:55.056503 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ee81675c-a94c-484b-ab21-c14617bbe5bd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:55.057114 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f98a2aba-c5ae-438c-a7b8-b927baa25a87 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:55.057563 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f98a2aba-c5ae-438c-a7b8-b927baa25a87 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:55.058350 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f98a2aba-c5ae-438c-a7b8-b927baa25a87 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:55.058786 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f98a2aba-c5ae-438c-a7b8-b927baa25a87 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:55.061900 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ee81675c-a94c-484b-ab21-c14617bbe5bd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:55.062358 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ee81675c-a94c-484b-ab21-c14617bbe5bd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:55.063147 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ee81675c-a94c-484b-ab21-c14617bbe5bd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:55.063588 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ee81675c-a94c-484b-ab21-c14617bbe5bd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:55.087861 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f98a2aba-c5ae-438c-a7b8-b927baa25a87 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042021 Mar 03 02:33:55.089005 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 270/529] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:33:55 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:33:55.127941 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ee81675c-a94c-484b-ab21-c14617bbe5bd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "POST /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/action" status: 202 len: 0 microversion: 2.1 time: 0.076305 Mar 03 02:33:55.128685 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 260/530] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Mar 3 02:33:55 2022] POST /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 03 02:33:55.137276 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-eeedfbec-e634-4663-9a62-bb6102ead811 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:55.137872 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-eeedfbec-e634-4663-9a62-bb6102ead811 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:55.143729 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eeedfbec-e634-4663-9a62-bb6102ead811 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:55.144180 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eeedfbec-e634-4663-9a62-bb6102ead811 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:55.144956 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eeedfbec-e634-4663-9a62-bb6102ead811 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:55.145394 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eeedfbec-e634-4663-9a62-bb6102ead811 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:55.281178 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-eeedfbec-e634-4663-9a62-bb6102ead811 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:55.289339 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-eeedfbec-e634-4663-9a62-bb6102ead811 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1554 microversion: 2.1 time: 0.156359 Mar 03 02:33:55.290103 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 271/531] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:55 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:56.069457 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e040b085-414c-4f1e-8aa8-daf9d8213703 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:56.070147 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e040b085-414c-4f1e-8aa8-daf9d8213703 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:56.076903 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e040b085-414c-4f1e-8aa8-daf9d8213703 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:56.077352 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e040b085-414c-4f1e-8aa8-daf9d8213703 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:56.078126 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e040b085-414c-4f1e-8aa8-daf9d8213703 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:56.078593 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e040b085-414c-4f1e-8aa8-daf9d8213703 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:56.099849 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0fbcec62-e17d-4d29-b2f7-2b14df8d41d0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:56.100756 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0fbcec62-e17d-4d29-b2f7-2b14df8d41d0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:56.108098 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0fbcec62-e17d-4d29-b2f7-2b14df8d41d0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:56.108546 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0fbcec62-e17d-4d29-b2f7-2b14df8d41d0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:56.109324 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0fbcec62-e17d-4d29-b2f7-2b14df8d41d0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:56.109757 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0fbcec62-e17d-4d29-b2f7-2b14df8d41d0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:56.137889 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0fbcec62-e17d-4d29-b2f7-2b14df8d41d0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041907 Mar 03 02:33:56.138452 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 272/532] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:33:56 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:33:56.214319 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e040b085-414c-4f1e-8aa8-daf9d8213703 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:56.222366 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e040b085-414c-4f1e-8aa8-daf9d8213703 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:56.223865 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e040b085-414c-4f1e-8aa8-daf9d8213703 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:56.225005 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e040b085-414c-4f1e-8aa8-daf9d8213703 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.160271 Mar 03 02:33:56.225566 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 261/533] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:56 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:33:56.306831 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-48a8ad77-3974-4b28-857d-d12eee8e8d88 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:56.307469 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-48a8ad77-3974-4b28-857d-d12eee8e8d88 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:56.316030 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-48a8ad77-3974-4b28-857d-d12eee8e8d88 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:56.316633 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-48a8ad77-3974-4b28-857d-d12eee8e8d88 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:56.317560 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-48a8ad77-3974-4b28-857d-d12eee8e8d88 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:56.318124 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-48a8ad77-3974-4b28-857d-d12eee8e8d88 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:56.453971 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-48a8ad77-3974-4b28-857d-d12eee8e8d88 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:56.461574 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-48a8ad77-3974-4b28-857d-d12eee8e8d88 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1554 microversion: 2.1 time: 0.158579 Mar 03 02:33:56.462141 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 273/534] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:56 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:57.149792 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-69277d2d-62d7-4897-b4f6-ad0994b93a24 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:57.151064 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-69277d2d-62d7-4897-b4f6-ad0994b93a24 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:57.157277 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-69277d2d-62d7-4897-b4f6-ad0994b93a24 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:57.157719 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-69277d2d-62d7-4897-b4f6-ad0994b93a24 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:57.158492 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-69277d2d-62d7-4897-b4f6-ad0994b93a24 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:57.158925 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-69277d2d-62d7-4897-b4f6-ad0994b93a24 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:57.187877 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-69277d2d-62d7-4897-b4f6-ad0994b93a24 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042219 Mar 03 02:33:57.188427 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 262/535] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:33:57 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:33:57.243522 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b5fb0ed7-0f33-436a-ad22-0dd607096766 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:57.244823 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b5fb0ed7-0f33-436a-ad22-0dd607096766 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:57.251211 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b5fb0ed7-0f33-436a-ad22-0dd607096766 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:57.251690 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b5fb0ed7-0f33-436a-ad22-0dd607096766 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:57.252464 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b5fb0ed7-0f33-436a-ad22-0dd607096766 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:57.252894 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b5fb0ed7-0f33-436a-ad22-0dd607096766 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:57.383953 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b5fb0ed7-0f33-436a-ad22-0dd607096766 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:57.392609 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b5fb0ed7-0f33-436a-ad22-0dd607096766 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:57.394093 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b5fb0ed7-0f33-436a-ad22-0dd607096766 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:57.395220 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b5fb0ed7-0f33-436a-ad22-0dd607096766 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.155605 Mar 03 02:33:57.395807 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 274/536] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:57 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:33:57.479890 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0eb22541-d478-4fee-a73b-73b3595c54cc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:57.480501 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0eb22541-d478-4fee-a73b-73b3595c54cc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:57.486294 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0eb22541-d478-4fee-a73b-73b3595c54cc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:57.486756 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0eb22541-d478-4fee-a73b-73b3595c54cc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:57.487532 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0eb22541-d478-4fee-a73b-73b3595c54cc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:57.488004 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0eb22541-d478-4fee-a73b-73b3595c54cc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:57.620643 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0eb22541-d478-4fee-a73b-73b3595c54cc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:57.628385 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0eb22541-d478-4fee-a73b-73b3595c54cc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1554 microversion: 2.1 time: 0.152981 Mar 03 02:33:57.628955 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 263/537] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:57 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:58.200247 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-aba82ae3-6338-4ed6-9944-002ed64dd51d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:58.201171 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-aba82ae3-6338-4ed6-9944-002ed64dd51d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:58.207251 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aba82ae3-6338-4ed6-9944-002ed64dd51d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:58.207732 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aba82ae3-6338-4ed6-9944-002ed64dd51d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:58.208555 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aba82ae3-6338-4ed6-9944-002ed64dd51d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:58.208991 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aba82ae3-6338-4ed6-9944-002ed64dd51d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:58.244681 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-aba82ae3-6338-4ed6-9944-002ed64dd51d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048248 Mar 03 02:33:58.246191 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 275/538] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:33:58 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:33:58.414332 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b5287077-50de-4d81-b7e5-80d315604d8f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:58.414957 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b5287077-50de-4d81-b7e5-80d315604d8f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:58.421198 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b5287077-50de-4d81-b7e5-80d315604d8f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:58.421643 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b5287077-50de-4d81-b7e5-80d315604d8f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:58.422418 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b5287077-50de-4d81-b7e5-80d315604d8f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:58.422851 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b5287077-50de-4d81-b7e5-80d315604d8f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:58.561115 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b5287077-50de-4d81-b7e5-80d315604d8f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:58.571495 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b5287077-50de-4d81-b7e5-80d315604d8f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:58.574282 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b5287077-50de-4d81-b7e5-80d315604d8f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:58.575551 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b5287077-50de-4d81-b7e5-80d315604d8f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.165035 Mar 03 02:33:58.576602 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 264/539] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:58 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:33:58.646096 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2f78086a-05f7-4374-90be-41f51c3b6585 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:58.646607 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2f78086a-05f7-4374-90be-41f51c3b6585 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:58.653912 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f78086a-05f7-4374-90be-41f51c3b6585 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:58.654372 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f78086a-05f7-4374-90be-41f51c3b6585 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:58.656699 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f78086a-05f7-4374-90be-41f51c3b6585 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:58.657521 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f78086a-05f7-4374-90be-41f51c3b6585 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:58.809211 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2f78086a-05f7-4374-90be-41f51c3b6585 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:58.816916 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2f78086a-05f7-4374-90be-41f51c3b6585 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1560 microversion: 2.1 time: 0.174819 Mar 03 02:33:58.817479 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 276/540] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:33:58 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:33:58.882960 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8baeaae6-93f2-403f-b0e8-e4b782b3cacb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:58.883448 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8baeaae6-93f2-403f-b0e8-e4b782b3cacb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:58.889379 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8baeaae6-93f2-403f-b0e8-e4b782b3cacb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:58.889826 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8baeaae6-93f2-403f-b0e8-e4b782b3cacb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:58.890590 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8baeaae6-93f2-403f-b0e8-e4b782b3cacb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:58.891022 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8baeaae6-93f2-403f-b0e8-e4b782b3cacb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:58.967030 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.objects.instance [None req-8baeaae6-93f2-403f-b0e8-e4b782b3cacb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lazy-loading 'services' on Instance uuid 0b9116d7-0099-4dfe-b678-192ce74500eb {{(pid=116858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 03 02:33:59.036601 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8baeaae6-93f2-403f-b0e8-e4b782b3cacb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments/48041a70-94bf-454e-997d-6645136166b5" status: 202 len: 0 microversion: 2.1 time: 0.157302 Mar 03 02:33:59.037205 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 265/541] 10.222.0.30 () {58 vars in 1415 bytes} [Thu Mar 3 02:33:58 2022] DELETE /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments/48041a70-94bf-454e-997d-6645136166b5 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 03 02:33:59.046215 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9f81dcf8-b171-479e-88cb-cc42193cb8ae tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:59.047388 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9f81dcf8-b171-479e-88cb-cc42193cb8ae tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:59.054412 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9f81dcf8-b171-479e-88cb-cc42193cb8ae tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:59.054800 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9f81dcf8-b171-479e-88cb-cc42193cb8ae tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:59.055595 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9f81dcf8-b171-479e-88cb-cc42193cb8ae tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:59.056062 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9f81dcf8-b171-479e-88cb-cc42193cb8ae tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:59.084068 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9f81dcf8-b171-479e-88cb-cc42193cb8ae tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041783 Mar 03 02:33:59.084624 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 277/542] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:33:59 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:33:59.257626 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7e3f402f-8a1b-446f-b74d-3271ba905f07 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:59.258711 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7e3f402f-8a1b-446f-b74d-3271ba905f07 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:59.264831 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7e3f402f-8a1b-446f-b74d-3271ba905f07 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:59.265276 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7e3f402f-8a1b-446f-b74d-3271ba905f07 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:59.266049 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7e3f402f-8a1b-446f-b74d-3271ba905f07 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:59.266477 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7e3f402f-8a1b-446f-b74d-3271ba905f07 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:59.294443 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7e3f402f-8a1b-446f-b74d-3271ba905f07 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041093 Mar 03 02:33:59.294980 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 266/543] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:33:59 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:33:59.599549 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8f7e15e1-c303-4d0b-81e2-3d7dc93297c8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:33:59.600188 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8f7e15e1-c303-4d0b-81e2-3d7dc93297c8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:33:59.606087 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8f7e15e1-c303-4d0b-81e2-3d7dc93297c8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:59.606542 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8f7e15e1-c303-4d0b-81e2-3d7dc93297c8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:59.607320 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8f7e15e1-c303-4d0b-81e2-3d7dc93297c8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:33:59.607868 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8f7e15e1-c303-4d0b-81e2-3d7dc93297c8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:33:59.740101 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8f7e15e1-c303-4d0b-81e2-3d7dc93297c8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:59.749578 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8f7e15e1-c303-4d0b-81e2-3d7dc93297c8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:59.751072 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8f7e15e1-c303-4d0b-81e2-3d7dc93297c8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:33:59.752265 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8f7e15e1-c303-4d0b-81e2-3d7dc93297c8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.156822 Mar 03 02:33:59.752826 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 278/544] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:33:59 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:34:00.096141 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-702e4750-9ed7-4908-820d-5c2de46c6519 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:00.097037 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-702e4750-9ed7-4908-820d-5c2de46c6519 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:00.103147 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-702e4750-9ed7-4908-820d-5c2de46c6519 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:00.104308 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-702e4750-9ed7-4908-820d-5c2de46c6519 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:00.105044 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-702e4750-9ed7-4908-820d-5c2de46c6519 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:00.105480 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-702e4750-9ed7-4908-820d-5c2de46c6519 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:00.133196 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-702e4750-9ed7-4908-820d-5c2de46c6519 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041008 Mar 03 02:34:00.133736 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 267/545] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:00 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:00.305874 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3aa70d82-2ef5-46b6-8408-81413470b95a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:00.307376 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3aa70d82-2ef5-46b6-8408-81413470b95a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:00.313288 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3aa70d82-2ef5-46b6-8408-81413470b95a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:00.313738 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3aa70d82-2ef5-46b6-8408-81413470b95a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:00.314508 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3aa70d82-2ef5-46b6-8408-81413470b95a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:00.314939 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3aa70d82-2ef5-46b6-8408-81413470b95a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:00.342643 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3aa70d82-2ef5-46b6-8408-81413470b95a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040760 Mar 03 02:34:00.343256 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 279/546] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:00 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:00.770308 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-41eb3fe1-fa14-4d08-b2a2-9d09fc6ec3a4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:00.770905 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-41eb3fe1-fa14-4d08-b2a2-9d09fc6ec3a4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:00.777599 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-41eb3fe1-fa14-4d08-b2a2-9d09fc6ec3a4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:00.778045 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-41eb3fe1-fa14-4d08-b2a2-9d09fc6ec3a4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:00.778815 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-41eb3fe1-fa14-4d08-b2a2-9d09fc6ec3a4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:00.779249 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-41eb3fe1-fa14-4d08-b2a2-9d09fc6ec3a4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:00.912233 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-41eb3fe1-fa14-4d08-b2a2-9d09fc6ec3a4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:00.920323 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-41eb3fe1-fa14-4d08-b2a2-9d09fc6ec3a4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:00.921825 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-41eb3fe1-fa14-4d08-b2a2-9d09fc6ec3a4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:00.922962 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-41eb3fe1-fa14-4d08-b2a2-9d09fc6ec3a4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.156529 Mar 03 02:34:00.923523 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 268/547] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:00 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:01.145122 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-23b59ae5-f49c-40d8-8a7f-6a3a6337b196 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:01.146027 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-23b59ae5-f49c-40d8-8a7f-6a3a6337b196 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:01.152805 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-23b59ae5-f49c-40d8-8a7f-6a3a6337b196 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:01.153248 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-23b59ae5-f49c-40d8-8a7f-6a3a6337b196 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:01.154017 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-23b59ae5-f49c-40d8-8a7f-6a3a6337b196 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:01.154450 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-23b59ae5-f49c-40d8-8a7f-6a3a6337b196 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:01.182240 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-23b59ae5-f49c-40d8-8a7f-6a3a6337b196 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041228 Mar 03 02:34:01.182784 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 280/548] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:01 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:01.354560 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c3bfa840-4557-40a6-b3ef-630dd7dd7d32 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:01.355479 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c3bfa840-4557-40a6-b3ef-630dd7dd7d32 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:01.361643 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c3bfa840-4557-40a6-b3ef-630dd7dd7d32 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:01.362096 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c3bfa840-4557-40a6-b3ef-630dd7dd7d32 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:01.362885 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c3bfa840-4557-40a6-b3ef-630dd7dd7d32 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:01.363322 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c3bfa840-4557-40a6-b3ef-630dd7dd7d32 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:01.392792 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c3bfa840-4557-40a6-b3ef-630dd7dd7d32 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042419 Mar 03 02:34:01.393340 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 269/549] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:01 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:01.941132 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c8f8a3c5-db87-4a53-8690-22e11948cad6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:01.941735 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c8f8a3c5-db87-4a53-8690-22e11948cad6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:01.947795 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c8f8a3c5-db87-4a53-8690-22e11948cad6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:01.948247 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c8f8a3c5-db87-4a53-8690-22e11948cad6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:01.949021 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c8f8a3c5-db87-4a53-8690-22e11948cad6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:01.949452 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c8f8a3c5-db87-4a53-8690-22e11948cad6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:02.082087 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c8f8a3c5-db87-4a53-8690-22e11948cad6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:02.090708 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c8f8a3c5-db87-4a53-8690-22e11948cad6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:02.092234 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c8f8a3c5-db87-4a53-8690-22e11948cad6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:02.093369 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c8f8a3c5-db87-4a53-8690-22e11948cad6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.156166 Mar 03 02:34:02.093917 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 281/550] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:01 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:02.193523 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9b9fa074-4d5f-4306-9b00-a8fd56a08dbb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:02.194365 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9b9fa074-4d5f-4306-9b00-a8fd56a08dbb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:02.200333 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9b9fa074-4d5f-4306-9b00-a8fd56a08dbb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:02.200781 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9b9fa074-4d5f-4306-9b00-a8fd56a08dbb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:02.201558 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9b9fa074-4d5f-4306-9b00-a8fd56a08dbb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:02.201993 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9b9fa074-4d5f-4306-9b00-a8fd56a08dbb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:02.230076 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9b9fa074-4d5f-4306-9b00-a8fd56a08dbb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040545 Mar 03 02:34:02.230625 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 270/551] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:02 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:02.404369 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0b3ff0ad-35e4-4945-8f7c-29aa221d7e96 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:02.405387 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0b3ff0ad-35e4-4945-8f7c-29aa221d7e96 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:02.411748 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0b3ff0ad-35e4-4945-8f7c-29aa221d7e96 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:02.412195 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0b3ff0ad-35e4-4945-8f7c-29aa221d7e96 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:02.413123 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0b3ff0ad-35e4-4945-8f7c-29aa221d7e96 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:02.413726 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0b3ff0ad-35e4-4945-8f7c-29aa221d7e96 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:02.442248 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0b3ff0ad-35e4-4945-8f7c-29aa221d7e96 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042545 Mar 03 02:34:02.442786 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 282/552] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:02 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:03.111842 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a7da086c-dd52-460a-84c3-a0dad07b43c4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:03.112445 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a7da086c-dd52-460a-84c3-a0dad07b43c4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:03.118659 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a7da086c-dd52-460a-84c3-a0dad07b43c4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:03.119814 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a7da086c-dd52-460a-84c3-a0dad07b43c4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:03.120827 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a7da086c-dd52-460a-84c3-a0dad07b43c4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:03.121257 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a7da086c-dd52-460a-84c3-a0dad07b43c4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:03.241563 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b93ee236-aff8-4df7-8ad1-3d7dc9877fea tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:03.242550 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b93ee236-aff8-4df7-8ad1-3d7dc9877fea tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:03.249297 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b93ee236-aff8-4df7-8ad1-3d7dc9877fea tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:03.249741 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b93ee236-aff8-4df7-8ad1-3d7dc9877fea tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:03.250521 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b93ee236-aff8-4df7-8ad1-3d7dc9877fea tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:03.250953 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b93ee236-aff8-4df7-8ad1-3d7dc9877fea tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:03.254759 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a7da086c-dd52-460a-84c3-a0dad07b43c4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:03.263202 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a7da086c-dd52-460a-84c3-a0dad07b43c4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:03.264733 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a7da086c-dd52-460a-84c3-a0dad07b43c4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:03.265877 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a7da086c-dd52-460a-84c3-a0dad07b43c4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.157999 Mar 03 02:34:03.266429 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 271/553] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:03 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:03.279530 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b93ee236-aff8-4df7-8ad1-3d7dc9877fea tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041830 Mar 03 02:34:03.280137 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 283/554] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:03 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:34:03.453833 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d2d537d2-ece6-4e62-8c8f-33a1df296688 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:03.454747 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d2d537d2-ece6-4e62-8c8f-33a1df296688 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:03.460529 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d2d537d2-ece6-4e62-8c8f-33a1df296688 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:03.460986 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d2d537d2-ece6-4e62-8c8f-33a1df296688 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:03.461774 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d2d537d2-ece6-4e62-8c8f-33a1df296688 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:03.462217 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d2d537d2-ece6-4e62-8c8f-33a1df296688 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:03.490325 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d2d537d2-ece6-4e62-8c8f-33a1df296688 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040466 Mar 03 02:34:03.491069 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 272/555] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:03 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:34:04.284233 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-379da24b-f5ce-4ec9-a8a1-a5602af99973 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:04.284832 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-379da24b-f5ce-4ec9-a8a1-a5602af99973 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:04.290549 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2aec6095-86e2-48ee-b3f3-1f6d34b3ce95 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:04.291064 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-379da24b-f5ce-4ec9-a8a1-a5602af99973 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:04.291711 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-379da24b-f5ce-4ec9-a8a1-a5602af99973 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:04.292066 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2aec6095-86e2-48ee-b3f3-1f6d34b3ce95 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:04.292494 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-379da24b-f5ce-4ec9-a8a1-a5602af99973 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:04.292930 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-379da24b-f5ce-4ec9-a8a1-a5602af99973 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:04.298255 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2aec6095-86e2-48ee-b3f3-1f6d34b3ce95 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:04.298705 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2aec6095-86e2-48ee-b3f3-1f6d34b3ce95 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:04.299497 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2aec6095-86e2-48ee-b3f3-1f6d34b3ce95 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:04.299962 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2aec6095-86e2-48ee-b3f3-1f6d34b3ce95 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:04.330712 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2aec6095-86e2-48ee-b3f3-1f6d34b3ce95 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043978 Mar 03 02:34:04.331286 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 273/556] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:04 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:04.422806 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-379da24b-f5ce-4ec9-a8a1-a5602af99973 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:04.430840 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-379da24b-f5ce-4ec9-a8a1-a5602af99973 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:04.433135 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-379da24b-f5ce-4ec9-a8a1-a5602af99973 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:04.434267 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-379da24b-f5ce-4ec9-a8a1-a5602af99973 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.153891 Mar 03 02:34:04.434819 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 284/557] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:04 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:04.501859 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-aa1aa124-9f0b-461b-911b-aa807b678443 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:04.502763 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-aa1aa124-9f0b-461b-911b-aa807b678443 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:04.508526 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aa1aa124-9f0b-461b-911b-aa807b678443 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:04.508970 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aa1aa124-9f0b-461b-911b-aa807b678443 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:04.510352 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aa1aa124-9f0b-461b-911b-aa807b678443 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:04.510788 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aa1aa124-9f0b-461b-911b-aa807b678443 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:04.540189 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-aa1aa124-9f0b-461b-911b-aa807b678443 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041516 Mar 03 02:34:04.540189 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 274/558] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:04 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:05.342127 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-80b0545c-1b04-4264-9d04-393d0312c2ea tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:05.343096 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-80b0545c-1b04-4264-9d04-393d0312c2ea tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:05.349309 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-80b0545c-1b04-4264-9d04-393d0312c2ea tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:05.349753 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-80b0545c-1b04-4264-9d04-393d0312c2ea tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:05.350555 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-80b0545c-1b04-4264-9d04-393d0312c2ea tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:05.350988 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-80b0545c-1b04-4264-9d04-393d0312c2ea tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:05.380154 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-80b0545c-1b04-4264-9d04-393d0312c2ea tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042519 Mar 03 02:34:05.380635 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 285/559] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:05 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:05.452106 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-11ab4bc1-65e9-4915-880b-e60de0ac74b2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:05.452714 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-11ab4bc1-65e9-4915-880b-e60de0ac74b2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:05.458831 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-11ab4bc1-65e9-4915-880b-e60de0ac74b2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:05.459280 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-11ab4bc1-65e9-4915-880b-e60de0ac74b2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:05.460081 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-11ab4bc1-65e9-4915-880b-e60de0ac74b2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:05.460519 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-11ab4bc1-65e9-4915-880b-e60de0ac74b2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:05.550286 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3092c4be-050e-4098-b98f-ce331f4531d3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:05.551203 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3092c4be-050e-4098-b98f-ce331f4531d3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:05.557295 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3092c4be-050e-4098-b98f-ce331f4531d3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:05.557743 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3092c4be-050e-4098-b98f-ce331f4531d3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:05.558697 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3092c4be-050e-4098-b98f-ce331f4531d3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:05.559130 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3092c4be-050e-4098-b98f-ce331f4531d3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:05.588203 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3092c4be-050e-4098-b98f-ce331f4531d3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041623 Mar 03 02:34:05.588892 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 286/560] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:05 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:34:05.594055 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-74ac73c6-16f0-4750-b1c7-be447b472e65 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:34:05.594914 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-74ac73c6-16f0-4750-b1c7-be447b472e65 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:05.597268 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-11ab4bc1-65e9-4915-880b-e60de0ac74b2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:05.600502 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-74ac73c6-16f0-4750-b1c7-be447b472e65 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:05.600953 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-74ac73c6-16f0-4750-b1c7-be447b472e65 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:05.601726 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-74ac73c6-16f0-4750-b1c7-be447b472e65 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:05.602158 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-74ac73c6-16f0-4750-b1c7-be447b472e65 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:05.605852 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-11ab4bc1-65e9-4915-880b-e60de0ac74b2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:05.607448 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-11ab4bc1-65e9-4915-880b-e60de0ac74b2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:05.608665 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-11ab4bc1-65e9-4915-880b-e60de0ac74b2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.160489 Mar 03 02:34:05.609232 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 275/561] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:05 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:05.670784 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-74ac73c6-16f0-4750-b1c7-be447b472e65 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "POST /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/action" status: 202 len: 0 microversion: 2.1 time: 0.080710 Mar 03 02:34:05.671417 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 287/562] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Mar 3 02:34:05 2022] POST /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 03 02:34:05.679451 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0d5bded2-ba58-4470-b62c-733e3a2c06d1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:05.680098 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0d5bded2-ba58-4470-b62c-733e3a2c06d1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:05.685917 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0d5bded2-ba58-4470-b62c-733e3a2c06d1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:05.686434 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0d5bded2-ba58-4470-b62c-733e3a2c06d1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:05.687252 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0d5bded2-ba58-4470-b62c-733e3a2c06d1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:05.687770 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0d5bded2-ba58-4470-b62c-733e3a2c06d1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:05.930719 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0d5bded2-ba58-4470-b62c-733e3a2c06d1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:05.938877 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0d5bded2-ba58-4470-b62c-733e3a2c06d1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1753 microversion: 2.1 time: 0.263260 Mar 03 02:34:05.939447 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 276/563] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:34:05 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1753 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:34:06.392720 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6e7564dd-b4f7-424e-aef3-7fa2f9dee554 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:06.393768 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6e7564dd-b4f7-424e-aef3-7fa2f9dee554 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:06.400237 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6e7564dd-b4f7-424e-aef3-7fa2f9dee554 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:06.400778 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6e7564dd-b4f7-424e-aef3-7fa2f9dee554 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:06.401553 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6e7564dd-b4f7-424e-aef3-7fa2f9dee554 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:06.401985 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6e7564dd-b4f7-424e-aef3-7fa2f9dee554 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:06.430909 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6e7564dd-b4f7-424e-aef3-7fa2f9dee554 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043194 Mar 03 02:34:06.431465 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 288/564] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:06 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:06.600096 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e7d4e756-8ffa-43d7-9fce-6eae984ec15c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:06.601147 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e7d4e756-8ffa-43d7-9fce-6eae984ec15c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:06.608088 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e7d4e756-8ffa-43d7-9fce-6eae984ec15c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:06.608531 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e7d4e756-8ffa-43d7-9fce-6eae984ec15c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:06.609301 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e7d4e756-8ffa-43d7-9fce-6eae984ec15c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:06.609729 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e7d4e756-8ffa-43d7-9fce-6eae984ec15c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:06.626360 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9836a610-ac20-4841-83d3-f11b49184e2c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:06.626970 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9836a610-ac20-4841-83d3-f11b49184e2c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:06.632642 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9836a610-ac20-4841-83d3-f11b49184e2c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:06.633114 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9836a610-ac20-4841-83d3-f11b49184e2c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:06.633885 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9836a610-ac20-4841-83d3-f11b49184e2c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:06.634330 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9836a610-ac20-4841-83d3-f11b49184e2c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:06.637792 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e7d4e756-8ffa-43d7-9fce-6eae984ec15c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041591 Mar 03 02:34:06.638354 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 277/565] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:06 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:06.770514 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9836a610-ac20-4841-83d3-f11b49184e2c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:06.779319 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9836a610-ac20-4841-83d3-f11b49184e2c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:06.780869 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9836a610-ac20-4841-83d3-f11b49184e2c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:06.782010 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9836a610-ac20-4841-83d3-f11b49184e2c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.159539 Mar 03 02:34:06.782562 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 289/566] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:06 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:34:06.956921 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8e9feee0-9d1c-401d-b2d8-e9de029ee55f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:06.957668 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8e9feee0-9d1c-401d-b2d8-e9de029ee55f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:06.964505 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8e9feee0-9d1c-401d-b2d8-e9de029ee55f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:06.964952 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8e9feee0-9d1c-401d-b2d8-e9de029ee55f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:06.965719 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8e9feee0-9d1c-401d-b2d8-e9de029ee55f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:06.966151 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8e9feee0-9d1c-401d-b2d8-e9de029ee55f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:07.108711 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8e9feee0-9d1c-401d-b2d8-e9de029ee55f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:07.116355 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8e9feee0-9d1c-401d-b2d8-e9de029ee55f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1758 microversion: 2.1 time: 0.163277 Mar 03 02:34:07.116924 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 278/567] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:34:06 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:34:07.442368 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1360c9ee-da19-44b7-b7cc-7020c5473066 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:07.443279 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1360c9ee-da19-44b7-b7cc-7020c5473066 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:07.450535 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1360c9ee-da19-44b7-b7cc-7020c5473066 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:07.450984 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1360c9ee-da19-44b7-b7cc-7020c5473066 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:07.451802 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1360c9ee-da19-44b7-b7cc-7020c5473066 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:07.452240 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1360c9ee-da19-44b7-b7cc-7020c5473066 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:07.481142 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1360c9ee-da19-44b7-b7cc-7020c5473066 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042629 Mar 03 02:34:07.481690 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 290/568] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:07 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:07.648352 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1e2b7a1c-94f6-41be-b7cf-6bd5c09e8b24 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:07.649262 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1e2b7a1c-94f6-41be-b7cf-6bd5c09e8b24 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:07.655546 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1e2b7a1c-94f6-41be-b7cf-6bd5c09e8b24 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:07.656042 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1e2b7a1c-94f6-41be-b7cf-6bd5c09e8b24 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:07.656816 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1e2b7a1c-94f6-41be-b7cf-6bd5c09e8b24 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:07.657253 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1e2b7a1c-94f6-41be-b7cf-6bd5c09e8b24 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:07.686428 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1e2b7a1c-94f6-41be-b7cf-6bd5c09e8b24 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041896 Mar 03 02:34:07.687190 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 279/569] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:07 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:07.800581 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7664bafc-7682-4676-9a57-39e35539c195 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:07.801234 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7664bafc-7682-4676-9a57-39e35539c195 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:07.808281 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7664bafc-7682-4676-9a57-39e35539c195 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:07.808725 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7664bafc-7682-4676-9a57-39e35539c195 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:07.809538 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7664bafc-7682-4676-9a57-39e35539c195 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:07.809970 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7664bafc-7682-4676-9a57-39e35539c195 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:07.941742 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-7664bafc-7682-4676-9a57-39e35539c195 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:07.949946 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-7664bafc-7682-4676-9a57-39e35539c195 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:07.951425 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-7664bafc-7682-4676-9a57-39e35539c195 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:07.952586 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7664bafc-7682-4676-9a57-39e35539c195 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.155965 Mar 03 02:34:07.953136 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 291/570] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:07 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:08.134140 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-21b7e77b-b72e-41a0-b7d9-1f157bc2a61d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:08.134988 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-21b7e77b-b72e-41a0-b7d9-1f157bc2a61d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:08.140863 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-21b7e77b-b72e-41a0-b7d9-1f157bc2a61d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:08.141267 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-21b7e77b-b72e-41a0-b7d9-1f157bc2a61d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:08.142041 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-21b7e77b-b72e-41a0-b7d9-1f157bc2a61d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:08.142510 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-21b7e77b-b72e-41a0-b7d9-1f157bc2a61d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:08.286222 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-21b7e77b-b72e-41a0-b7d9-1f157bc2a61d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:08.294721 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-21b7e77b-b72e-41a0-b7d9-1f157bc2a61d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1758 microversion: 2.1 time: 0.164427 Mar 03 02:34:08.295285 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 280/571] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:34:08 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:34:08.492329 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-36c2f8e5-f796-4c44-8a45-5abb22633a3e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:08.493148 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-36c2f8e5-f796-4c44-8a45-5abb22633a3e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:08.499889 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-36c2f8e5-f796-4c44-8a45-5abb22633a3e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:08.500340 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-36c2f8e5-f796-4c44-8a45-5abb22633a3e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:08.501117 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-36c2f8e5-f796-4c44-8a45-5abb22633a3e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:08.501554 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-36c2f8e5-f796-4c44-8a45-5abb22633a3e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:08.530589 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-36c2f8e5-f796-4c44-8a45-5abb22633a3e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042274 Mar 03 02:34:08.531140 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 292/572] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:08 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:08.698382 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8be5ce06-9145-436f-b339-1e0cdb4648e7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:08.699295 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8be5ce06-9145-436f-b339-1e0cdb4648e7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:08.706111 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8be5ce06-9145-436f-b339-1e0cdb4648e7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:08.706571 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8be5ce06-9145-436f-b339-1e0cdb4648e7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:08.707371 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8be5ce06-9145-436f-b339-1e0cdb4648e7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:08.707858 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8be5ce06-9145-436f-b339-1e0cdb4648e7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:08.736713 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8be5ce06-9145-436f-b339-1e0cdb4648e7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042681 Mar 03 02:34:08.737269 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 281/573] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:08 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:08.970979 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-cdaaaa2a-3091-4527-8e3e-f44bd1d77420 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:08.971588 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-cdaaaa2a-3091-4527-8e3e-f44bd1d77420 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:08.977401 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cdaaaa2a-3091-4527-8e3e-f44bd1d77420 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:08.977849 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cdaaaa2a-3091-4527-8e3e-f44bd1d77420 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:08.978633 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cdaaaa2a-3091-4527-8e3e-f44bd1d77420 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:08.979070 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cdaaaa2a-3091-4527-8e3e-f44bd1d77420 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:09.108681 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-cdaaaa2a-3091-4527-8e3e-f44bd1d77420 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:09.116675 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-cdaaaa2a-3091-4527-8e3e-f44bd1d77420 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:09.118156 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-cdaaaa2a-3091-4527-8e3e-f44bd1d77420 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:09.119969 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-cdaaaa2a-3091-4527-8e3e-f44bd1d77420 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.152375 Mar 03 02:34:09.120838 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 293/574] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:08 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:09.311934 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d05b19af-14cc-4270-90ad-945fbbd3038b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:09.312536 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d05b19af-14cc-4270-90ad-945fbbd3038b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:09.318324 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d05b19af-14cc-4270-90ad-945fbbd3038b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:09.318769 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d05b19af-14cc-4270-90ad-945fbbd3038b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:09.319537 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d05b19af-14cc-4270-90ad-945fbbd3038b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:09.319998 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d05b19af-14cc-4270-90ad-945fbbd3038b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:09.461359 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d05b19af-14cc-4270-90ad-945fbbd3038b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:09.470062 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d05b19af-14cc-4270-90ad-945fbbd3038b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1758 microversion: 2.1 time: 0.161947 Mar 03 02:34:09.470632 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 282/575] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:34:09 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:34:09.542940 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8db7ff2f-29ed-49f5-8dbc-c2ce713123db tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:09.543805 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8db7ff2f-29ed-49f5-8dbc-c2ce713123db tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:09.549968 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8db7ff2f-29ed-49f5-8dbc-c2ce713123db tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:09.550413 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8db7ff2f-29ed-49f5-8dbc-c2ce713123db tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:09.551182 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8db7ff2f-29ed-49f5-8dbc-c2ce713123db tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:09.551623 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8db7ff2f-29ed-49f5-8dbc-c2ce713123db tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:09.578888 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8db7ff2f-29ed-49f5-8dbc-c2ce713123db tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040839 Mar 03 02:34:09.579435 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 294/576] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:09 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:09.748301 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-31a23521-b3b6-43bf-ba4e-32246d4a0a49 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:09.749211 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-31a23521-b3b6-43bf-ba4e-32246d4a0a49 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:09.756645 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-31a23521-b3b6-43bf-ba4e-32246d4a0a49 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:09.757099 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-31a23521-b3b6-43bf-ba4e-32246d4a0a49 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:09.757884 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-31a23521-b3b6-43bf-ba4e-32246d4a0a49 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:09.758363 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-31a23521-b3b6-43bf-ba4e-32246d4a0a49 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:09.786358 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-31a23521-b3b6-43bf-ba4e-32246d4a0a49 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042549 Mar 03 02:34:09.786913 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 283/577] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:09 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:10.138891 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-633c7689-fd49-43c5-bfb3-c82f01080581 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:10.139523 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-633c7689-fd49-43c5-bfb3-c82f01080581 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:10.145534 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-633c7689-fd49-43c5-bfb3-c82f01080581 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:10.145981 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-633c7689-fd49-43c5-bfb3-c82f01080581 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:10.146789 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-633c7689-fd49-43c5-bfb3-c82f01080581 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:10.147220 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-633c7689-fd49-43c5-bfb3-c82f01080581 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:10.279221 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-633c7689-fd49-43c5-bfb3-c82f01080581 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:10.287335 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-633c7689-fd49-43c5-bfb3-c82f01080581 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:10.288874 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-633c7689-fd49-43c5-bfb3-c82f01080581 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:10.290014 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-633c7689-fd49-43c5-bfb3-c82f01080581 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.155718 Mar 03 02:34:10.290573 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 295/578] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:10 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:10.488181 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-75c57f9c-66ed-4517-8b3a-a5f43c771e89 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:10.488790 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-75c57f9c-66ed-4517-8b3a-a5f43c771e89 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:10.496455 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-75c57f9c-66ed-4517-8b3a-a5f43c771e89 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:10.496906 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-75c57f9c-66ed-4517-8b3a-a5f43c771e89 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:10.497684 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-75c57f9c-66ed-4517-8b3a-a5f43c771e89 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:10.498119 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-75c57f9c-66ed-4517-8b3a-a5f43c771e89 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:10.591134 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-647e6143-5138-4bb8-b13f-82603f150d52 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:10.592119 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-647e6143-5138-4bb8-b13f-82603f150d52 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:10.598984 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-647e6143-5138-4bb8-b13f-82603f150d52 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:10.599442 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-647e6143-5138-4bb8-b13f-82603f150d52 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:10.600276 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-647e6143-5138-4bb8-b13f-82603f150d52 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:10.600749 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-647e6143-5138-4bb8-b13f-82603f150d52 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:10.630567 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-647e6143-5138-4bb8-b13f-82603f150d52 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044034 Mar 03 02:34:10.631126 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 296/579] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:10 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:34:10.642375 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-75c57f9c-66ed-4517-8b3a-a5f43c771e89 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:10.650111 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-75c57f9c-66ed-4517-8b3a-a5f43c771e89 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1758 microversion: 2.1 time: 0.165823 Mar 03 02:34:10.650677 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 284/580] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:34:10 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:34:10.798276 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d0df2244-edb5-4bd5-9ab5-c299db373b03 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:10.799124 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d0df2244-edb5-4bd5-9ab5-c299db373b03 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:10.805686 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d0df2244-edb5-4bd5-9ab5-c299db373b03 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:10.806138 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d0df2244-edb5-4bd5-9ab5-c299db373b03 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:10.807551 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d0df2244-edb5-4bd5-9ab5-c299db373b03 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:10.808011 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d0df2244-edb5-4bd5-9ab5-c299db373b03 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:10.835212 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d0df2244-edb5-4bd5-9ab5-c299db373b03 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040926 Mar 03 02:34:10.835781 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 297/581] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:10 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:11.308043 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1fdbaf7d-b91a-4dcc-9a47-56c8fefd95fa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:11.308619 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1fdbaf7d-b91a-4dcc-9a47-56c8fefd95fa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:11.314852 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1fdbaf7d-b91a-4dcc-9a47-56c8fefd95fa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:11.315306 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1fdbaf7d-b91a-4dcc-9a47-56c8fefd95fa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:11.316118 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1fdbaf7d-b91a-4dcc-9a47-56c8fefd95fa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:11.316568 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1fdbaf7d-b91a-4dcc-9a47-56c8fefd95fa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:11.453261 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1fdbaf7d-b91a-4dcc-9a47-56c8fefd95fa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:11.461309 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1fdbaf7d-b91a-4dcc-9a47-56c8fefd95fa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:11.462808 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1fdbaf7d-b91a-4dcc-9a47-56c8fefd95fa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:11.464237 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1fdbaf7d-b91a-4dcc-9a47-56c8fefd95fa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.160248 Mar 03 02:34:11.464803 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 285/582] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:11 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:11.641471 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-769f02ff-9b15-4f4e-ad1a-56e9292e0f14 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:11.642413 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-769f02ff-9b15-4f4e-ad1a-56e9292e0f14 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:11.648565 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-769f02ff-9b15-4f4e-ad1a-56e9292e0f14 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:11.649027 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-769f02ff-9b15-4f4e-ad1a-56e9292e0f14 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:11.649792 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-769f02ff-9b15-4f4e-ad1a-56e9292e0f14 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:11.650231 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-769f02ff-9b15-4f4e-ad1a-56e9292e0f14 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:11.666530 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5f7773a2-5582-44bb-a01e-a390a935fb1f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:11.667305 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5f7773a2-5582-44bb-a01e-a390a935fb1f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:11.672956 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5f7773a2-5582-44bb-a01e-a390a935fb1f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:11.673401 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5f7773a2-5582-44bb-a01e-a390a935fb1f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:11.674176 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5f7773a2-5582-44bb-a01e-a390a935fb1f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:11.674612 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5f7773a2-5582-44bb-a01e-a390a935fb1f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:11.678754 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-769f02ff-9b15-4f4e-ad1a-56e9292e0f14 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041192 Mar 03 02:34:11.679327 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 298/583] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:11 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:11.818961 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5f7773a2-5582-44bb-a01e-a390a935fb1f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:11.826687 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5f7773a2-5582-44bb-a01e-a390a935fb1f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1758 microversion: 2.1 time: 0.164468 Mar 03 02:34:11.827255 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 286/584] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:34:11 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:34:11.846189 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0f51f0a7-ecdb-457d-ba0d-15e6b3bd0c54 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:11.847097 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0f51f0a7-ecdb-457d-ba0d-15e6b3bd0c54 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:11.852872 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0f51f0a7-ecdb-457d-ba0d-15e6b3bd0c54 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:11.853320 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0f51f0a7-ecdb-457d-ba0d-15e6b3bd0c54 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:11.854697 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0f51f0a7-ecdb-457d-ba0d-15e6b3bd0c54 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:11.855135 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0f51f0a7-ecdb-457d-ba0d-15e6b3bd0c54 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:11.882637 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0f51f0a7-ecdb-457d-ba0d-15e6b3bd0c54 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040297 Mar 03 02:34:11.883184 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 299/585] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:11 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:12.482527 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8ac2bb82-a017-4730-9771-831678b4451e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:12.483135 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8ac2bb82-a017-4730-9771-831678b4451e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:12.489442 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8ac2bb82-a017-4730-9771-831678b4451e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:12.490230 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8ac2bb82-a017-4730-9771-831678b4451e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:12.491019 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8ac2bb82-a017-4730-9771-831678b4451e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:12.491459 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8ac2bb82-a017-4730-9771-831678b4451e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:12.625259 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 02:34:12.625432 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: Thu Mar 3 02:34:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 03 02:34:12.627645 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8ac2bb82-a017-4730-9771-831678b4451e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:12.636607 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8ac2bb82-a017-4730-9771-831678b4451e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:12.638130 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8ac2bb82-a017-4730-9771-831678b4451e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:12.639282 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8ac2bb82-a017-4730-9771-831678b4451e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.160824 Mar 03 02:34:12.639882 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 287/586] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:12 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:12.690623 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a2a3b61c-bbcf-4a85-9c1d-dd9f80c1e5e7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:12.691556 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a2a3b61c-bbcf-4a85-9c1d-dd9f80c1e5e7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:12.699055 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a2a3b61c-bbcf-4a85-9c1d-dd9f80c1e5e7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:12.699502 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a2a3b61c-bbcf-4a85-9c1d-dd9f80c1e5e7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:12.700302 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a2a3b61c-bbcf-4a85-9c1d-dd9f80c1e5e7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:12.700736 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a2a3b61c-bbcf-4a85-9c1d-dd9f80c1e5e7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:12.727256 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a2a3b61c-bbcf-4a85-9c1d-dd9f80c1e5e7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040553 Mar 03 02:34:12.727895 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 300/587] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:12 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:12.843922 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-cddc046e-aa26-456b-9246-c9fb7b023ff1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:12.844525 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-cddc046e-aa26-456b-9246-c9fb7b023ff1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:12.850464 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cddc046e-aa26-456b-9246-c9fb7b023ff1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:12.850908 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cddc046e-aa26-456b-9246-c9fb7b023ff1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:12.851704 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cddc046e-aa26-456b-9246-c9fb7b023ff1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:12.852138 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cddc046e-aa26-456b-9246-c9fb7b023ff1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:12.893249 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1164f565-4a84-46bf-815b-5c17a84de50c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:12.894161 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1164f565-4a84-46bf-815b-5c17a84de50c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:12.900001 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1164f565-4a84-46bf-815b-5c17a84de50c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:12.900456 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1164f565-4a84-46bf-815b-5c17a84de50c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:12.901243 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1164f565-4a84-46bf-815b-5c17a84de50c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:12.901681 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1164f565-4a84-46bf-815b-5c17a84de50c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:12.930322 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1164f565-4a84-46bf-815b-5c17a84de50c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041039 Mar 03 02:34:12.930875 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 301/588] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:12 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:34:12.994604 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-cddc046e-aa26-456b-9246-c9fb7b023ff1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:13.003103 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-cddc046e-aa26-456b-9246-c9fb7b023ff1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1758 microversion: 2.1 time: 0.162946 Mar 03 02:34:13.003699 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 288/589] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:34:12 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:34:13.657873 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2b514b30-53c9-4974-85a5-429cb17817d6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:13.658479 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2b514b30-53c9-4974-85a5-429cb17817d6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:13.664548 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2b514b30-53c9-4974-85a5-429cb17817d6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:13.665029 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2b514b30-53c9-4974-85a5-429cb17817d6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:13.665898 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2b514b30-53c9-4974-85a5-429cb17817d6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:13.666992 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2b514b30-53c9-4974-85a5-429cb17817d6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:13.738460 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3ea15077-826f-4323-a3a1-257e10191619 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:13.739371 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3ea15077-826f-4323-a3a1-257e10191619 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:13.747044 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3ea15077-826f-4323-a3a1-257e10191619 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:13.747495 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3ea15077-826f-4323-a3a1-257e10191619 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:13.748321 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3ea15077-826f-4323-a3a1-257e10191619 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:13.748759 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3ea15077-826f-4323-a3a1-257e10191619 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:13.785287 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3ea15077-826f-4323-a3a1-257e10191619 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050720 Mar 03 02:34:13.786089 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 289/590] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:13 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:34:13.798693 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2b514b30-53c9-4974-85a5-429cb17817d6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:13.808006 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2b514b30-53c9-4974-85a5-429cb17817d6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:13.809518 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2b514b30-53c9-4974-85a5-429cb17817d6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:13.810669 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2b514b30-53c9-4974-85a5-429cb17817d6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.156789 Mar 03 02:34:13.811293 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 302/591] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:13 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:13.942468 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1d65ec20-1ded-4d92-959c-4d04f0d0bccb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:13.943294 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1d65ec20-1ded-4d92-959c-4d04f0d0bccb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:13.949311 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1d65ec20-1ded-4d92-959c-4d04f0d0bccb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:13.949755 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1d65ec20-1ded-4d92-959c-4d04f0d0bccb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:13.950523 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1d65ec20-1ded-4d92-959c-4d04f0d0bccb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:13.950951 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1d65ec20-1ded-4d92-959c-4d04f0d0bccb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:13.978301 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1d65ec20-1ded-4d92-959c-4d04f0d0bccb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039846 Mar 03 02:34:13.979424 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 290/592] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:13 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:14.019898 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8077873b-97f4-416b-8e81-1b1dcda1cfed tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:14.020501 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8077873b-97f4-416b-8e81-1b1dcda1cfed tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:14.027472 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8077873b-97f4-416b-8e81-1b1dcda1cfed tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:14.027966 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8077873b-97f4-416b-8e81-1b1dcda1cfed tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:14.028747 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8077873b-97f4-416b-8e81-1b1dcda1cfed tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:14.029182 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8077873b-97f4-416b-8e81-1b1dcda1cfed tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:14.175852 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8077873b-97f4-416b-8e81-1b1dcda1cfed tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:14.183912 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8077873b-97f4-416b-8e81-1b1dcda1cfed tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1758 microversion: 2.1 time: 0.167736 Mar 03 02:34:14.184482 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 303/593] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:34:14 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:34:14.797109 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6b0785bc-ef36-4678-a022-b4b626e90126 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:14.798015 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6b0785bc-ef36-4678-a022-b4b626e90126 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:14.804728 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6b0785bc-ef36-4678-a022-b4b626e90126 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:14.805200 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6b0785bc-ef36-4678-a022-b4b626e90126 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:14.805982 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6b0785bc-ef36-4678-a022-b4b626e90126 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:14.806411 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6b0785bc-ef36-4678-a022-b4b626e90126 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:14.829530 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-57f1d376-c0c5-42f8-a9f8-2a3a4477094f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:14.830132 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-57f1d376-c0c5-42f8-a9f8-2a3a4477094f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:14.835518 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6b0785bc-ef36-4678-a022-b4b626e90126 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042324 Mar 03 02:34:14.836115 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 291/594] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:14 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:14.836450 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-57f1d376-c0c5-42f8-a9f8-2a3a4477094f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:14.836911 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-57f1d376-c0c5-42f8-a9f8-2a3a4477094f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:14.837691 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-57f1d376-c0c5-42f8-a9f8-2a3a4477094f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:14.838638 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-57f1d376-c0c5-42f8-a9f8-2a3a4477094f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:14.967187 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-57f1d376-c0c5-42f8-a9f8-2a3a4477094f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:14.975391 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-57f1d376-c0c5-42f8-a9f8-2a3a4477094f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:14.976920 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-57f1d376-c0c5-42f8-a9f8-2a3a4477094f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:14.978095 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-57f1d376-c0c5-42f8-a9f8-2a3a4477094f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.152509 Mar 03 02:34:14.979169 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 304/595] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:14 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:34:14.990342 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7c5019ae-a470-438e-980b-ab715132ec23 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:14.991257 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7c5019ae-a470-438e-980b-ab715132ec23 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:14.998218 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c5019ae-a470-438e-980b-ab715132ec23 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:14.998674 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c5019ae-a470-438e-980b-ab715132ec23 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:14.999461 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c5019ae-a470-438e-980b-ab715132ec23 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:14.999927 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c5019ae-a470-438e-980b-ab715132ec23 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:15.028441 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7c5019ae-a470-438e-980b-ab715132ec23 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042047 Mar 03 02:34:15.029052 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 292/596] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:14 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:15.200557 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-af9633fd-f620-4fef-8ec8-92bd6d561009 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:15.201156 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-af9633fd-f620-4fef-8ec8-92bd6d561009 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:15.206929 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-af9633fd-f620-4fef-8ec8-92bd6d561009 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:15.207375 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-af9633fd-f620-4fef-8ec8-92bd6d561009 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:15.208180 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-af9633fd-f620-4fef-8ec8-92bd6d561009 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:15.208612 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-af9633fd-f620-4fef-8ec8-92bd6d561009 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:15.350668 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-af9633fd-f620-4fef-8ec8-92bd6d561009 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:15.359026 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-af9633fd-f620-4fef-8ec8-92bd6d561009 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1758 microversion: 2.1 time: 0.162328 Mar 03 02:34:15.359633 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 305/597] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:34:15 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:34:15.846163 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-025e4cdc-2c6e-42b7-abb3-2c8d36c1ab9b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:15.847061 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-025e4cdc-2c6e-42b7-abb3-2c8d36c1ab9b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:15.853149 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-025e4cdc-2c6e-42b7-abb3-2c8d36c1ab9b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:15.854114 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-025e4cdc-2c6e-42b7-abb3-2c8d36c1ab9b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:15.854882 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-025e4cdc-2c6e-42b7-abb3-2c8d36c1ab9b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:15.855314 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-025e4cdc-2c6e-42b7-abb3-2c8d36c1ab9b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:15.883018 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-025e4cdc-2c6e-42b7-abb3-2c8d36c1ab9b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040730 Mar 03 02:34:15.883552 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 293/598] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:15 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:15.996662 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3306fb9c-eddf-40ad-b2e9-c49c257a37c6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:15.997273 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3306fb9c-eddf-40ad-b2e9-c49c257a37c6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:16.003588 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3306fb9c-eddf-40ad-b2e9-c49c257a37c6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:16.004070 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3306fb9c-eddf-40ad-b2e9-c49c257a37c6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:16.004857 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3306fb9c-eddf-40ad-b2e9-c49c257a37c6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:16.005304 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3306fb9c-eddf-40ad-b2e9-c49c257a37c6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:16.039906 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-588ca73b-2279-4a9e-9ffd-dbb3671a4b97 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:16.040809 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-588ca73b-2279-4a9e-9ffd-dbb3671a4b97 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:16.047368 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-588ca73b-2279-4a9e-9ffd-dbb3671a4b97 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:16.047850 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-588ca73b-2279-4a9e-9ffd-dbb3671a4b97 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:16.048638 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-588ca73b-2279-4a9e-9ffd-dbb3671a4b97 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:16.049073 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-588ca73b-2279-4a9e-9ffd-dbb3671a4b97 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:16.078014 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-588ca73b-2279-4a9e-9ffd-dbb3671a4b97 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041982 Mar 03 02:34:16.078580 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 294/599] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:16 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:34:16.137784 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3306fb9c-eddf-40ad-b2e9-c49c257a37c6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:16.145730 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3306fb9c-eddf-40ad-b2e9-c49c257a37c6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:16.147206 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3306fb9c-eddf-40ad-b2e9-c49c257a37c6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:16.148367 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3306fb9c-eddf-40ad-b2e9-c49c257a37c6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.156595 Mar 03 02:34:16.149121 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 306/600] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:15 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:16.376293 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e3d2cbd1-bb98-4d67-9b51-dbff96903eb9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:16.376822 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e3d2cbd1-bb98-4d67-9b51-dbff96903eb9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:16.382529 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e3d2cbd1-bb98-4d67-9b51-dbff96903eb9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:16.382979 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e3d2cbd1-bb98-4d67-9b51-dbff96903eb9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:16.383779 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e3d2cbd1-bb98-4d67-9b51-dbff96903eb9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:16.384213 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e3d2cbd1-bb98-4d67-9b51-dbff96903eb9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:16.529519 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e3d2cbd1-bb98-4d67-9b51-dbff96903eb9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:16.537176 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e3d2cbd1-bb98-4d67-9b51-dbff96903eb9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1758 microversion: 2.1 time: 0.164787 Mar 03 02:34:16.537740 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 295/601] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:34:16 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:34:16.894151 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-de8028e4-3967-482b-8cc6-f301493c59a3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:16.895143 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-de8028e4-3967-482b-8cc6-f301493c59a3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:16.901037 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-de8028e4-3967-482b-8cc6-f301493c59a3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:16.902022 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-de8028e4-3967-482b-8cc6-f301493c59a3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:16.902792 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-de8028e4-3967-482b-8cc6-f301493c59a3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:16.903222 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-de8028e4-3967-482b-8cc6-f301493c59a3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:16.933606 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-de8028e4-3967-482b-8cc6-f301493c59a3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043306 Mar 03 02:34:16.934133 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 307/602] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:16 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:17.089828 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3cb994a0-3691-48f1-91df-ef375238a41c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:17.090670 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3cb994a0-3691-48f1-91df-ef375238a41c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:17.096861 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3cb994a0-3691-48f1-91df-ef375238a41c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:17.097312 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3cb994a0-3691-48f1-91df-ef375238a41c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:17.098095 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3cb994a0-3691-48f1-91df-ef375238a41c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:17.098536 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3cb994a0-3691-48f1-91df-ef375238a41c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:17.127147 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3cb994a0-3691-48f1-91df-ef375238a41c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041548 Mar 03 02:34:17.127731 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 296/603] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:17 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:17.166002 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-501e19a3-185e-48ca-a088-9d2c6d813da7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:17.166595 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-501e19a3-185e-48ca-a088-9d2c6d813da7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:17.172859 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-501e19a3-185e-48ca-a088-9d2c6d813da7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:17.173312 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-501e19a3-185e-48ca-a088-9d2c6d813da7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:17.174097 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-501e19a3-185e-48ca-a088-9d2c6d813da7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:17.174535 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-501e19a3-185e-48ca-a088-9d2c6d813da7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:17.304872 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-501e19a3-185e-48ca-a088-9d2c6d813da7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:17.313402 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-501e19a3-185e-48ca-a088-9d2c6d813da7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:17.314887 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-501e19a3-185e-48ca-a088-9d2c6d813da7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:17.316062 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-501e19a3-185e-48ca-a088-9d2c6d813da7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.153911 Mar 03 02:34:17.316620 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 308/604] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:17 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:17.554975 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b6c5e760-5a97-40ec-8d29-53c7577c677f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:17.555506 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b6c5e760-5a97-40ec-8d29-53c7577c677f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:17.562195 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b6c5e760-5a97-40ec-8d29-53c7577c677f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:17.562648 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b6c5e760-5a97-40ec-8d29-53c7577c677f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:17.563427 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b6c5e760-5a97-40ec-8d29-53c7577c677f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:17.563903 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b6c5e760-5a97-40ec-8d29-53c7577c677f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:17.705120 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b6c5e760-5a97-40ec-8d29-53c7577c677f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:17.713429 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b6c5e760-5a97-40ec-8d29-53c7577c677f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1758 microversion: 2.1 time: 0.161876 Mar 03 02:34:17.713993 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 297/605] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:34:17 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:34:17.944825 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-93b8d4e6-416b-4e9e-8ef4-0aefbcd67a6c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:17.945727 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-93b8d4e6-416b-4e9e-8ef4-0aefbcd67a6c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:17.951596 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-93b8d4e6-416b-4e9e-8ef4-0aefbcd67a6c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:17.952066 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-93b8d4e6-416b-4e9e-8ef4-0aefbcd67a6c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:17.952839 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-93b8d4e6-416b-4e9e-8ef4-0aefbcd67a6c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:17.953270 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-93b8d4e6-416b-4e9e-8ef4-0aefbcd67a6c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:17.980996 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-93b8d4e6-416b-4e9e-8ef4-0aefbcd67a6c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040185 Mar 03 02:34:17.981536 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 309/606] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:17 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:18.138961 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1d578a17-754c-431c-ac74-c5f741d26097 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:18.139845 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1d578a17-754c-431c-ac74-c5f741d26097 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:18.146069 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1d578a17-754c-431c-ac74-c5f741d26097 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:18.146526 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1d578a17-754c-431c-ac74-c5f741d26097 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:18.147307 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1d578a17-754c-431c-ac74-c5f741d26097 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:18.147782 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1d578a17-754c-431c-ac74-c5f741d26097 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:18.175512 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1d578a17-754c-431c-ac74-c5f741d26097 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041121 Mar 03 02:34:18.176095 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 298/607] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:18 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:18.333796 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b155b7f8-009b-4f17-a700-f0063e1860f7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:18.334399 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b155b7f8-009b-4f17-a700-f0063e1860f7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:18.341575 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b155b7f8-009b-4f17-a700-f0063e1860f7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:18.342024 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b155b7f8-009b-4f17-a700-f0063e1860f7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:18.342801 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b155b7f8-009b-4f17-a700-f0063e1860f7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:18.343240 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b155b7f8-009b-4f17-a700-f0063e1860f7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:18.476557 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b155b7f8-009b-4f17-a700-f0063e1860f7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:18.484580 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b155b7f8-009b-4f17-a700-f0063e1860f7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:18.486061 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b155b7f8-009b-4f17-a700-f0063e1860f7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:18.487227 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b155b7f8-009b-4f17-a700-f0063e1860f7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.157353 Mar 03 02:34:18.487806 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 310/608] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:18 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:18.730264 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-80a7b1da-25ac-4e53-817e-6128c1394526 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:18.730813 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-80a7b1da-25ac-4e53-817e-6128c1394526 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:18.736643 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-80a7b1da-25ac-4e53-817e-6128c1394526 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:18.737089 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-80a7b1da-25ac-4e53-817e-6128c1394526 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:18.737873 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-80a7b1da-25ac-4e53-817e-6128c1394526 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:18.738312 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-80a7b1da-25ac-4e53-817e-6128c1394526 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:18.884384 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-80a7b1da-25ac-4e53-817e-6128c1394526 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:18.892309 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-80a7b1da-25ac-4e53-817e-6128c1394526 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1758 microversion: 2.1 time: 0.165915 Mar 03 02:34:18.892884 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 299/609] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:34:18 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:34:18.992407 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-78a6881a-299c-4701-82d2-a368ad197b1c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:18.993272 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-78a6881a-299c-4701-82d2-a368ad197b1c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:18.999394 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-78a6881a-299c-4701-82d2-a368ad197b1c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:18.999885 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-78a6881a-299c-4701-82d2-a368ad197b1c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:19.000658 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-78a6881a-299c-4701-82d2-a368ad197b1c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:19.001087 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-78a6881a-299c-4701-82d2-a368ad197b1c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:19.029619 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-78a6881a-299c-4701-82d2-a368ad197b1c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041235 Mar 03 02:34:19.030156 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 311/610] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:18 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:19.099541 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e068732d-76d6-4d38-b7b4-e02546802e50 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:19.100071 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e068732d-76d6-4d38-b7b4-e02546802e50 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:19.105831 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e068732d-76d6-4d38-b7b4-e02546802e50 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:19.106282 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e068732d-76d6-4d38-b7b4-e02546802e50 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:19.107064 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e068732d-76d6-4d38-b7b4-e02546802e50 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:19.107501 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e068732d-76d6-4d38-b7b4-e02546802e50 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:19.182466 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.objects.instance [None req-e068732d-76d6-4d38-b7b4-e02546802e50 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lazy-loading 'services' on Instance uuid df03ab77-ba2a-4603-b517-8e7b435882f2 {{(pid=116858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 03 02:34:19.186723 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-19426cdd-455a-46cd-9522-03dde6a9fb78 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:19.187907 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-19426cdd-455a-46cd-9522-03dde6a9fb78 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:19.193545 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-19426cdd-455a-46cd-9522-03dde6a9fb78 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:19.193992 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-19426cdd-455a-46cd-9522-03dde6a9fb78 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:19.194770 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-19426cdd-455a-46cd-9522-03dde6a9fb78 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:19.195206 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-19426cdd-455a-46cd-9522-03dde6a9fb78 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:19.225500 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-19426cdd-455a-46cd-9522-03dde6a9fb78 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042583 Mar 03 02:34:19.230036 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 312/611] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:19 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:34:19.252014 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e068732d-76d6-4d38-b7b4-e02546802e50 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "DELETE /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments/11ff84ea-b1e5-4148-ba60-3f66b05ab802" status: 202 len: 0 microversion: 2.1 time: 0.156201 Mar 03 02:34:19.252722 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 300/612] 10.222.0.30 () {58 vars in 1415 bytes} [Thu Mar 3 02:34:19 2022] DELETE /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments/11ff84ea-b1e5-4148-ba60-3f66b05ab802 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 03 02:34:19.506092 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-926263f4-9d9e-4ef6-90a7-ecfad14ef11e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:19.506608 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-926263f4-9d9e-4ef6-90a7-ecfad14ef11e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:19.513688 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-926263f4-9d9e-4ef6-90a7-ecfad14ef11e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:19.514138 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-926263f4-9d9e-4ef6-90a7-ecfad14ef11e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:19.514911 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-926263f4-9d9e-4ef6-90a7-ecfad14ef11e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:19.515341 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-926263f4-9d9e-4ef6-90a7-ecfad14ef11e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:19.643201 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-926263f4-9d9e-4ef6-90a7-ecfad14ef11e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:19.651298 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-926263f4-9d9e-4ef6-90a7-ecfad14ef11e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:19.652839 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-926263f4-9d9e-4ef6-90a7-ecfad14ef11e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:19.653983 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-926263f4-9d9e-4ef6-90a7-ecfad14ef11e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.151798 Mar 03 02:34:19.654544 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 313/613] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:19 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:19.910355 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6f10f1be-fd4b-4658-8090-949cb980e1b4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:19.911077 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6f10f1be-fd4b-4658-8090-949cb980e1b4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:19.917907 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6f10f1be-fd4b-4658-8090-949cb980e1b4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:19.918357 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6f10f1be-fd4b-4658-8090-949cb980e1b4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:19.919137 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6f10f1be-fd4b-4658-8090-949cb980e1b4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:19.919573 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6f10f1be-fd4b-4658-8090-949cb980e1b4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:20.042141 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1aaada6b-f861-43ac-9a7f-a64efbc3ff2a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:20.043224 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1aaada6b-f861-43ac-9a7f-a64efbc3ff2a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:20.049098 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1aaada6b-f861-43ac-9a7f-a64efbc3ff2a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:20.049545 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1aaada6b-f861-43ac-9a7f-a64efbc3ff2a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:20.050331 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1aaada6b-f861-43ac-9a7f-a64efbc3ff2a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:20.050766 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1aaada6b-f861-43ac-9a7f-a64efbc3ff2a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:20.068934 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6f10f1be-fd4b-4658-8090-949cb980e1b4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:20.076871 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6f10f1be-fd4b-4658-8090-949cb980e1b4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1758 microversion: 2.1 time: 0.170875 Mar 03 02:34:20.077354 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 301/614] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:34:19 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:34:20.079141 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1aaada6b-f861-43ac-9a7f-a64efbc3ff2a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041789 Mar 03 02:34:20.079708 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 314/615] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:20 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:20.237289 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-25aff374-631d-46ab-8e06-6d7307b3f235 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:20.238173 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-25aff374-631d-46ab-8e06-6d7307b3f235 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:20.244579 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-25aff374-631d-46ab-8e06-6d7307b3f235 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:20.245279 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-25aff374-631d-46ab-8e06-6d7307b3f235 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:20.246062 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-25aff374-631d-46ab-8e06-6d7307b3f235 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:20.246493 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-25aff374-631d-46ab-8e06-6d7307b3f235 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:20.273639 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-25aff374-631d-46ab-8e06-6d7307b3f235 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040273 Mar 03 02:34:20.274212 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 302/616] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:20 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:20.670885 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-79f42d24-902e-4dd7-be81-99570759276b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:20.671513 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-79f42d24-902e-4dd7-be81-99570759276b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:20.677707 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-79f42d24-902e-4dd7-be81-99570759276b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:20.678151 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-79f42d24-902e-4dd7-be81-99570759276b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:20.678917 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-79f42d24-902e-4dd7-be81-99570759276b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:20.679361 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-79f42d24-902e-4dd7-be81-99570759276b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:20.813321 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-79f42d24-902e-4dd7-be81-99570759276b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:20.821355 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-79f42d24-902e-4dd7-be81-99570759276b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:20.823461 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-79f42d24-902e-4dd7-be81-99570759276b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:20.824616 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-79f42d24-902e-4dd7-be81-99570759276b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.157597 Mar 03 02:34:20.825172 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 315/617] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:20 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:21.090601 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-98534a26-40ea-455e-b703-1ecd53ac258b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:21.091506 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-98534a26-40ea-455e-b703-1ecd53ac258b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:21.093598 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-93fc2370-aa85-4a0a-877b-b30bfb908d72 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:21.094211 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-93fc2370-aa85-4a0a-877b-b30bfb908d72 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:21.097448 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-98534a26-40ea-455e-b703-1ecd53ac258b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:21.097907 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-98534a26-40ea-455e-b703-1ecd53ac258b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:21.098697 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-98534a26-40ea-455e-b703-1ecd53ac258b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:21.099140 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-98534a26-40ea-455e-b703-1ecd53ac258b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:21.099858 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-93fc2370-aa85-4a0a-877b-b30bfb908d72 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:21.100310 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-93fc2370-aa85-4a0a-877b-b30bfb908d72 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:21.101088 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-93fc2370-aa85-4a0a-877b-b30bfb908d72 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:21.101528 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-93fc2370-aa85-4a0a-877b-b30bfb908d72 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:21.127992 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-98534a26-40ea-455e-b703-1ecd53ac258b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041541 Mar 03 02:34:21.128559 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 303/618] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:21 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:21.243548 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-93fc2370-aa85-4a0a-877b-b30bfb908d72 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:21.252270 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-93fc2370-aa85-4a0a-877b-b30bfb908d72 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1758 microversion: 2.1 time: 0.162438 Mar 03 02:34:21.252832 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 316/619] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:34:21 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:34:21.285457 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-61efcb6c-ae5e-4162-b2bb-7ec044bd7a17 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:21.286380 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-61efcb6c-ae5e-4162-b2bb-7ec044bd7a17 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:21.293285 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-61efcb6c-ae5e-4162-b2bb-7ec044bd7a17 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:21.293736 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-61efcb6c-ae5e-4162-b2bb-7ec044bd7a17 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:21.294601 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-61efcb6c-ae5e-4162-b2bb-7ec044bd7a17 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:21.295048 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-61efcb6c-ae5e-4162-b2bb-7ec044bd7a17 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:21.323256 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-61efcb6c-ae5e-4162-b2bb-7ec044bd7a17 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041692 Mar 03 02:34:21.323835 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 304/620] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:21 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:21.843249 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-34ef454a-a8dd-45cd-83a7-21dbb2922be2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:21.843856 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-34ef454a-a8dd-45cd-83a7-21dbb2922be2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:21.850987 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-34ef454a-a8dd-45cd-83a7-21dbb2922be2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:21.851429 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-34ef454a-a8dd-45cd-83a7-21dbb2922be2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:21.852245 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-34ef454a-a8dd-45cd-83a7-21dbb2922be2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:21.852675 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-34ef454a-a8dd-45cd-83a7-21dbb2922be2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:21.985034 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-34ef454a-a8dd-45cd-83a7-21dbb2922be2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:21.993141 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-34ef454a-a8dd-45cd-83a7-21dbb2922be2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:21.994932 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-34ef454a-a8dd-45cd-83a7-21dbb2922be2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:21.996363 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-34ef454a-a8dd-45cd-83a7-21dbb2922be2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.157054 Mar 03 02:34:21.996911 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 317/621] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:21 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:22.140861 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1e8b515b-73ec-4a57-8c37-30044392a19b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:22.141690 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1e8b515b-73ec-4a57-8c37-30044392a19b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:22.147496 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1e8b515b-73ec-4a57-8c37-30044392a19b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:22.147975 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1e8b515b-73ec-4a57-8c37-30044392a19b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:22.148752 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1e8b515b-73ec-4a57-8c37-30044392a19b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:22.149180 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1e8b515b-73ec-4a57-8c37-30044392a19b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:22.177080 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1e8b515b-73ec-4a57-8c37-30044392a19b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040399 Mar 03 02:34:22.177627 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 305/622] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:22 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:34:22.269258 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-594a956e-a702-4d3f-a775-4bfbca540628 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:22.269888 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-594a956e-a702-4d3f-a775-4bfbca540628 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:22.275922 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-594a956e-a702-4d3f-a775-4bfbca540628 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:22.276085 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-594a956e-a702-4d3f-a775-4bfbca540628 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:22.276853 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-594a956e-a702-4d3f-a775-4bfbca540628 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:22.277288 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-594a956e-a702-4d3f-a775-4bfbca540628 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:22.334535 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-191fa5ed-f7b7-4912-8ff7-b69b5377519c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:22.335484 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-191fa5ed-f7b7-4912-8ff7-b69b5377519c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:22.342005 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-191fa5ed-f7b7-4912-8ff7-b69b5377519c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:22.342449 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-191fa5ed-f7b7-4912-8ff7-b69b5377519c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:22.343254 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-191fa5ed-f7b7-4912-8ff7-b69b5377519c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:22.343707 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-191fa5ed-f7b7-4912-8ff7-b69b5377519c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:22.373279 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-191fa5ed-f7b7-4912-8ff7-b69b5377519c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042648 Mar 03 02:34:22.374084 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 306/623] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:22 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:34:22.426825 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-594a956e-a702-4d3f-a775-4bfbca540628 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:22.435145 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-594a956e-a702-4d3f-a775-4bfbca540628 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1761 microversion: 2.1 time: 0.169827 Mar 03 02:34:22.435757 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 318/624] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:34:22 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1761 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:34:23.014802 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b2c359e7-f5f0-4c9b-a951-027dc9205b97 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:23.015398 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b2c359e7-f5f0-4c9b-a951-027dc9205b97 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:23.021192 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b2c359e7-f5f0-4c9b-a951-027dc9205b97 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:23.021643 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b2c359e7-f5f0-4c9b-a951-027dc9205b97 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:23.022421 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b2c359e7-f5f0-4c9b-a951-027dc9205b97 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:23.022882 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b2c359e7-f5f0-4c9b-a951-027dc9205b97 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:23.152594 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b2c359e7-f5f0-4c9b-a951-027dc9205b97 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:23.160611 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b2c359e7-f5f0-4c9b-a951-027dc9205b97 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:23.162111 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b2c359e7-f5f0-4c9b-a951-027dc9205b97 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:23.163258 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b2c359e7-f5f0-4c9b-a951-027dc9205b97 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.152397 Mar 03 02:34:23.163854 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 307/625] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:23 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:23.188318 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5f28e7b0-d9e4-4c61-a70f-6284d2cfb25b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:23.189221 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5f28e7b0-d9e4-4c61-a70f-6284d2cfb25b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:23.195428 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5f28e7b0-d9e4-4c61-a70f-6284d2cfb25b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:23.195906 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5f28e7b0-d9e4-4c61-a70f-6284d2cfb25b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:23.196679 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5f28e7b0-d9e4-4c61-a70f-6284d2cfb25b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:23.197494 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5f28e7b0-d9e4-4c61-a70f-6284d2cfb25b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:23.225552 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5f28e7b0-d9e4-4c61-a70f-6284d2cfb25b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041293 Mar 03 02:34:23.226105 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 319/626] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:23 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:23.385485 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3dd8e3b4-916e-4989-a088-7ae55d7c1d27 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:23.386444 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3dd8e3b4-916e-4989-a088-7ae55d7c1d27 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:23.392368 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3dd8e3b4-916e-4989-a088-7ae55d7c1d27 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:23.392815 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3dd8e3b4-916e-4989-a088-7ae55d7c1d27 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:23.393586 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3dd8e3b4-916e-4989-a088-7ae55d7c1d27 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:23.394024 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3dd8e3b4-916e-4989-a088-7ae55d7c1d27 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:23.422143 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3dd8e3b4-916e-4989-a088-7ae55d7c1d27 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041260 Mar 03 02:34:23.422702 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 308/627] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:23 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:24.182406 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f2fb7f0e-dee2-4046-8e06-3f480d276061 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:24.183014 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f2fb7f0e-dee2-4046-8e06-3f480d276061 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:24.189133 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f2fb7f0e-dee2-4046-8e06-3f480d276061 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:24.189683 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f2fb7f0e-dee2-4046-8e06-3f480d276061 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:24.190380 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f2fb7f0e-dee2-4046-8e06-3f480d276061 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:24.190813 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f2fb7f0e-dee2-4046-8e06-3f480d276061 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:24.237835 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d689ec5a-9782-4f43-bf5b-a4ca309fa50c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:24.238880 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d689ec5a-9782-4f43-bf5b-a4ca309fa50c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:24.246232 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d689ec5a-9782-4f43-bf5b-a4ca309fa50c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:24.246688 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d689ec5a-9782-4f43-bf5b-a4ca309fa50c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:24.247475 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d689ec5a-9782-4f43-bf5b-a4ca309fa50c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:24.247941 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d689ec5a-9782-4f43-bf5b-a4ca309fa50c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:24.276328 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d689ec5a-9782-4f43-bf5b-a4ca309fa50c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042637 Mar 03 02:34:24.276907 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 309/628] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:24 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:34:24.321435 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f2fb7f0e-dee2-4046-8e06-3f480d276061 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:24.329463 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f2fb7f0e-dee2-4046-8e06-3f480d276061 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:24.330935 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f2fb7f0e-dee2-4046-8e06-3f480d276061 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:24.332109 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f2fb7f0e-dee2-4046-8e06-3f480d276061 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.154268 Mar 03 02:34:24.332670 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 320/629] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:24 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:24.434460 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8c3e4327-8f6d-44f2-81e0-7da21cfb01f1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:24.435370 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8c3e4327-8f6d-44f2-81e0-7da21cfb01f1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:24.441151 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8c3e4327-8f6d-44f2-81e0-7da21cfb01f1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:24.441605 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8c3e4327-8f6d-44f2-81e0-7da21cfb01f1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:24.442391 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8c3e4327-8f6d-44f2-81e0-7da21cfb01f1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:24.442831 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8c3e4327-8f6d-44f2-81e0-7da21cfb01f1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:24.470727 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8c3e4327-8f6d-44f2-81e0-7da21cfb01f1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040832 Mar 03 02:34:24.471277 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 310/630] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:24 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:25.287108 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-24758c80-d249-4cde-93c3-b696f7b44dd5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:25.288062 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-24758c80-d249-4cde-93c3-b696f7b44dd5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:25.294422 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-24758c80-d249-4cde-93c3-b696f7b44dd5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:25.294815 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-24758c80-d249-4cde-93c3-b696f7b44dd5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:25.295628 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-24758c80-d249-4cde-93c3-b696f7b44dd5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:25.296067 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-24758c80-d249-4cde-93c3-b696f7b44dd5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:25.324357 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-24758c80-d249-4cde-93c3-b696f7b44dd5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041070 Mar 03 02:34:25.324904 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 321/631] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:25 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:25.350451 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4dc9bf5b-fe25-482c-bbc3-60c01e3287eb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:25.351095 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4dc9bf5b-fe25-482c-bbc3-60c01e3287eb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:25.357810 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4dc9bf5b-fe25-482c-bbc3-60c01e3287eb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:25.358258 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4dc9bf5b-fe25-482c-bbc3-60c01e3287eb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:25.359039 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4dc9bf5b-fe25-482c-bbc3-60c01e3287eb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:25.359482 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4dc9bf5b-fe25-482c-bbc3-60c01e3287eb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:25.482313 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-219f847a-72e3-482c-a4bb-fd28d2edea85 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:25.483288 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-219f847a-72e3-482c-a4bb-fd28d2edea85 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:25.489218 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-219f847a-72e3-482c-a4bb-fd28d2edea85 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:25.489691 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-219f847a-72e3-482c-a4bb-fd28d2edea85 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:25.490477 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-219f847a-72e3-482c-a4bb-fd28d2edea85 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:25.490953 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-219f847a-72e3-482c-a4bb-fd28d2edea85 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:25.492222 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4dc9bf5b-fe25-482c-bbc3-60c01e3287eb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:25.501440 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4dc9bf5b-fe25-482c-bbc3-60c01e3287eb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:25.503275 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4dc9bf5b-fe25-482c-bbc3-60c01e3287eb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:25.504450 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4dc9bf5b-fe25-482c-bbc3-60c01e3287eb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.158298 Mar 03 02:34:25.505013 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 311/632] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:25 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:34:25.520158 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-219f847a-72e3-482c-a4bb-fd28d2edea85 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041888 Mar 03 02:34:25.520703 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 322/633] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:25 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:34:26.335782 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4de5713b-e356-4f5d-9cc7-acd761e0103b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:26.336706 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4de5713b-e356-4f5d-9cc7-acd761e0103b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:26.343558 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4de5713b-e356-4f5d-9cc7-acd761e0103b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:26.344040 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4de5713b-e356-4f5d-9cc7-acd761e0103b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:26.344821 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4de5713b-e356-4f5d-9cc7-acd761e0103b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:26.345262 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4de5713b-e356-4f5d-9cc7-acd761e0103b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:26.373134 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4de5713b-e356-4f5d-9cc7-acd761e0103b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041328 Mar 03 02:34:26.373674 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 312/634] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:26 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:26.522326 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-28ad5fca-4266-497b-a357-8cea1eed015f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:26.522930 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-28ad5fca-4266-497b-a357-8cea1eed015f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:26.530492 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-28ad5fca-4266-497b-a357-8cea1eed015f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:26.530970 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-28ad5fca-4266-497b-a357-8cea1eed015f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:26.531797 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-28ad5fca-4266-497b-a357-8cea1eed015f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:26.532234 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-28ad5fca-4266-497b-a357-8cea1eed015f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:26.532549 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d8f6b8c8-4da3-4258-ae50-f432e3ff383c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:26.533535 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d8f6b8c8-4da3-4258-ae50-f432e3ff383c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:26.539481 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d8f6b8c8-4da3-4258-ae50-f432e3ff383c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:26.539986 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d8f6b8c8-4da3-4258-ae50-f432e3ff383c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:26.540777 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d8f6b8c8-4da3-4258-ae50-f432e3ff383c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:26.541464 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d8f6b8c8-4da3-4258-ae50-f432e3ff383c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:26.570425 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d8f6b8c8-4da3-4258-ae50-f432e3ff383c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041910 Mar 03 02:34:26.570991 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 313/635] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:26 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:26.666356 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-28ad5fca-4266-497b-a357-8cea1eed015f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:26.674464 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-28ad5fca-4266-497b-a357-8cea1eed015f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:26.675978 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-28ad5fca-4266-497b-a357-8cea1eed015f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:26.677112 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-28ad5fca-4266-497b-a357-8cea1eed015f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.158825 Mar 03 02:34:26.677665 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 323/636] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:26 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:27.384787 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-300a5e80-0d55-40cc-a414-e630f765932d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:27.385858 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-300a5e80-0d55-40cc-a414-e630f765932d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:27.392251 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-300a5e80-0d55-40cc-a414-e630f765932d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:27.392696 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-300a5e80-0d55-40cc-a414-e630f765932d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:27.393477 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-300a5e80-0d55-40cc-a414-e630f765932d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:27.393906 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-300a5e80-0d55-40cc-a414-e630f765932d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:27.421256 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-300a5e80-0d55-40cc-a414-e630f765932d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040528 Mar 03 02:34:27.421798 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 314/637] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:27 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:27.582463 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c8e26c5a-269e-4625-9def-b7165a3cfbbc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:27.583363 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c8e26c5a-269e-4625-9def-b7165a3cfbbc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:27.590482 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c8e26c5a-269e-4625-9def-b7165a3cfbbc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:27.590926 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c8e26c5a-269e-4625-9def-b7165a3cfbbc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:27.591731 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c8e26c5a-269e-4625-9def-b7165a3cfbbc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:27.592166 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c8e26c5a-269e-4625-9def-b7165a3cfbbc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:27.619749 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c8e26c5a-269e-4625-9def-b7165a3cfbbc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041142 Mar 03 02:34:27.620556 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 324/638] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:27 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:27.694314 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a5edced4-9b5e-461e-9b77-481dbe4e73f0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:27.695464 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a5edced4-9b5e-461e-9b77-481dbe4e73f0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:27.702018 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a5edced4-9b5e-461e-9b77-481dbe4e73f0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:27.702470 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a5edced4-9b5e-461e-9b77-481dbe4e73f0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:27.703251 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a5edced4-9b5e-461e-9b77-481dbe4e73f0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:27.703714 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a5edced4-9b5e-461e-9b77-481dbe4e73f0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:27.837773 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a5edced4-9b5e-461e-9b77-481dbe4e73f0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:27.845818 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a5edced4-9b5e-461e-9b77-481dbe4e73f0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:27.847316 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a5edced4-9b5e-461e-9b77-481dbe4e73f0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:27.848475 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a5edced4-9b5e-461e-9b77-481dbe4e73f0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.158078 Mar 03 02:34:27.849034 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 315/639] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:27 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:28.432669 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7efaa736-e7df-4744-9807-63f289972bac tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:28.433605 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7efaa736-e7df-4744-9807-63f289972bac tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:28.439446 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7efaa736-e7df-4744-9807-63f289972bac tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:28.439928 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7efaa736-e7df-4744-9807-63f289972bac tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:28.440704 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7efaa736-e7df-4744-9807-63f289972bac tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:28.441139 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7efaa736-e7df-4744-9807-63f289972bac tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:28.468965 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7efaa736-e7df-4744-9807-63f289972bac tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040512 Mar 03 02:34:28.469513 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 325/640] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:28 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:28.631413 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-434694bd-6e71-48fd-a8eb-fbb0c4ae1a8a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:28.632343 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-434694bd-6e71-48fd-a8eb-fbb0c4ae1a8a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:28.640102 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-434694bd-6e71-48fd-a8eb-fbb0c4ae1a8a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:28.640550 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-434694bd-6e71-48fd-a8eb-fbb0c4ae1a8a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:28.641353 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-434694bd-6e71-48fd-a8eb-fbb0c4ae1a8a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:28.641789 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-434694bd-6e71-48fd-a8eb-fbb0c4ae1a8a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:28.669826 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-434694bd-6e71-48fd-a8eb-fbb0c4ae1a8a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042355 Mar 03 02:34:28.670362 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 316/641] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:28 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:28.866414 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f7f73a2f-193c-42ec-90ef-7a89f0f451fd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:28.867012 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f7f73a2f-193c-42ec-90ef-7a89f0f451fd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:28.873499 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f7f73a2f-193c-42ec-90ef-7a89f0f451fd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:28.873941 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f7f73a2f-193c-42ec-90ef-7a89f0f451fd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:28.874743 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f7f73a2f-193c-42ec-90ef-7a89f0f451fd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:28.875174 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f7f73a2f-193c-42ec-90ef-7a89f0f451fd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:29.006334 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f7f73a2f-193c-42ec-90ef-7a89f0f451fd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:29.015159 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f7f73a2f-193c-42ec-90ef-7a89f0f451fd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:29.016681 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f7f73a2f-193c-42ec-90ef-7a89f0f451fd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:29.017818 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f7f73a2f-193c-42ec-90ef-7a89f0f451fd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.155258 Mar 03 02:34:29.018370 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 326/642] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:28 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:29.480473 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-bb32bb2b-3b11-40c0-8484-7dc3b601f69e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:29.481387 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-bb32bb2b-3b11-40c0-8484-7dc3b601f69e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:29.487451 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bb32bb2b-3b11-40c0-8484-7dc3b601f69e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:29.487947 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bb32bb2b-3b11-40c0-8484-7dc3b601f69e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:29.488726 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bb32bb2b-3b11-40c0-8484-7dc3b601f69e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:29.489163 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bb32bb2b-3b11-40c0-8484-7dc3b601f69e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:29.518077 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-bb32bb2b-3b11-40c0-8484-7dc3b601f69e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041536 Mar 03 02:34:29.518659 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 317/643] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:29 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:29.681239 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-56015200-f7bf-4753-baca-89a0d6e938cd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:29.682371 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-56015200-f7bf-4753-baca-89a0d6e938cd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:29.688334 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-56015200-f7bf-4753-baca-89a0d6e938cd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:29.688781 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-56015200-f7bf-4753-baca-89a0d6e938cd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:29.689546 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-56015200-f7bf-4753-baca-89a0d6e938cd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:29.689980 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-56015200-f7bf-4753-baca-89a0d6e938cd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:29.718973 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-56015200-f7bf-4753-baca-89a0d6e938cd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041722 Mar 03 02:34:29.719516 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 327/644] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:29 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:30.036042 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-bd9ef242-b286-4b4f-9e77-05faff6d5440 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:30.036560 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-bd9ef242-b286-4b4f-9e77-05faff6d5440 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:30.043196 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bd9ef242-b286-4b4f-9e77-05faff6d5440 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:30.043679 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bd9ef242-b286-4b4f-9e77-05faff6d5440 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:30.044453 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bd9ef242-b286-4b4f-9e77-05faff6d5440 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:30.044985 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bd9ef242-b286-4b4f-9e77-05faff6d5440 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:30.174643 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-bd9ef242-b286-4b4f-9e77-05faff6d5440 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:30.183942 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-bd9ef242-b286-4b4f-9e77-05faff6d5440 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:30.185427 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-bd9ef242-b286-4b4f-9e77-05faff6d5440 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:30.186566 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-bd9ef242-b286-4b4f-9e77-05faff6d5440 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.154716 Mar 03 02:34:30.187193 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 318/645] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:30 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:30.529991 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-bb3645aa-51c0-4233-8a55-666dd5ebfc52 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:30.530921 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-bb3645aa-51c0-4233-8a55-666dd5ebfc52 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:30.537057 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bb3645aa-51c0-4233-8a55-666dd5ebfc52 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:30.537494 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bb3645aa-51c0-4233-8a55-666dd5ebfc52 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:30.538261 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bb3645aa-51c0-4233-8a55-666dd5ebfc52 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:30.538691 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bb3645aa-51c0-4233-8a55-666dd5ebfc52 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:30.566389 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-bb3645aa-51c0-4233-8a55-666dd5ebfc52 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040275 Mar 03 02:34:30.566928 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 328/646] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:30 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:30.731070 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6d1e7e0f-6ebe-4b73-85f3-597a8aa0a987 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:30.732024 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6d1e7e0f-6ebe-4b73-85f3-597a8aa0a987 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:30.737939 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6d1e7e0f-6ebe-4b73-85f3-597a8aa0a987 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:30.738384 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6d1e7e0f-6ebe-4b73-85f3-597a8aa0a987 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:30.739153 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6d1e7e0f-6ebe-4b73-85f3-597a8aa0a987 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:30.739583 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6d1e7e0f-6ebe-4b73-85f3-597a8aa0a987 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:30.766799 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6d1e7e0f-6ebe-4b73-85f3-597a8aa0a987 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040392 Mar 03 02:34:30.767347 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 319/647] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:30 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:31.205116 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a8872554-300a-417e-a351-b3ddd4f66c31 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:31.205710 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a8872554-300a-417e-a351-b3ddd4f66c31 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:31.211383 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a8872554-300a-417e-a351-b3ddd4f66c31 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:31.211876 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a8872554-300a-417e-a351-b3ddd4f66c31 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:31.213268 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a8872554-300a-417e-a351-b3ddd4f66c31 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:31.213773 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a8872554-300a-417e-a351-b3ddd4f66c31 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:31.346132 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a8872554-300a-417e-a351-b3ddd4f66c31 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:31.354472 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a8872554-300a-417e-a351-b3ddd4f66c31 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:31.355997 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a8872554-300a-417e-a351-b3ddd4f66c31 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:31.357201 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a8872554-300a-417e-a351-b3ddd4f66c31 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.156071 Mar 03 02:34:31.357763 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 329/648] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:31 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:31.577642 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9e6f4d6a-17c6-4a90-ae77-89b0020bfb15 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:31.578552 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9e6f4d6a-17c6-4a90-ae77-89b0020bfb15 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:31.584885 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9e6f4d6a-17c6-4a90-ae77-89b0020bfb15 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:31.585338 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9e6f4d6a-17c6-4a90-ae77-89b0020bfb15 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:31.586119 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9e6f4d6a-17c6-4a90-ae77-89b0020bfb15 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:31.586557 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9e6f4d6a-17c6-4a90-ae77-89b0020bfb15 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:31.615517 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9e6f4d6a-17c6-4a90-ae77-89b0020bfb15 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041819 Mar 03 02:34:31.616095 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 320/649] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:31 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:31.778727 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7fd22671-0fcc-4042-a107-d4dc50c8f044 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:31.779717 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7fd22671-0fcc-4042-a107-d4dc50c8f044 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:31.785710 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7fd22671-0fcc-4042-a107-d4dc50c8f044 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:31.786160 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7fd22671-0fcc-4042-a107-d4dc50c8f044 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:31.786941 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7fd22671-0fcc-4042-a107-d4dc50c8f044 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:31.787641 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7fd22671-0fcc-4042-a107-d4dc50c8f044 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:31.817833 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7fd22671-0fcc-4042-a107-d4dc50c8f044 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043506 Mar 03 02:34:31.818383 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 330/650] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:31 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:32.374583 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9dce8894-9cc4-40e6-a0f6-f11cadfe2ae0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:32.375188 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9dce8894-9cc4-40e6-a0f6-f11cadfe2ae0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:32.381005 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9dce8894-9cc4-40e6-a0f6-f11cadfe2ae0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:32.381459 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9dce8894-9cc4-40e6-a0f6-f11cadfe2ae0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:32.382243 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9dce8894-9cc4-40e6-a0f6-f11cadfe2ae0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:32.382685 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9dce8894-9cc4-40e6-a0f6-f11cadfe2ae0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:32.514714 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9dce8894-9cc4-40e6-a0f6-f11cadfe2ae0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:32.522757 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9dce8894-9cc4-40e6-a0f6-f11cadfe2ae0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:32.524310 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9dce8894-9cc4-40e6-a0f6-f11cadfe2ae0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:32.526068 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9dce8894-9cc4-40e6-a0f6-f11cadfe2ae0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.155719 Mar 03 02:34:32.526628 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 321/651] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:32 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:32.628207 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-25dbeaa3-9152-4a19-b125-a259cd3eb7ef tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:32.629108 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-25dbeaa3-9152-4a19-b125-a259cd3eb7ef tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:32.635834 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-25dbeaa3-9152-4a19-b125-a259cd3eb7ef tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:32.636284 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-25dbeaa3-9152-4a19-b125-a259cd3eb7ef tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:32.637057 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-25dbeaa3-9152-4a19-b125-a259cd3eb7ef tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:32.637490 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-25dbeaa3-9152-4a19-b125-a259cd3eb7ef tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:32.664906 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-25dbeaa3-9152-4a19-b125-a259cd3eb7ef tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040664 Mar 03 02:34:32.665451 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 331/652] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:32 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:34:32.829370 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-227f3011-b844-4473-a645-e53e1f9889e3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:32.830285 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-227f3011-b844-4473-a645-e53e1f9889e3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:32.836652 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-227f3011-b844-4473-a645-e53e1f9889e3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:32.837158 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-227f3011-b844-4473-a645-e53e1f9889e3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:32.838030 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-227f3011-b844-4473-a645-e53e1f9889e3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:32.838468 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-227f3011-b844-4473-a645-e53e1f9889e3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:32.865922 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-227f3011-b844-4473-a645-e53e1f9889e3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040532 Mar 03 02:34:32.866472 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 322/653] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:32 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:33.544585 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3b74b8c4-0627-4677-9b49-3748775962a4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:33.545188 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3b74b8c4-0627-4677-9b49-3748775962a4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:33.550983 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3b74b8c4-0627-4677-9b49-3748775962a4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:33.551435 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3b74b8c4-0627-4677-9b49-3748775962a4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:33.552245 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3b74b8c4-0627-4677-9b49-3748775962a4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:33.552687 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3b74b8c4-0627-4677-9b49-3748775962a4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:33.675911 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e86b54e9-b5e7-48bf-8732-ff21b567333a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:33.676828 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e86b54e9-b5e7-48bf-8732-ff21b567333a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:33.683204 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e86b54e9-b5e7-48bf-8732-ff21b567333a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:33.683679 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e86b54e9-b5e7-48bf-8732-ff21b567333a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:33.684470 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e86b54e9-b5e7-48bf-8732-ff21b567333a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:33.684914 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e86b54e9-b5e7-48bf-8732-ff21b567333a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:33.687956 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3b74b8c4-0627-4677-9b49-3748775962a4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:33.696097 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3b74b8c4-0627-4677-9b49-3748775962a4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:33.698355 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3b74b8c4-0627-4677-9b49-3748775962a4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:33.699518 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3b74b8c4-0627-4677-9b49-3748775962a4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.159461 Mar 03 02:34:33.700241 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 332/654] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:33 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:33.713355 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e86b54e9-b5e7-48bf-8732-ff21b567333a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041459 Mar 03 02:34:33.713901 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 323/655] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:33 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:34:33.878043 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1d3b48f7-e295-4b18-a7a3-412713311f2d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:33.878974 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1d3b48f7-e295-4b18-a7a3-412713311f2d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:33.884975 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1d3b48f7-e295-4b18-a7a3-412713311f2d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:33.885397 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1d3b48f7-e295-4b18-a7a3-412713311f2d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:33.886165 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1d3b48f7-e295-4b18-a7a3-412713311f2d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:33.886593 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1d3b48f7-e295-4b18-a7a3-412713311f2d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:33.914082 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1d3b48f7-e295-4b18-a7a3-412713311f2d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040049 Mar 03 02:34:33.914624 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 333/656] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:33 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:34.718146 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-193b5bbe-19ea-491e-aa37-375c5b2a1b04 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:34.718752 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-193b5bbe-19ea-491e-aa37-375c5b2a1b04 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:34.724465 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-107a62b2-a984-42b9-bf7d-2318eb435717 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:34.725092 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-193b5bbe-19ea-491e-aa37-375c5b2a1b04 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:34.725359 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-107a62b2-a984-42b9-bf7d-2318eb435717 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:34.725544 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-193b5bbe-19ea-491e-aa37-375c5b2a1b04 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:34.726329 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-193b5bbe-19ea-491e-aa37-375c5b2a1b04 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:34.726767 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-193b5bbe-19ea-491e-aa37-375c5b2a1b04 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:34.732170 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-107a62b2-a984-42b9-bf7d-2318eb435717 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:34.732626 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-107a62b2-a984-42b9-bf7d-2318eb435717 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:34.733430 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-107a62b2-a984-42b9-bf7d-2318eb435717 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:34.733859 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-107a62b2-a984-42b9-bf7d-2318eb435717 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:34.762609 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-107a62b2-a984-42b9-bf7d-2318eb435717 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041908 Mar 03 02:34:34.763172 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 334/657] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:34 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:34:34.859793 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-193b5bbe-19ea-491e-aa37-375c5b2a1b04 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:34.867873 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-193b5bbe-19ea-491e-aa37-375c5b2a1b04 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:34.870574 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-193b5bbe-19ea-491e-aa37-375c5b2a1b04 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:34.871737 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-193b5bbe-19ea-491e-aa37-375c5b2a1b04 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.157571 Mar 03 02:34:34.872294 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 324/658] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:34 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:34:34.926322 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d580e7bd-a741-4d6f-a739-2493f466cd1b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:34.927268 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d580e7bd-a741-4d6f-a739-2493f466cd1b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:34.933764 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d580e7bd-a741-4d6f-a739-2493f466cd1b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:34.934214 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d580e7bd-a741-4d6f-a739-2493f466cd1b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:34.934996 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d580e7bd-a741-4d6f-a739-2493f466cd1b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:34.935436 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d580e7bd-a741-4d6f-a739-2493f466cd1b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:34.962937 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d580e7bd-a741-4d6f-a739-2493f466cd1b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040132 Mar 03 02:34:34.963723 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 335/659] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:34 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:35.774322 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-238cc671-49d5-49d4-9b8b-897e5806b7b3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:35.775974 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-238cc671-49d5-49d4-9b8b-897e5806b7b3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:35.782679 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-238cc671-49d5-49d4-9b8b-897e5806b7b3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:35.783249 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-238cc671-49d5-49d4-9b8b-897e5806b7b3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:35.784188 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-238cc671-49d5-49d4-9b8b-897e5806b7b3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:35.784703 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-238cc671-49d5-49d4-9b8b-897e5806b7b3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:35.819750 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-238cc671-49d5-49d4-9b8b-897e5806b7b3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049504 Mar 03 02:34:35.820298 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 325/660] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:35 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:35.889692 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c0522b1e-f5ad-43c1-9256-1551edfbf2cc tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:35.890231 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c0522b1e-f5ad-43c1-9256-1551edfbf2cc tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:35.896498 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c0522b1e-f5ad-43c1-9256-1551edfbf2cc tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:35.896947 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c0522b1e-f5ad-43c1-9256-1551edfbf2cc tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:35.897732 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c0522b1e-f5ad-43c1-9256-1551edfbf2cc tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:35.898166 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c0522b1e-f5ad-43c1-9256-1551edfbf2cc tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:35.974475 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5e582f6d-48aa-463d-8c66-b7265b3dd91f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:35.975486 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5e582f6d-48aa-463d-8c66-b7265b3dd91f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:35.982260 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5e582f6d-48aa-463d-8c66-b7265b3dd91f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:35.982423 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5e582f6d-48aa-463d-8c66-b7265b3dd91f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:35.983244 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5e582f6d-48aa-463d-8c66-b7265b3dd91f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:35.983719 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5e582f6d-48aa-463d-8c66-b7265b3dd91f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:36.014948 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5e582f6d-48aa-463d-8c66-b7265b3dd91f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044383 Mar 03 02:34:36.015515 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 326/661] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:35 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:36.033338 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c0522b1e-f5ad-43c1-9256-1551edfbf2cc tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:36.042422 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c0522b1e-f5ad-43c1-9256-1551edfbf2cc tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:36.043951 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c0522b1e-f5ad-43c1-9256-1551edfbf2cc tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:36.045111 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c0522b1e-f5ad-43c1-9256-1551edfbf2cc tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.159389 Mar 03 02:34:36.045662 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 336/662] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:35 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:36.831465 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d6c7d5ce-13b0-4fa6-a7f5-617ee10ccb6c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:36.832444 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d6c7d5ce-13b0-4fa6-a7f5-617ee10ccb6c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:36.838629 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d6c7d5ce-13b0-4fa6-a7f5-617ee10ccb6c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:36.839099 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d6c7d5ce-13b0-4fa6-a7f5-617ee10ccb6c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:36.839975 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d6c7d5ce-13b0-4fa6-a7f5-617ee10ccb6c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:36.840443 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d6c7d5ce-13b0-4fa6-a7f5-617ee10ccb6c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:36.868868 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d6c7d5ce-13b0-4fa6-a7f5-617ee10ccb6c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041350 Mar 03 02:34:36.869414 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 327/663] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:36 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:37.026384 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-cf3c879e-4b4d-44c6-8a10-d8d8618af908 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:37.027391 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-cf3c879e-4b4d-44c6-8a10-d8d8618af908 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:37.033681 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cf3c879e-4b4d-44c6-8a10-d8d8618af908 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:37.034131 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cf3c879e-4b4d-44c6-8a10-d8d8618af908 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:37.034907 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cf3c879e-4b4d-44c6-8a10-d8d8618af908 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:37.035345 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cf3c879e-4b4d-44c6-8a10-d8d8618af908 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:37.063388 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-dadbd9bd-89fa-4ef0-aa00-b4ca40a89d5f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:37.064012 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-dadbd9bd-89fa-4ef0-aa00-b4ca40a89d5f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:37.064994 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-cf3c879e-4b4d-44c6-8a10-d8d8618af908 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042612 Mar 03 02:34:37.065745 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 337/664] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:37 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:37.069817 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dadbd9bd-89fa-4ef0-aa00-b4ca40a89d5f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:37.070273 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dadbd9bd-89fa-4ef0-aa00-b4ca40a89d5f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:37.071076 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dadbd9bd-89fa-4ef0-aa00-b4ca40a89d5f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:37.071496 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dadbd9bd-89fa-4ef0-aa00-b4ca40a89d5f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:37.205361 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-dadbd9bd-89fa-4ef0-aa00-b4ca40a89d5f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:37.213348 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-dadbd9bd-89fa-4ef0-aa00-b4ca40a89d5f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:37.215648 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-dadbd9bd-89fa-4ef0-aa00-b4ca40a89d5f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:37.216802 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-dadbd9bd-89fa-4ef0-aa00-b4ca40a89d5f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.158511 Mar 03 02:34:37.217351 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 328/665] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:37 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:34:37.881423 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0186dacc-4b43-45d3-8abd-9cd4693dae4f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:37.882326 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0186dacc-4b43-45d3-8abd-9cd4693dae4f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:37.889020 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0186dacc-4b43-45d3-8abd-9cd4693dae4f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:37.889465 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0186dacc-4b43-45d3-8abd-9cd4693dae4f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:37.890244 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0186dacc-4b43-45d3-8abd-9cd4693dae4f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:37.890676 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0186dacc-4b43-45d3-8abd-9cd4693dae4f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:37.919549 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0186dacc-4b43-45d3-8abd-9cd4693dae4f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042118 Mar 03 02:34:37.920118 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 338/666] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:37 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:38.077035 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-25c18cc8-957a-4555-bb6e-a72f3f9420cf tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:38.077955 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-25c18cc8-957a-4555-bb6e-a72f3f9420cf tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:38.084091 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-25c18cc8-957a-4555-bb6e-a72f3f9420cf tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:38.084535 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-25c18cc8-957a-4555-bb6e-a72f3f9420cf tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:38.085306 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-25c18cc8-957a-4555-bb6e-a72f3f9420cf tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:38.085741 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-25c18cc8-957a-4555-bb6e-a72f3f9420cf tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:38.112984 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-25c18cc8-957a-4555-bb6e-a72f3f9420cf tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040517 Mar 03 02:34:38.113518 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 329/667] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:38 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:38.234332 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-73be3beb-a5ab-4a8c-a1a8-c1591eef3789 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:38.234929 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-73be3beb-a5ab-4a8c-a1a8-c1591eef3789 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:38.241041 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-73be3beb-a5ab-4a8c-a1a8-c1591eef3789 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:38.241485 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-73be3beb-a5ab-4a8c-a1a8-c1591eef3789 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:38.242255 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-73be3beb-a5ab-4a8c-a1a8-c1591eef3789 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:38.242679 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-73be3beb-a5ab-4a8c-a1a8-c1591eef3789 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:38.379501 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-73be3beb-a5ab-4a8c-a1a8-c1591eef3789 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:38.387660 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-73be3beb-a5ab-4a8c-a1a8-c1591eef3789 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:38.389149 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-73be3beb-a5ab-4a8c-a1a8-c1591eef3789 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:38.390286 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-73be3beb-a5ab-4a8c-a1a8-c1591eef3789 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.160123 Mar 03 02:34:38.390830 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 339/668] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:38 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:38.931048 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5abd5ceb-e05b-4aa1-9b5b-f729ee2bc3a1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:38.931983 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5abd5ceb-e05b-4aa1-9b5b-f729ee2bc3a1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:38.937895 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5abd5ceb-e05b-4aa1-9b5b-f729ee2bc3a1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:38.938341 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5abd5ceb-e05b-4aa1-9b5b-f729ee2bc3a1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:38.939169 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5abd5ceb-e05b-4aa1-9b5b-f729ee2bc3a1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:38.939618 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5abd5ceb-e05b-4aa1-9b5b-f729ee2bc3a1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:38.967100 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5abd5ceb-e05b-4aa1-9b5b-f729ee2bc3a1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040017 Mar 03 02:34:38.967655 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 330/669] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:38 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:39.124385 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-25249080-1998-4371-a112-816aede0d288 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:39.125282 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-25249080-1998-4371-a112-816aede0d288 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:39.131257 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-25249080-1998-4371-a112-816aede0d288 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:39.131754 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-25249080-1998-4371-a112-816aede0d288 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:39.132542 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-25249080-1998-4371-a112-816aede0d288 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:39.132975 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-25249080-1998-4371-a112-816aede0d288 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:39.161560 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-25249080-1998-4371-a112-816aede0d288 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041608 Mar 03 02:34:39.162101 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 340/670] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:39 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:39.409321 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-63b4ad55-15e6-4fb1-aafd-d3a16794117e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:39.409928 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-63b4ad55-15e6-4fb1-aafd-d3a16794117e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:39.416250 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-63b4ad55-15e6-4fb1-aafd-d3a16794117e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:39.416697 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-63b4ad55-15e6-4fb1-aafd-d3a16794117e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:39.417564 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-63b4ad55-15e6-4fb1-aafd-d3a16794117e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:39.418648 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-63b4ad55-15e6-4fb1-aafd-d3a16794117e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:39.549313 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-63b4ad55-15e6-4fb1-aafd-d3a16794117e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:39.557283 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-63b4ad55-15e6-4fb1-aafd-d3a16794117e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:39.558776 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-63b4ad55-15e6-4fb1-aafd-d3a16794117e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:39.559946 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-63b4ad55-15e6-4fb1-aafd-d3a16794117e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.154531 Mar 03 02:34:39.560500 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 331/671] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:39 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:39.978916 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e999031f-b3b2-4c51-aea4-5d5ba4aa7790 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:39.979910 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e999031f-b3b2-4c51-aea4-5d5ba4aa7790 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:39.986776 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e999031f-b3b2-4c51-aea4-5d5ba4aa7790 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:39.987237 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e999031f-b3b2-4c51-aea4-5d5ba4aa7790 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:39.988074 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e999031f-b3b2-4c51-aea4-5d5ba4aa7790 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:39.988515 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e999031f-b3b2-4c51-aea4-5d5ba4aa7790 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:40.018598 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e999031f-b3b2-4c51-aea4-5d5ba4aa7790 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043732 Mar 03 02:34:40.019161 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 341/672] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:39 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:40.173118 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9dffc5a6-e35b-4fbf-b2cc-1dfd975f9ce3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:40.174014 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9dffc5a6-e35b-4fbf-b2cc-1dfd975f9ce3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:40.179874 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9dffc5a6-e35b-4fbf-b2cc-1dfd975f9ce3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:40.180327 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9dffc5a6-e35b-4fbf-b2cc-1dfd975f9ce3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:40.181089 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9dffc5a6-e35b-4fbf-b2cc-1dfd975f9ce3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:40.181519 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9dffc5a6-e35b-4fbf-b2cc-1dfd975f9ce3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:40.210796 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9dffc5a6-e35b-4fbf-b2cc-1dfd975f9ce3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041567 Mar 03 02:34:40.211339 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 332/673] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:40 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:40.577841 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-aeb683a5-52c3-4d6e-97ca-a8496cff83f5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:40.578440 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-aeb683a5-52c3-4d6e-97ca-a8496cff83f5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:40.584348 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aeb683a5-52c3-4d6e-97ca-a8496cff83f5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:40.584793 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aeb683a5-52c3-4d6e-97ca-a8496cff83f5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:40.585557 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aeb683a5-52c3-4d6e-97ca-a8496cff83f5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:40.585985 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aeb683a5-52c3-4d6e-97ca-a8496cff83f5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:40.723412 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-aeb683a5-52c3-4d6e-97ca-a8496cff83f5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:40.732076 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-aeb683a5-52c3-4d6e-97ca-a8496cff83f5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:40.733562 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-aeb683a5-52c3-4d6e-97ca-a8496cff83f5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:40.734687 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-aeb683a5-52c3-4d6e-97ca-a8496cff83f5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.160933 Mar 03 02:34:40.735241 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 342/674] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:40 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:41.030827 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-bc99eefe-0467-4d4f-ba7d-6865c75c7b61 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:41.031684 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-bc99eefe-0467-4d4f-ba7d-6865c75c7b61 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:41.037809 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bc99eefe-0467-4d4f-ba7d-6865c75c7b61 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:41.038256 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bc99eefe-0467-4d4f-ba7d-6865c75c7b61 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:41.039023 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bc99eefe-0467-4d4f-ba7d-6865c75c7b61 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:41.039456 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bc99eefe-0467-4d4f-ba7d-6865c75c7b61 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:41.067338 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-bc99eefe-0467-4d4f-ba7d-6865c75c7b61 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041138 Mar 03 02:34:41.067915 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 333/675] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:41 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:41.222439 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1fa62e75-44bb-487b-845a-59487813445f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:41.223338 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1fa62e75-44bb-487b-845a-59487813445f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:41.229476 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1fa62e75-44bb-487b-845a-59487813445f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:41.229921 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1fa62e75-44bb-487b-845a-59487813445f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:41.230688 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1fa62e75-44bb-487b-845a-59487813445f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:41.231853 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1fa62e75-44bb-487b-845a-59487813445f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:41.258946 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1fa62e75-44bb-487b-845a-59487813445f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040409 Mar 03 02:34:41.259482 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 343/676] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:41 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:41.753561 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-90d45fc5-e2e0-4e02-aa9d-9e10376a9d31 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:41.754165 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-90d45fc5-e2e0-4e02-aa9d-9e10376a9d31 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:41.760025 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-90d45fc5-e2e0-4e02-aa9d-9e10376a9d31 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:41.760487 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-90d45fc5-e2e0-4e02-aa9d-9e10376a9d31 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:41.761270 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-90d45fc5-e2e0-4e02-aa9d-9e10376a9d31 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:41.761717 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-90d45fc5-e2e0-4e02-aa9d-9e10376a9d31 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:41.963078 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-90d45fc5-e2e0-4e02-aa9d-9e10376a9d31 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:41.971469 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-90d45fc5-e2e0-4e02-aa9d-9e10376a9d31 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:41.972987 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-90d45fc5-e2e0-4e02-aa9d-9e10376a9d31 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:41.974235 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-90d45fc5-e2e0-4e02-aa9d-9e10376a9d31 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.224635 Mar 03 02:34:41.974822 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 334/677] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:41 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:42.078459 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-cd7d317f-f047-4648-bcb9-61697833d1cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:42.079386 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-cd7d317f-f047-4648-bcb9-61697833d1cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:42.085151 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cd7d317f-f047-4648-bcb9-61697833d1cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:42.085599 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cd7d317f-f047-4648-bcb9-61697833d1cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:42.086389 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cd7d317f-f047-4648-bcb9-61697833d1cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:42.086847 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cd7d317f-f047-4648-bcb9-61697833d1cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:42.114690 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-cd7d317f-f047-4648-bcb9-61697833d1cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040237 Mar 03 02:34:42.115226 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 344/678] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:42 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:42.270413 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-14fb920b-ddbf-4185-b0f5-08229de9462e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:42.271253 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-14fb920b-ddbf-4185-b0f5-08229de9462e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:42.277453 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-14fb920b-ddbf-4185-b0f5-08229de9462e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:42.277934 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-14fb920b-ddbf-4185-b0f5-08229de9462e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:42.278719 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-14fb920b-ddbf-4185-b0f5-08229de9462e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:42.279161 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-14fb920b-ddbf-4185-b0f5-08229de9462e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:42.306810 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-14fb920b-ddbf-4185-b0f5-08229de9462e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040414 Mar 03 02:34:42.307366 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 335/679] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:42 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:42.991592 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f38a28d2-9704-4b13-a5cd-15ea665aa246 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:42.992216 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f38a28d2-9704-4b13-a5cd-15ea665aa246 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:42.998886 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f38a28d2-9704-4b13-a5cd-15ea665aa246 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:42.999331 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f38a28d2-9704-4b13-a5cd-15ea665aa246 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:43.000143 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f38a28d2-9704-4b13-a5cd-15ea665aa246 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:43.000577 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f38a28d2-9704-4b13-a5cd-15ea665aa246 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:43.127450 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-faffb435-2f34-4726-9dd8-2d902aa08789 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:43.128389 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-faffb435-2f34-4726-9dd8-2d902aa08789 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:43.134084 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-faffb435-2f34-4726-9dd8-2d902aa08789 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:43.134214 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f38a28d2-9704-4b13-a5cd-15ea665aa246 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:43.134536 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-faffb435-2f34-4726-9dd8-2d902aa08789 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:43.135319 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-faffb435-2f34-4726-9dd8-2d902aa08789 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:43.135786 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-faffb435-2f34-4726-9dd8-2d902aa08789 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:43.143729 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f38a28d2-9704-4b13-a5cd-15ea665aa246 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:43.145353 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f38a28d2-9704-4b13-a5cd-15ea665aa246 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:43.146537 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f38a28d2-9704-4b13-a5cd-15ea665aa246 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.158834 Mar 03 02:34:43.147162 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 345/680] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:42 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:43.164075 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-faffb435-2f34-4726-9dd8-2d902aa08789 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040617 Mar 03 02:34:43.164622 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 336/681] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:43 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:34:43.319103 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a272d051-ab2e-4455-be8b-c1304c7f9b86 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:43.320056 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a272d051-ab2e-4455-be8b-c1304c7f9b86 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:43.326546 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a272d051-ab2e-4455-be8b-c1304c7f9b86 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:43.326996 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a272d051-ab2e-4455-be8b-c1304c7f9b86 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:43.327813 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a272d051-ab2e-4455-be8b-c1304c7f9b86 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:43.328255 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a272d051-ab2e-4455-be8b-c1304c7f9b86 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:43.355748 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a272d051-ab2e-4455-be8b-c1304c7f9b86 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040505 Mar 03 02:34:43.356309 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 346/682] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:43 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:44.164831 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-15ed6d13-bcd7-4838-9440-74729f3b30a4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:44.165476 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-15ed6d13-bcd7-4838-9440-74729f3b30a4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:44.172663 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-15ed6d13-bcd7-4838-9440-74729f3b30a4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:44.173115 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-15ed6d13-bcd7-4838-9440-74729f3b30a4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:44.174027 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-15ed6d13-bcd7-4838-9440-74729f3b30a4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:44.174472 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-15ed6d13-bcd7-4838-9440-74729f3b30a4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:44.176271 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2b762d19-d293-4098-b945-fb30c8c74ba0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:44.177186 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2b762d19-d293-4098-b945-fb30c8c74ba0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:44.183263 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2b762d19-d293-4098-b945-fb30c8c74ba0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:44.183744 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2b762d19-d293-4098-b945-fb30c8c74ba0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:44.185032 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2b762d19-d293-4098-b945-fb30c8c74ba0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:44.185479 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2b762d19-d293-4098-b945-fb30c8c74ba0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:44.214236 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2b762d19-d293-4098-b945-fb30c8c74ba0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041881 Mar 03 02:34:44.214804 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 347/683] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:44 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:34:44.306054 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-15ed6d13-bcd7-4838-9440-74729f3b30a4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:44.314751 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-15ed6d13-bcd7-4838-9440-74729f3b30a4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:44.316294 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-15ed6d13-bcd7-4838-9440-74729f3b30a4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:44.317436 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-15ed6d13-bcd7-4838-9440-74729f3b30a4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.156578 Mar 03 02:34:44.318023 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 337/684] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:44 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:34:44.367213 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5b7ab55b-e0e1-49e7-8205-939c4d292ad8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:44.368167 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5b7ab55b-e0e1-49e7-8205-939c4d292ad8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:44.374265 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5b7ab55b-e0e1-49e7-8205-939c4d292ad8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:44.374707 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5b7ab55b-e0e1-49e7-8205-939c4d292ad8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:44.375479 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5b7ab55b-e0e1-49e7-8205-939c4d292ad8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:44.375935 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5b7ab55b-e0e1-49e7-8205-939c4d292ad8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:44.404837 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5b7ab55b-e0e1-49e7-8205-939c4d292ad8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041590 Mar 03 02:34:44.405404 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 348/685] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:44 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:45.226354 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2b01ef1f-aaf6-4136-bd72-93294ddff577 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:45.227254 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2b01ef1f-aaf6-4136-bd72-93294ddff577 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:45.233369 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2b01ef1f-aaf6-4136-bd72-93294ddff577 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:45.233814 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2b01ef1f-aaf6-4136-bd72-93294ddff577 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:45.234580 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2b01ef1f-aaf6-4136-bd72-93294ddff577 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:45.235579 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2b01ef1f-aaf6-4136-bd72-93294ddff577 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:45.262958 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2b01ef1f-aaf6-4136-bd72-93294ddff577 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040538 Mar 03 02:34:45.263707 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 338/686] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:45 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:45.336883 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4c8e7a6c-786b-43b9-aa0a-066112eb9201 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:45.337487 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4c8e7a6c-786b-43b9-aa0a-066112eb9201 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:45.343565 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4c8e7a6c-786b-43b9-aa0a-066112eb9201 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:45.344042 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4c8e7a6c-786b-43b9-aa0a-066112eb9201 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:45.345527 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4c8e7a6c-786b-43b9-aa0a-066112eb9201 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:45.345958 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4c8e7a6c-786b-43b9-aa0a-066112eb9201 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:45.416405 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2fd5464a-87ae-46ef-a3ff-fda42810d812 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:45.417306 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2fd5464a-87ae-46ef-a3ff-fda42810d812 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:45.423873 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2fd5464a-87ae-46ef-a3ff-fda42810d812 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:45.424320 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2fd5464a-87ae-46ef-a3ff-fda42810d812 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:45.425136 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2fd5464a-87ae-46ef-a3ff-fda42810d812 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:45.425569 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2fd5464a-87ae-46ef-a3ff-fda42810d812 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:45.455298 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2fd5464a-87ae-46ef-a3ff-fda42810d812 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042844 Mar 03 02:34:45.455915 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 339/687] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:45 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:34:45.477885 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4c8e7a6c-786b-43b9-aa0a-066112eb9201 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:45.486490 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4c8e7a6c-786b-43b9-aa0a-066112eb9201 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:45.488111 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4c8e7a6c-786b-43b9-aa0a-066112eb9201 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:45.489247 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4c8e7a6c-786b-43b9-aa0a-066112eb9201 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.156329 Mar 03 02:34:45.489790 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 349/688] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:45 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:46.274319 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f5e73145-9da0-40a1-9834-1e811796ebe4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:46.275218 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f5e73145-9da0-40a1-9834-1e811796ebe4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:46.281359 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f5e73145-9da0-40a1-9834-1e811796ebe4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:46.281830 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f5e73145-9da0-40a1-9834-1e811796ebe4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:46.282771 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f5e73145-9da0-40a1-9834-1e811796ebe4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:46.283204 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f5e73145-9da0-40a1-9834-1e811796ebe4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:46.310193 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f5e73145-9da0-40a1-9834-1e811796ebe4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039711 Mar 03 02:34:46.310682 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 340/689] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:46 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:46.466827 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-29bbf8d2-86fb-4dde-8395-fab9e1ecb45f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:46.467808 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-29bbf8d2-86fb-4dde-8395-fab9e1ecb45f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:46.474702 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-29bbf8d2-86fb-4dde-8395-fab9e1ecb45f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:46.475160 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-29bbf8d2-86fb-4dde-8395-fab9e1ecb45f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:46.475967 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-29bbf8d2-86fb-4dde-8395-fab9e1ecb45f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:46.476404 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-29bbf8d2-86fb-4dde-8395-fab9e1ecb45f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:46.505170 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-29bbf8d2-86fb-4dde-8395-fab9e1ecb45f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042240 Mar 03 02:34:46.505718 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 350/690] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:46 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:46.508067 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-df7877fe-d0d1-4c93-a01f-a780623ca868 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:46.508673 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-df7877fe-d0d1-4c93-a01f-a780623ca868 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:46.514442 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-df7877fe-d0d1-4c93-a01f-a780623ca868 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:46.514894 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-df7877fe-d0d1-4c93-a01f-a780623ca868 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:46.515703 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-df7877fe-d0d1-4c93-a01f-a780623ca868 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:46.516168 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-df7877fe-d0d1-4c93-a01f-a780623ca868 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:46.656786 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-df7877fe-d0d1-4c93-a01f-a780623ca868 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:46.666704 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-df7877fe-d0d1-4c93-a01f-a780623ca868 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:46.668233 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-df7877fe-d0d1-4c93-a01f-a780623ca868 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:46.669401 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-df7877fe-d0d1-4c93-a01f-a780623ca868 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.165438 Mar 03 02:34:46.669933 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 341/691] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:46 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:47.322117 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-81af0c9d-2021-4d6c-90f0-66f1217cd7c1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:47.322969 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-81af0c9d-2021-4d6c-90f0-66f1217cd7c1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:47.328775 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-81af0c9d-2021-4d6c-90f0-66f1217cd7c1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:47.329733 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-81af0c9d-2021-4d6c-90f0-66f1217cd7c1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:47.330514 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-81af0c9d-2021-4d6c-90f0-66f1217cd7c1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:47.330942 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-81af0c9d-2021-4d6c-90f0-66f1217cd7c1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:47.358211 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-81af0c9d-2021-4d6c-90f0-66f1217cd7c1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040171 Mar 03 02:34:47.358813 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 351/692] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:47 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:47.516976 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e623e900-877b-4e9e-9afe-919e7a3a4855 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:47.517881 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e623e900-877b-4e9e-9afe-919e7a3a4855 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:47.523999 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e623e900-877b-4e9e-9afe-919e7a3a4855 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:47.524443 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e623e900-877b-4e9e-9afe-919e7a3a4855 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:47.525571 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e623e900-877b-4e9e-9afe-919e7a3a4855 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:47.526004 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e623e900-877b-4e9e-9afe-919e7a3a4855 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:47.553571 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e623e900-877b-4e9e-9afe-919e7a3a4855 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041012 Mar 03 02:34:47.554106 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 342/693] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:47 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:47.688256 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a7f6b9a5-eddf-442e-a046-93b4e26db27d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:47.689373 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a7f6b9a5-eddf-442e-a046-93b4e26db27d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:47.695745 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a7f6b9a5-eddf-442e-a046-93b4e26db27d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:47.696204 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a7f6b9a5-eddf-442e-a046-93b4e26db27d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:47.696991 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a7f6b9a5-eddf-442e-a046-93b4e26db27d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:47.697430 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a7f6b9a5-eddf-442e-a046-93b4e26db27d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:47.826062 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a7f6b9a5-eddf-442e-a046-93b4e26db27d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:47.834621 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a7f6b9a5-eddf-442e-a046-93b4e26db27d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:47.836146 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a7f6b9a5-eddf-442e-a046-93b4e26db27d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:47.837293 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a7f6b9a5-eddf-442e-a046-93b4e26db27d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.153000 Mar 03 02:34:47.837848 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 352/694] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:47 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:48.369642 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-045a3d48-e9a0-4eec-af22-ee96a14e4251 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:48.370805 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-045a3d48-e9a0-4eec-af22-ee96a14e4251 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:48.376565 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-045a3d48-e9a0-4eec-af22-ee96a14e4251 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:48.377025 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-045a3d48-e9a0-4eec-af22-ee96a14e4251 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:48.377839 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-045a3d48-e9a0-4eec-af22-ee96a14e4251 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:48.378277 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-045a3d48-e9a0-4eec-af22-ee96a14e4251 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:48.405352 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-045a3d48-e9a0-4eec-af22-ee96a14e4251 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039634 Mar 03 02:34:48.405896 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 343/695] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:48 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:48.565181 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-aeadf31e-8559-458d-9743-097cfb81cc86 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:48.566175 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-aeadf31e-8559-458d-9743-097cfb81cc86 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:48.572501 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aeadf31e-8559-458d-9743-097cfb81cc86 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:48.572953 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aeadf31e-8559-458d-9743-097cfb81cc86 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:48.573736 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aeadf31e-8559-458d-9743-097cfb81cc86 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:48.574176 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aeadf31e-8559-458d-9743-097cfb81cc86 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:48.602756 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-aeadf31e-8559-458d-9743-097cfb81cc86 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041937 Mar 03 02:34:48.603387 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 353/696] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:48 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:48.855512 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2656d165-90aa-45e7-8881-d3713115d8ca tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:48.856229 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2656d165-90aa-45e7-8881-d3713115d8ca tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:48.862540 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2656d165-90aa-45e7-8881-d3713115d8ca tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:48.862985 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2656d165-90aa-45e7-8881-d3713115d8ca tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:48.863792 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2656d165-90aa-45e7-8881-d3713115d8ca tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:48.864230 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2656d165-90aa-45e7-8881-d3713115d8ca tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:48.994218 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2656d165-90aa-45e7-8881-d3713115d8ca tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:49.003162 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2656d165-90aa-45e7-8881-d3713115d8ca tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:49.004679 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2656d165-90aa-45e7-8881-d3713115d8ca tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:49.005821 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2656d165-90aa-45e7-8881-d3713115d8ca tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.154274 Mar 03 02:34:49.006367 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 344/697] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:48 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:49.417947 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-69d5a269-ef3d-43de-bcb3-2d71fa7bd6c4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:49.418854 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-69d5a269-ef3d-43de-bcb3-2d71fa7bd6c4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:49.426072 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-69d5a269-ef3d-43de-bcb3-2d71fa7bd6c4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:49.426523 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-69d5a269-ef3d-43de-bcb3-2d71fa7bd6c4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:49.427302 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-69d5a269-ef3d-43de-bcb3-2d71fa7bd6c4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:49.427777 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-69d5a269-ef3d-43de-bcb3-2d71fa7bd6c4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:49.456317 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-69d5a269-ef3d-43de-bcb3-2d71fa7bd6c4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042324 Mar 03 02:34:49.456867 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 354/698] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:49 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:49.614973 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ebe9e113-0092-48f3-85c8-f4206e6c7ff5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:49.615907 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ebe9e113-0092-48f3-85c8-f4206e6c7ff5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:49.622477 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ebe9e113-0092-48f3-85c8-f4206e6c7ff5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:49.622926 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ebe9e113-0092-48f3-85c8-f4206e6c7ff5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:49.623735 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ebe9e113-0092-48f3-85c8-f4206e6c7ff5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:49.624171 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ebe9e113-0092-48f3-85c8-f4206e6c7ff5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:49.651378 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ebe9e113-0092-48f3-85c8-f4206e6c7ff5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041101 Mar 03 02:34:49.651947 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 345/699] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:49 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:50.023823 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-618c5df5-465a-49dc-a373-8fa1480c57db tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:50.024357 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-618c5df5-465a-49dc-a373-8fa1480c57db tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:50.030203 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-618c5df5-465a-49dc-a373-8fa1480c57db tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:50.030657 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-618c5df5-465a-49dc-a373-8fa1480c57db tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:50.031440 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-618c5df5-465a-49dc-a373-8fa1480c57db tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:50.031908 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-618c5df5-465a-49dc-a373-8fa1480c57db tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:50.166049 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-618c5df5-465a-49dc-a373-8fa1480c57db tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:50.174068 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-618c5df5-465a-49dc-a373-8fa1480c57db tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:50.175566 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-618c5df5-465a-49dc-a373-8fa1480c57db tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:50.176724 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-618c5df5-465a-49dc-a373-8fa1480c57db tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.157028 Mar 03 02:34:50.177278 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 355/700] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:50 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:50.467933 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2ee067c4-6182-4de0-9a15-5b8fb9ae626b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:50.468779 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2ee067c4-6182-4de0-9a15-5b8fb9ae626b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:50.475583 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2ee067c4-6182-4de0-9a15-5b8fb9ae626b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:50.476057 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2ee067c4-6182-4de0-9a15-5b8fb9ae626b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:50.476829 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2ee067c4-6182-4de0-9a15-5b8fb9ae626b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:50.477260 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2ee067c4-6182-4de0-9a15-5b8fb9ae626b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:50.504866 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2ee067c4-6182-4de0-9a15-5b8fb9ae626b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040943 Mar 03 02:34:50.505420 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 346/701] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:50 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:50.663255 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-807e1bfd-22a9-4088-acc0-ae27fe2b8c14 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:50.664190 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-807e1bfd-22a9-4088-acc0-ae27fe2b8c14 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:50.670591 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-807e1bfd-22a9-4088-acc0-ae27fe2b8c14 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:50.671042 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-807e1bfd-22a9-4088-acc0-ae27fe2b8c14 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:50.671868 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-807e1bfd-22a9-4088-acc0-ae27fe2b8c14 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:50.672310 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-807e1bfd-22a9-4088-acc0-ae27fe2b8c14 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:50.700847 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-807e1bfd-22a9-4088-acc0-ae27fe2b8c14 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041551 Mar 03 02:34:50.701416 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 356/702] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:50 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:51.195504 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-03aeb1e7-03a0-4916-8e8f-3624c3e6d92f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:51.196187 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-03aeb1e7-03a0-4916-8e8f-3624c3e6d92f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:51.202094 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-03aeb1e7-03a0-4916-8e8f-3624c3e6d92f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:51.202561 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-03aeb1e7-03a0-4916-8e8f-3624c3e6d92f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:51.203329 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-03aeb1e7-03a0-4916-8e8f-3624c3e6d92f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:51.203799 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-03aeb1e7-03a0-4916-8e8f-3624c3e6d92f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:51.337386 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-03aeb1e7-03a0-4916-8e8f-3624c3e6d92f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:51.345905 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-03aeb1e7-03a0-4916-8e8f-3624c3e6d92f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:51.347393 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-03aeb1e7-03a0-4916-8e8f-3624c3e6d92f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:51.348547 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-03aeb1e7-03a0-4916-8e8f-3624c3e6d92f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.157007 Mar 03 02:34:51.349095 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 347/703] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:51 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:51.516291 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8d6ceb49-0f4f-45a0-a068-787b5495dbdc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:51.517233 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8d6ceb49-0f4f-45a0-a068-787b5495dbdc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:51.522967 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8d6ceb49-0f4f-45a0-a068-787b5495dbdc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:51.523415 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8d6ceb49-0f4f-45a0-a068-787b5495dbdc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:51.524226 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8d6ceb49-0f4f-45a0-a068-787b5495dbdc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:51.524667 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8d6ceb49-0f4f-45a0-a068-787b5495dbdc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:51.554068 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8d6ceb49-0f4f-45a0-a068-787b5495dbdc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041630 Mar 03 02:34:51.554619 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 357/704] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:51 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:51.715185 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3f049dc3-61b6-4649-b5ce-505472867347 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:51.716063 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3f049dc3-61b6-4649-b5ce-505472867347 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:51.724095 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3f049dc3-61b6-4649-b5ce-505472867347 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:51.724698 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3f049dc3-61b6-4649-b5ce-505472867347 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:51.725491 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3f049dc3-61b6-4649-b5ce-505472867347 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:51.726010 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3f049dc3-61b6-4649-b5ce-505472867347 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:51.758519 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3f049dc3-61b6-4649-b5ce-505472867347 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049174 Mar 03 02:34:51.759078 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 348/705] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:51 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:34:52.367150 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f7eae48e-c8bf-4d67-a61b-566bce2ba9bb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:52.367781 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f7eae48e-c8bf-4d67-a61b-566bce2ba9bb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:52.374323 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f7eae48e-c8bf-4d67-a61b-566bce2ba9bb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:52.374774 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f7eae48e-c8bf-4d67-a61b-566bce2ba9bb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:52.375549 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f7eae48e-c8bf-4d67-a61b-566bce2ba9bb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:52.376746 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f7eae48e-c8bf-4d67-a61b-566bce2ba9bb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:52.508085 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f7eae48e-c8bf-4d67-a61b-566bce2ba9bb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:52.516060 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f7eae48e-c8bf-4d67-a61b-566bce2ba9bb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:52.517590 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f7eae48e-c8bf-4d67-a61b-566bce2ba9bb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:52.518720 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f7eae48e-c8bf-4d67-a61b-566bce2ba9bb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.155606 Mar 03 02:34:52.519274 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 358/706] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:52 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:52.566024 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-07fe4673-07cc-4dce-ae33-f300809cd2b3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:52.566917 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-07fe4673-07cc-4dce-ae33-f300809cd2b3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:52.572691 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-07fe4673-07cc-4dce-ae33-f300809cd2b3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:52.573138 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-07fe4673-07cc-4dce-ae33-f300809cd2b3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:52.573905 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-07fe4673-07cc-4dce-ae33-f300809cd2b3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:52.574336 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-07fe4673-07cc-4dce-ae33-f300809cd2b3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:52.601631 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-07fe4673-07cc-4dce-ae33-f300809cd2b3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040156 Mar 03 02:34:52.602164 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 349/707] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:52 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:52.769925 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3ea8bbdf-d542-4feb-b5a8-df54298d6fb6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:52.770871 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3ea8bbdf-d542-4feb-b5a8-df54298d6fb6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:52.776668 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3ea8bbdf-d542-4feb-b5a8-df54298d6fb6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:52.777121 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3ea8bbdf-d542-4feb-b5a8-df54298d6fb6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:52.777898 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3ea8bbdf-d542-4feb-b5a8-df54298d6fb6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:52.778334 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3ea8bbdf-d542-4feb-b5a8-df54298d6fb6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:52.806984 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3ea8bbdf-d542-4feb-b5a8-df54298d6fb6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041013 Mar 03 02:34:52.807543 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 359/708] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:52 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:53.536908 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-60c6c7f4-d606-45bd-8cdf-abc12f4bf977 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:53.537517 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-60c6c7f4-d606-45bd-8cdf-abc12f4bf977 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:53.543981 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-60c6c7f4-d606-45bd-8cdf-abc12f4bf977 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:53.544436 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-60c6c7f4-d606-45bd-8cdf-abc12f4bf977 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:53.545222 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-60c6c7f4-d606-45bd-8cdf-abc12f4bf977 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:53.545670 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-60c6c7f4-d606-45bd-8cdf-abc12f4bf977 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:53.612786 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7a197584-c316-48ba-b8a2-b7230dc11dbe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:53.613688 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7a197584-c316-48ba-b8a2-b7230dc11dbe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:53.620057 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7a197584-c316-48ba-b8a2-b7230dc11dbe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:53.620512 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7a197584-c316-48ba-b8a2-b7230dc11dbe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:53.621293 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7a197584-c316-48ba-b8a2-b7230dc11dbe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:53.621729 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7a197584-c316-48ba-b8a2-b7230dc11dbe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:53.650598 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7a197584-c316-48ba-b8a2-b7230dc11dbe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041743 Mar 03 02:34:53.651205 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 360/709] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:53 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:34:53.675296 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-60c6c7f4-d606-45bd-8cdf-abc12f4bf977 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:53.683368 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-60c6c7f4-d606-45bd-8cdf-abc12f4bf977 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:53.684920 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-60c6c7f4-d606-45bd-8cdf-abc12f4bf977 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:53.686051 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-60c6c7f4-d606-45bd-8cdf-abc12f4bf977 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.153681 Mar 03 02:34:53.686606 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 350/710] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:53 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:53.819202 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ce6bd654-18ad-4a6c-bded-4beee43dd7b0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:53.820137 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ce6bd654-18ad-4a6c-bded-4beee43dd7b0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:53.825885 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ce6bd654-18ad-4a6c-bded-4beee43dd7b0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:53.826338 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ce6bd654-18ad-4a6c-bded-4beee43dd7b0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:53.827159 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ce6bd654-18ad-4a6c-bded-4beee43dd7b0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:53.827596 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ce6bd654-18ad-4a6c-bded-4beee43dd7b0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:53.860064 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ce6bd654-18ad-4a6c-bded-4beee43dd7b0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044840 Mar 03 02:34:53.860647 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 361/711] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:53 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:34:54.662167 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-fc35602f-7494-430f-9303-0c89525986fe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:54.663086 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-fc35602f-7494-430f-9303-0c89525986fe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:54.669262 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fc35602f-7494-430f-9303-0c89525986fe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:54.669709 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fc35602f-7494-430f-9303-0c89525986fe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:54.670486 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fc35602f-7494-430f-9303-0c89525986fe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:54.670920 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fc35602f-7494-430f-9303-0c89525986fe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:54.698101 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-fc35602f-7494-430f-9303-0c89525986fe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039860 Mar 03 02:34:54.698645 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 351/712] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:54 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:54.705621 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0e1bc0b8-9994-4549-b066-0e27e76b7151 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:54.706230 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0e1bc0b8-9994-4549-b066-0e27e76b7151 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:54.712393 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0e1bc0b8-9994-4549-b066-0e27e76b7151 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:54.712841 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0e1bc0b8-9994-4549-b066-0e27e76b7151 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:54.713620 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0e1bc0b8-9994-4549-b066-0e27e76b7151 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:54.714065 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0e1bc0b8-9994-4549-b066-0e27e76b7151 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:54.847839 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0e1bc0b8-9994-4549-b066-0e27e76b7151 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:54.855760 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0e1bc0b8-9994-4549-b066-0e27e76b7151 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:54.857238 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0e1bc0b8-9994-4549-b066-0e27e76b7151 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:54.858372 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0e1bc0b8-9994-4549-b066-0e27e76b7151 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.157681 Mar 03 02:34:54.858922 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 362/713] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:54 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:54.871741 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-901424a8-3550-4a7d-ad9f-b258cd26b57f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:54.872646 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-901424a8-3550-4a7d-ad9f-b258cd26b57f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:54.878369 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-901424a8-3550-4a7d-ad9f-b258cd26b57f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:54.878817 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-901424a8-3550-4a7d-ad9f-b258cd26b57f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:54.879620 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-901424a8-3550-4a7d-ad9f-b258cd26b57f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:54.880059 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-901424a8-3550-4a7d-ad9f-b258cd26b57f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:54.908129 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-901424a8-3550-4a7d-ad9f-b258cd26b57f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039744 Mar 03 02:34:54.908682 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 352/714] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:54 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:55.709508 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-42042127-fbd3-4a53-9406-1f4ac07837df tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:55.710417 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-42042127-fbd3-4a53-9406-1f4ac07837df tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:55.716651 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-42042127-fbd3-4a53-9406-1f4ac07837df tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:55.717095 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-42042127-fbd3-4a53-9406-1f4ac07837df tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:55.717873 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-42042127-fbd3-4a53-9406-1f4ac07837df tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:55.718333 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-42042127-fbd3-4a53-9406-1f4ac07837df tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:55.746168 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-42042127-fbd3-4a53-9406-1f4ac07837df tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040617 Mar 03 02:34:55.746706 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 363/715] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:55 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:55.876133 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9e19422e-1baa-46d4-b989-706a1c006ef0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:55.876811 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9e19422e-1baa-46d4-b989-706a1c006ef0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:55.883015 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9e19422e-1baa-46d4-b989-706a1c006ef0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:55.883463 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9e19422e-1baa-46d4-b989-706a1c006ef0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:55.884279 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9e19422e-1baa-46d4-b989-706a1c006ef0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:55.884714 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9e19422e-1baa-46d4-b989-706a1c006ef0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:55.919519 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-67f41b70-eacf-4963-a0b2-0c23e033d29e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:55.920453 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-67f41b70-eacf-4963-a0b2-0c23e033d29e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:55.926937 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-67f41b70-eacf-4963-a0b2-0c23e033d29e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:55.927389 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-67f41b70-eacf-4963-a0b2-0c23e033d29e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:55.928247 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-67f41b70-eacf-4963-a0b2-0c23e033d29e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:55.928686 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-67f41b70-eacf-4963-a0b2-0c23e033d29e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:55.956774 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-67f41b70-eacf-4963-a0b2-0c23e033d29e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041049 Mar 03 02:34:55.957337 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 364/716] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:55 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:34:56.013798 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9e19422e-1baa-46d4-b989-706a1c006ef0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:56.021899 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9e19422e-1baa-46d4-b989-706a1c006ef0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:56.023394 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9e19422e-1baa-46d4-b989-706a1c006ef0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:56.024570 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9e19422e-1baa-46d4-b989-706a1c006ef0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.152402 Mar 03 02:34:56.025124 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 353/717] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:55 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:56.758429 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-886e89a4-588f-43fc-8393-2b950b37e857 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:56.759329 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-886e89a4-588f-43fc-8393-2b950b37e857 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:56.765468 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-886e89a4-588f-43fc-8393-2b950b37e857 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:56.765913 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-886e89a4-588f-43fc-8393-2b950b37e857 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:56.767310 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-886e89a4-588f-43fc-8393-2b950b37e857 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:56.767776 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-886e89a4-588f-43fc-8393-2b950b37e857 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:56.794386 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-886e89a4-588f-43fc-8393-2b950b37e857 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039940 Mar 03 02:34:56.794931 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 365/718] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:56 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:56.968131 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8b54ee78-1231-48c3-b25f-7023bbcedaae tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:56.969056 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8b54ee78-1231-48c3-b25f-7023bbcedaae tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:56.975451 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b54ee78-1231-48c3-b25f-7023bbcedaae tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:56.975927 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b54ee78-1231-48c3-b25f-7023bbcedaae tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:56.976694 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b54ee78-1231-48c3-b25f-7023bbcedaae tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:56.977122 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b54ee78-1231-48c3-b25f-7023bbcedaae tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:57.006147 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8b54ee78-1231-48c3-b25f-7023bbcedaae tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041932 Mar 03 02:34:57.006699 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 354/719] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:56 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:57.042499 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d3ed211a-3680-4a56-a6bb-b1f024cc07d0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:57.043035 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d3ed211a-3680-4a56-a6bb-b1f024cc07d0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:57.049573 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d3ed211a-3680-4a56-a6bb-b1f024cc07d0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:57.050023 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d3ed211a-3680-4a56-a6bb-b1f024cc07d0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:57.050796 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d3ed211a-3680-4a56-a6bb-b1f024cc07d0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:57.051231 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d3ed211a-3680-4a56-a6bb-b1f024cc07d0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:57.186733 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d3ed211a-3680-4a56-a6bb-b1f024cc07d0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:57.195385 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d3ed211a-3680-4a56-a6bb-b1f024cc07d0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:57.196913 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d3ed211a-3680-4a56-a6bb-b1f024cc07d0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:57.198050 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d3ed211a-3680-4a56-a6bb-b1f024cc07d0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.159420 Mar 03 02:34:57.198603 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 366/720] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:57 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:57.806160 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-74879442-e2f3-44fb-b0a8-d01450aeb379 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:57.807049 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-74879442-e2f3-44fb-b0a8-d01450aeb379 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:57.812949 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-74879442-e2f3-44fb-b0a8-d01450aeb379 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:57.813674 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-74879442-e2f3-44fb-b0a8-d01450aeb379 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:57.814462 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-74879442-e2f3-44fb-b0a8-d01450aeb379 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:57.814900 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-74879442-e2f3-44fb-b0a8-d01450aeb379 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:57.843103 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-74879442-e2f3-44fb-b0a8-d01450aeb379 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041188 Mar 03 02:34:57.843687 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 355/721] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:57 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:58.017915 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6a21720d-0d62-4caf-9e76-890404366014 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:58.018814 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6a21720d-0d62-4caf-9e76-890404366014 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:58.024970 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6a21720d-0d62-4caf-9e76-890404366014 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:58.025416 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6a21720d-0d62-4caf-9e76-890404366014 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:58.026216 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6a21720d-0d62-4caf-9e76-890404366014 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:58.026646 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6a21720d-0d62-4caf-9e76-890404366014 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:58.055373 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6a21720d-0d62-4caf-9e76-890404366014 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041970 Mar 03 02:34:58.055972 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 367/722] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:58 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:58.216447 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-be1d163f-90fb-4fc7-89ab-20cd6bda5f57 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:58.217055 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-be1d163f-90fb-4fc7-89ab-20cd6bda5f57 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:58.224136 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-be1d163f-90fb-4fc7-89ab-20cd6bda5f57 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:58.224598 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-be1d163f-90fb-4fc7-89ab-20cd6bda5f57 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:58.225382 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-be1d163f-90fb-4fc7-89ab-20cd6bda5f57 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:58.225821 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-be1d163f-90fb-4fc7-89ab-20cd6bda5f57 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:58.363132 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-be1d163f-90fb-4fc7-89ab-20cd6bda5f57 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:58.372267 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-be1d163f-90fb-4fc7-89ab-20cd6bda5f57 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:58.373776 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-be1d163f-90fb-4fc7-89ab-20cd6bda5f57 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:58.374951 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-be1d163f-90fb-4fc7-89ab-20cd6bda5f57 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.162477 Mar 03 02:34:58.376286 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 356/723] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:58 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:58.855350 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-60c032d1-9162-46e0-9c2a-fad5569afc87 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:58.856312 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-60c032d1-9162-46e0-9c2a-fad5569afc87 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:58.862893 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-60c032d1-9162-46e0-9c2a-fad5569afc87 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:58.863340 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-60c032d1-9162-46e0-9c2a-fad5569afc87 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:58.864156 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-60c032d1-9162-46e0-9c2a-fad5569afc87 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:58.864592 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-60c032d1-9162-46e0-9c2a-fad5569afc87 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:58.894119 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-60c032d1-9162-46e0-9c2a-fad5569afc87 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042638 Mar 03 02:34:58.894684 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 368/724] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:58 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:59.067855 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-784db913-06b6-4d70-beed-5cc637aa8044 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:59.068798 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-784db913-06b6-4d70-beed-5cc637aa8044 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:59.074728 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-784db913-06b6-4d70-beed-5cc637aa8044 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:59.075176 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-784db913-06b6-4d70-beed-5cc637aa8044 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:59.075997 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-784db913-06b6-4d70-beed-5cc637aa8044 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:59.076430 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-784db913-06b6-4d70-beed-5cc637aa8044 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:59.106759 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-784db913-06b6-4d70-beed-5cc637aa8044 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042655 Mar 03 02:34:59.107242 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 357/725] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:59 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:34:59.393551 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c1368d3b-af1a-445c-88bf-af53439ed81c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:59.394076 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c1368d3b-af1a-445c-88bf-af53439ed81c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:59.400358 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c1368d3b-af1a-445c-88bf-af53439ed81c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:59.400803 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c1368d3b-af1a-445c-88bf-af53439ed81c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:59.401574 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c1368d3b-af1a-445c-88bf-af53439ed81c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:59.402004 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c1368d3b-af1a-445c-88bf-af53439ed81c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:59.544341 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c1368d3b-af1a-445c-88bf-af53439ed81c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:59.553210 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c1368d3b-af1a-445c-88bf-af53439ed81c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:59.554691 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c1368d3b-af1a-445c-88bf-af53439ed81c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:34:59.556403 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c1368d3b-af1a-445c-88bf-af53439ed81c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.167413 Mar 03 02:34:59.557016 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 369/726] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:34:59 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:34:59.907332 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7c0383e0-7826-481e-9512-c18d7f3e91d8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:34:59.908262 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7c0383e0-7826-481e-9512-c18d7f3e91d8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:34:59.914555 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c0383e0-7826-481e-9512-c18d7f3e91d8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:59.915004 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c0383e0-7826-481e-9512-c18d7f3e91d8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:59.915826 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c0383e0-7826-481e-9512-c18d7f3e91d8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:34:59.916266 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c0383e0-7826-481e-9512-c18d7f3e91d8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:34:59.945547 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7c0383e0-7826-481e-9512-c18d7f3e91d8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042205 Mar 03 02:34:59.946216 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 358/727] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:34:59 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:00.119518 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-49019978-3d92-4e2d-bfb6-f2a2f9ba3a14 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:00.120695 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-49019978-3d92-4e2d-bfb6-f2a2f9ba3a14 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:00.127104 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-49019978-3d92-4e2d-bfb6-f2a2f9ba3a14 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:00.127549 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-49019978-3d92-4e2d-bfb6-f2a2f9ba3a14 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:00.128340 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-49019978-3d92-4e2d-bfb6-f2a2f9ba3a14 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:00.128768 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-49019978-3d92-4e2d-bfb6-f2a2f9ba3a14 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:00.159850 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-49019978-3d92-4e2d-bfb6-f2a2f9ba3a14 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044248 Mar 03 02:35:00.160352 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 370/728] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:00 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:00.573901 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0eb23392-52ab-48bc-a7e8-a07b7aabfeb4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:00.574498 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0eb23392-52ab-48bc-a7e8-a07b7aabfeb4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:00.580287 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0eb23392-52ab-48bc-a7e8-a07b7aabfeb4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:00.580730 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0eb23392-52ab-48bc-a7e8-a07b7aabfeb4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:00.581497 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0eb23392-52ab-48bc-a7e8-a07b7aabfeb4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:00.581931 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0eb23392-52ab-48bc-a7e8-a07b7aabfeb4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:00.714057 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0eb23392-52ab-48bc-a7e8-a07b7aabfeb4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:00.723269 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0eb23392-52ab-48bc-a7e8-a07b7aabfeb4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:00.724868 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0eb23392-52ab-48bc-a7e8-a07b7aabfeb4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:00.726030 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0eb23392-52ab-48bc-a7e8-a07b7aabfeb4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.156018 Mar 03 02:35:00.726597 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 359/729] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:00 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:35:00.957559 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c8e72e15-e8ed-4fc9-9edd-b552b4a06964 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:00.958575 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c8e72e15-e8ed-4fc9-9edd-b552b4a06964 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:00.965177 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c8e72e15-e8ed-4fc9-9edd-b552b4a06964 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:00.965639 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c8e72e15-e8ed-4fc9-9edd-b552b4a06964 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:00.966418 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c8e72e15-e8ed-4fc9-9edd-b552b4a06964 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:00.966869 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c8e72e15-e8ed-4fc9-9edd-b552b4a06964 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:00.995567 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c8e72e15-e8ed-4fc9-9edd-b552b4a06964 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042071 Mar 03 02:35:00.996209 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 371/730] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:00 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:01.171220 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e35ed7e6-c10c-46d2-8223-d8c1d8ce3223 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:01.172144 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e35ed7e6-c10c-46d2-8223-d8c1d8ce3223 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:01.178881 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e35ed7e6-c10c-46d2-8223-d8c1d8ce3223 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:01.179329 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e35ed7e6-c10c-46d2-8223-d8c1d8ce3223 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:01.180130 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e35ed7e6-c10c-46d2-8223-d8c1d8ce3223 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:01.180561 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e35ed7e6-c10c-46d2-8223-d8c1d8ce3223 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:01.209630 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e35ed7e6-c10c-46d2-8223-d8c1d8ce3223 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042240 Mar 03 02:35:01.210108 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 360/731] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:01 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:01.241357 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3b28f9e9-ae2b-4764-95de-6166b16c8a0d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1980320468"}} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:35:01.241925 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3b28f9e9-ae2b-4764-95de-6166b16c8a0d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:01.248192 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3b28f9e9-ae2b-4764-95de-6166b16c8a0d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:01.248711 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3b28f9e9-ae2b-4764-95de-6166b16c8a0d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:01.249548 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3b28f9e9-ae2b-4764-95de-6166b16c8a0d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:01.250051 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3b28f9e9-ae2b-4764-95de-6166b16c8a0d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:01.388174 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.network.security_group_api [None req-3b28f9e9-ae2b-4764-95de-6166b16c8a0d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Removing security group 2529c8d4-27cd-4a19-9458-9abeafd70446 from port 92ff8971-ee17-4845-81d7-3a348747a57d Mar 03 02:35:01.744143 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-227455c4-e064-44cd-8596-9d222f77c9ca tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:01.745456 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-227455c4-e064-44cd-8596-9d222f77c9ca tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:01.753152 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-227455c4-e064-44cd-8596-9d222f77c9ca tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:01.753876 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-227455c4-e064-44cd-8596-9d222f77c9ca tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:01.754878 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-227455c4-e064-44cd-8596-9d222f77c9ca tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:01.755521 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-227455c4-e064-44cd-8596-9d222f77c9ca tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:01.768323 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3b28f9e9-ae2b-4764-95de-6166b16c8a0d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "POST /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/action" status: 202 len: 0 microversion: 2.1 time: 0.530919 Mar 03 02:35:01.769112 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 372/732] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Mar 3 02:35:01 2022] POST /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/action => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 03 02:35:01.779897 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [req-8784ef26-4688-4fae-970b-62675aeb3d45 req-3c9f42e6-818a-45c1-8047-0169a0be3ab7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0df5e3af-dfd2-431d-83af-1a2a02019651", "tag": "92ff8971-ee17-4845-81d7-3a348747a57d"}]} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:35:01.790742 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-8784ef26-4688-4fae-970b-62675aeb3d45 req-3c9f42e6-818a-45c1-8047-0169a0be3ab7 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:01.793530 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-8784ef26-4688-4fae-970b-62675aeb3d45 req-3c9f42e6-818a-45c1-8047-0169a0be3ab7 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:01.806142 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.compute.server_external_events [req-8784ef26-4688-4fae-970b-62675aeb3d45 req-3c9f42e6-818a-45c1-8047-0169a0be3ab7 service nova] Creating event network-changed:92ff8971-ee17-4845-81d7-3a348747a57d for instance 0df5e3af-dfd2-431d-83af-1a2a02019651 on hv-cinder-81977 Mar 03 02:35:01.813442 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [req-8784ef26-4688-4fae-970b-62675aeb3d45 req-3c9f42e6-818a-45c1-8047-0169a0be3ab7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036850 Mar 03 02:35:01.814421 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 373/733] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:35:02.008381 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9a99ef1d-fd69-4461-beb8-7d891a2b0a4a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:02.009376 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9a99ef1d-fd69-4461-beb8-7d891a2b0a4a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:02.015709 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9a99ef1d-fd69-4461-beb8-7d891a2b0a4a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:02.016774 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9a99ef1d-fd69-4461-beb8-7d891a2b0a4a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:02.017633 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9a99ef1d-fd69-4461-beb8-7d891a2b0a4a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:02.018146 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9a99ef1d-fd69-4461-beb8-7d891a2b0a4a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:02.050601 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9a99ef1d-fd69-4461-beb8-7d891a2b0a4a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042819 Mar 03 02:35:02.051953 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 374/734] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:02 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:02.130709 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-227455c4-e064-44cd-8596-9d222f77c9ca tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:02.144646 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-227455c4-e064-44cd-8596-9d222f77c9ca tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:02.146332 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-227455c4-e064-44cd-8596-9d222f77c9ca tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:02.147505 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-227455c4-e064-44cd-8596-9d222f77c9ca tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.407306 Mar 03 02:35:02.148289 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 361/735] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:01 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:35:02.221816 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f16ac7fb-4c4e-4522-aa53-0cf38b9a5331 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:02.223054 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f16ac7fb-4c4e-4522-aa53-0cf38b9a5331 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:02.229195 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f16ac7fb-4c4e-4522-aa53-0cf38b9a5331 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:02.229939 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f16ac7fb-4c4e-4522-aa53-0cf38b9a5331 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:02.230966 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f16ac7fb-4c4e-4522-aa53-0cf38b9a5331 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:02.231407 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f16ac7fb-4c4e-4522-aa53-0cf38b9a5331 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:02.262482 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f16ac7fb-4c4e-4522-aa53-0cf38b9a5331 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045470 Mar 03 02:35:02.263061 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 375/736] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:02 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:03.062431 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-fdc7d4b5-9873-417d-bb0e-06fefd433dbe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:03.064146 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-fdc7d4b5-9873-417d-bb0e-06fefd433dbe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:03.070344 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fdc7d4b5-9873-417d-bb0e-06fefd433dbe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:03.070794 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fdc7d4b5-9873-417d-bb0e-06fefd433dbe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:03.071568 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fdc7d4b5-9873-417d-bb0e-06fefd433dbe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:03.072044 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fdc7d4b5-9873-417d-bb0e-06fefd433dbe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:03.100570 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-fdc7d4b5-9873-417d-bb0e-06fefd433dbe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042114 Mar 03 02:35:03.101130 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 362/737] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:03 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:03.166381 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f24256f9-640b-4c9e-8334-8d616b0016e5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:03.166987 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f24256f9-640b-4c9e-8334-8d616b0016e5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:03.172735 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f24256f9-640b-4c9e-8334-8d616b0016e5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:03.173267 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f24256f9-640b-4c9e-8334-8d616b0016e5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:03.174035 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f24256f9-640b-4c9e-8334-8d616b0016e5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:03.174466 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f24256f9-640b-4c9e-8334-8d616b0016e5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:03.274006 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e6d80d79-9fca-4758-93ae-88f2c3fcbe6a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:03.274950 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e6d80d79-9fca-4758-93ae-88f2c3fcbe6a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:03.280617 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e6d80d79-9fca-4758-93ae-88f2c3fcbe6a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:03.281062 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e6d80d79-9fca-4758-93ae-88f2c3fcbe6a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:03.282231 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e6d80d79-9fca-4758-93ae-88f2c3fcbe6a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:03.282785 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e6d80d79-9fca-4758-93ae-88f2c3fcbe6a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:03.333420 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e6d80d79-9fca-4758-93ae-88f2c3fcbe6a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063276 Mar 03 02:35:03.333997 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 363/738] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:03 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:35:03.353752 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8dcb8646-e617-4e5a-93e4-b6cf82eed6a4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:03.354240 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8dcb8646-e617-4e5a-93e4-b6cf82eed6a4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:03.360518 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8dcb8646-e617-4e5a-93e4-b6cf82eed6a4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:03.361659 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8dcb8646-e617-4e5a-93e4-b6cf82eed6a4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:03.362455 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8dcb8646-e617-4e5a-93e4-b6cf82eed6a4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:03.362897 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8dcb8646-e617-4e5a-93e4-b6cf82eed6a4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:03.375277 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f24256f9-640b-4c9e-8334-8d616b0016e5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:03.386096 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f24256f9-640b-4c9e-8334-8d616b0016e5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:03.387750 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f24256f9-640b-4c9e-8334-8d616b0016e5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:03.389048 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f24256f9-640b-4c9e-8334-8d616b0016e5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.226588 Mar 03 02:35:03.389602 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 376/739] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:03 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:35:03.444804 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.objects.instance [None req-8dcb8646-e617-4e5a-93e4-b6cf82eed6a4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lazy-loading 'services' on Instance uuid 0df5e3af-dfd2-431d-83af-1a2a02019651 {{(pid=116858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 03 02:35:03.540677 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8dcb8646-e617-4e5a-93e4-b6cf82eed6a4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments/f2e36cca-2705-4b40-8b08-2a93f505f2f6" status: 202 len: 0 microversion: 2.1 time: 0.190718 Mar 03 02:35:03.541592 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 364/740] 10.222.0.30 () {58 vars in 1415 bytes} [Thu Mar 3 02:35:03 2022] DELETE /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments/f2e36cca-2705-4b40-8b08-2a93f505f2f6 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 03 02:35:03.551471 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7b3a1766-3269-4e58-ae4d-c8b6ded2d89e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:03.552471 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7b3a1766-3269-4e58-ae4d-c8b6ded2d89e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:03.559035 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7b3a1766-3269-4e58-ae4d-c8b6ded2d89e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:03.559575 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7b3a1766-3269-4e58-ae4d-c8b6ded2d89e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:03.561301 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7b3a1766-3269-4e58-ae4d-c8b6ded2d89e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:03.561750 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7b3a1766-3269-4e58-ae4d-c8b6ded2d89e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:03.596266 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7b3a1766-3269-4e58-ae4d-c8b6ded2d89e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050471 Mar 03 02:35:03.597042 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 377/741] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:03 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:03.842855 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [req-96af9430-990e-4edd-8e97-4379d8ae298a req-e062b255-16a1-426b-b118-476f7d651720 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0df5e3af-dfd2-431d-83af-1a2a02019651", "tag": "92ff8971-ee17-4845-81d7-3a348747a57d"}]} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:35:03.851729 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-96af9430-990e-4edd-8e97-4379d8ae298a req-e062b255-16a1-426b-b118-476f7d651720 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:03.852267 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-96af9430-990e-4edd-8e97-4379d8ae298a req-e062b255-16a1-426b-b118-476f7d651720 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:03.863365 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.compute.server_external_events [req-96af9430-990e-4edd-8e97-4379d8ae298a req-e062b255-16a1-426b-b118-476f7d651720 service nova] Creating event network-changed:92ff8971-ee17-4845-81d7-3a348747a57d for instance 0df5e3af-dfd2-431d-83af-1a2a02019651 on hv-cinder-81977 Mar 03 02:35:03.868214 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [req-96af9430-990e-4edd-8e97-4379d8ae298a req-e062b255-16a1-426b-b118-476f7d651720 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029419 Mar 03 02:35:03.868808 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 365/742] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:04.114123 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f5c5f3fc-f699-477b-b64f-ae207a7eac77 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:04.115294 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f5c5f3fc-f699-477b-b64f-ae207a7eac77 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:04.127312 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f5c5f3fc-f699-477b-b64f-ae207a7eac77 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:04.127805 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f5c5f3fc-f699-477b-b64f-ae207a7eac77 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:04.128624 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f5c5f3fc-f699-477b-b64f-ae207a7eac77 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:04.129268 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f5c5f3fc-f699-477b-b64f-ae207a7eac77 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:04.162849 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f5c5f3fc-f699-477b-b64f-ae207a7eac77 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054454 Mar 03 02:35:04.166024 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 378/743] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:04 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:04.352967 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7ff0935d-2922-4021-a0fc-d019654626cc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:04.353984 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7ff0935d-2922-4021-a0fc-d019654626cc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:04.360516 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7ff0935d-2922-4021-a0fc-d019654626cc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:04.361075 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7ff0935d-2922-4021-a0fc-d019654626cc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:04.362321 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7ff0935d-2922-4021-a0fc-d019654626cc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:04.362834 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7ff0935d-2922-4021-a0fc-d019654626cc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:04.392788 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7ff0935d-2922-4021-a0fc-d019654626cc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051568 Mar 03 02:35:04.393463 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 366/744] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:04 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:04.406120 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-50dc27b8-fced-4d14-b46b-3305c3497a5d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:04.406892 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-50dc27b8-fced-4d14-b46b-3305c3497a5d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:04.413850 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-50dc27b8-fced-4d14-b46b-3305c3497a5d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:04.414718 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-50dc27b8-fced-4d14-b46b-3305c3497a5d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:04.416041 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-50dc27b8-fced-4d14-b46b-3305c3497a5d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:04.416913 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-50dc27b8-fced-4d14-b46b-3305c3497a5d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:04.557292 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-50dc27b8-fced-4d14-b46b-3305c3497a5d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:04.566214 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-50dc27b8-fced-4d14-b46b-3305c3497a5d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:04.567724 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-50dc27b8-fced-4d14-b46b-3305c3497a5d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:04.568870 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-50dc27b8-fced-4d14-b46b-3305c3497a5d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.166674 Mar 03 02:35:04.569422 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 379/745] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:04 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:35:04.608404 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0b542ce3-7cf0-4fc9-828f-6070fc563124 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:04.609394 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0b542ce3-7cf0-4fc9-828f-6070fc563124 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:04.615403 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0b542ce3-7cf0-4fc9-828f-6070fc563124 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:04.615948 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0b542ce3-7cf0-4fc9-828f-6070fc563124 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:04.616737 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0b542ce3-7cf0-4fc9-828f-6070fc563124 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:04.617168 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0b542ce3-7cf0-4fc9-828f-6070fc563124 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:04.647000 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0b542ce3-7cf0-4fc9-828f-6070fc563124 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042441 Mar 03 02:35:04.647554 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 367/746] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:04 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:05.174819 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-bd0eea0c-3e8d-463b-9b00-9d0a09c53542 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:05.175787 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-bd0eea0c-3e8d-463b-9b00-9d0a09c53542 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:05.181546 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bd0eea0c-3e8d-463b-9b00-9d0a09c53542 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:05.181996 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bd0eea0c-3e8d-463b-9b00-9d0a09c53542 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:05.182771 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bd0eea0c-3e8d-463b-9b00-9d0a09c53542 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:05.183207 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bd0eea0c-3e8d-463b-9b00-9d0a09c53542 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:05.211614 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-bd0eea0c-3e8d-463b-9b00-9d0a09c53542 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041825 Mar 03 02:35:05.212168 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 380/747] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:05 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:05.404504 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f53430bb-4f4e-49a5-9827-58343e802ecf tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:05.405408 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f53430bb-4f4e-49a5-9827-58343e802ecf tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:05.411997 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f53430bb-4f4e-49a5-9827-58343e802ecf tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:05.412441 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f53430bb-4f4e-49a5-9827-58343e802ecf tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:05.413211 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f53430bb-4f4e-49a5-9827-58343e802ecf tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:05.413644 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f53430bb-4f4e-49a5-9827-58343e802ecf tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:05.442855 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f53430bb-4f4e-49a5-9827-58343e802ecf tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042299 Mar 03 02:35:05.443406 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 368/748] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:05 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:05.588080 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e586aad2-7221-458e-a74c-4ab55aa7a505 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:05.588687 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e586aad2-7221-458e-a74c-4ab55aa7a505 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:05.595523 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e586aad2-7221-458e-a74c-4ab55aa7a505 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:05.596006 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e586aad2-7221-458e-a74c-4ab55aa7a505 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:05.596783 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e586aad2-7221-458e-a74c-4ab55aa7a505 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:05.597220 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e586aad2-7221-458e-a74c-4ab55aa7a505 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:05.659186 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-43d141de-cd2b-4051-9ea3-6f8fa137b764 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:05.660040 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-43d141de-cd2b-4051-9ea3-6f8fa137b764 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:05.665647 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-43d141de-cd2b-4051-9ea3-6f8fa137b764 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:05.666100 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-43d141de-cd2b-4051-9ea3-6f8fa137b764 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:05.666884 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-43d141de-cd2b-4051-9ea3-6f8fa137b764 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:05.667324 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-43d141de-cd2b-4051-9ea3-6f8fa137b764 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:05.695570 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-43d141de-cd2b-4051-9ea3-6f8fa137b764 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041041 Mar 03 02:35:05.696192 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 369/749] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:05 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:35:05.727630 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e586aad2-7221-458e-a74c-4ab55aa7a505 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:05.735690 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e586aad2-7221-458e-a74c-4ab55aa7a505 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:05.737195 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e586aad2-7221-458e-a74c-4ab55aa7a505 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:05.738348 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e586aad2-7221-458e-a74c-4ab55aa7a505 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.154273 Mar 03 02:35:05.738912 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 381/750] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:05 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:35:06.222883 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a3138818-43a4-4f37-b975-186e015d995f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:06.223834 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a3138818-43a4-4f37-b975-186e015d995f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:06.229644 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a3138818-43a4-4f37-b975-186e015d995f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:06.230160 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a3138818-43a4-4f37-b975-186e015d995f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:06.230939 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a3138818-43a4-4f37-b975-186e015d995f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:06.231382 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a3138818-43a4-4f37-b975-186e015d995f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:06.259339 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a3138818-43a4-4f37-b975-186e015d995f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040371 Mar 03 02:35:06.259918 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 370/751] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:06 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:06.454617 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d4fe4ead-6a86-4f57-b7f0-d963f4b28653 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:06.455550 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d4fe4ead-6a86-4f57-b7f0-d963f4b28653 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:06.465334 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d4fe4ead-6a86-4f57-b7f0-d963f4b28653 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:06.465780 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d4fe4ead-6a86-4f57-b7f0-d963f4b28653 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:06.466561 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d4fe4ead-6a86-4f57-b7f0-d963f4b28653 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:06.466994 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d4fe4ead-6a86-4f57-b7f0-d963f4b28653 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:06.494171 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d4fe4ead-6a86-4f57-b7f0-d963f4b28653 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043844 Mar 03 02:35:06.494720 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 382/752] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:06 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:06.706476 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3163062d-d64d-45fd-b718-c7ea25e7d4a4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:06.707372 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3163062d-d64d-45fd-b718-c7ea25e7d4a4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:06.713774 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3163062d-d64d-45fd-b718-c7ea25e7d4a4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:06.714225 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3163062d-d64d-45fd-b718-c7ea25e7d4a4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:06.715009 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3163062d-d64d-45fd-b718-c7ea25e7d4a4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:06.715456 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3163062d-d64d-45fd-b718-c7ea25e7d4a4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:06.743644 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3163062d-d64d-45fd-b718-c7ea25e7d4a4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041299 Mar 03 02:35:06.744197 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 371/753] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:06 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:06.757276 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3d4f8dd0-8fde-497a-b69e-9cd4c3a62b62 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:06.758225 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3d4f8dd0-8fde-497a-b69e-9cd4c3a62b62 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:06.764666 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3d4f8dd0-8fde-497a-b69e-9cd4c3a62b62 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:06.765112 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3d4f8dd0-8fde-497a-b69e-9cd4c3a62b62 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:06.765884 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3d4f8dd0-8fde-497a-b69e-9cd4c3a62b62 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:06.766486 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3d4f8dd0-8fde-497a-b69e-9cd4c3a62b62 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:06.901819 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3d4f8dd0-8fde-497a-b69e-9cd4c3a62b62 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:06.910729 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3d4f8dd0-8fde-497a-b69e-9cd4c3a62b62 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:06.912251 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3d4f8dd0-8fde-497a-b69e-9cd4c3a62b62 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:06.913386 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3d4f8dd0-8fde-497a-b69e-9cd4c3a62b62 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.159950 Mar 03 02:35:06.913940 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 383/754] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:06 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:35:07.271285 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d859a90f-7580-472c-be2f-5bda8033e018 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:07.272223 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d859a90f-7580-472c-be2f-5bda8033e018 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:07.277972 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d859a90f-7580-472c-be2f-5bda8033e018 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:07.278420 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d859a90f-7580-472c-be2f-5bda8033e018 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:07.279194 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d859a90f-7580-472c-be2f-5bda8033e018 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:07.279646 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d859a90f-7580-472c-be2f-5bda8033e018 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:07.307782 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d859a90f-7580-472c-be2f-5bda8033e018 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040400 Mar 03 02:35:07.308319 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 372/755] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:07 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:07.506971 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-46fba921-bc50-4305-a8b3-3abee8ed6d5b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:07.507832 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-46fba921-bc50-4305-a8b3-3abee8ed6d5b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:07.513622 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-46fba921-bc50-4305-a8b3-3abee8ed6d5b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:07.514090 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-46fba921-bc50-4305-a8b3-3abee8ed6d5b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:07.514856 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-46fba921-bc50-4305-a8b3-3abee8ed6d5b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:07.515291 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-46fba921-bc50-4305-a8b3-3abee8ed6d5b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:07.543010 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-46fba921-bc50-4305-a8b3-3abee8ed6d5b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040038 Mar 03 02:35:07.543548 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 384/756] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:07 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:35:07.755524 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-53a1174f-a5a1-4599-b4ae-e413e59dfb63 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:07.756488 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-53a1174f-a5a1-4599-b4ae-e413e59dfb63 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:07.762974 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-53a1174f-a5a1-4599-b4ae-e413e59dfb63 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:07.763376 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-53a1174f-a5a1-4599-b4ae-e413e59dfb63 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:07.764193 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-53a1174f-a5a1-4599-b4ae-e413e59dfb63 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:07.764630 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-53a1174f-a5a1-4599-b4ae-e413e59dfb63 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:07.792980 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-53a1174f-a5a1-4599-b4ae-e413e59dfb63 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041442 Mar 03 02:35:07.793522 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 373/757] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:07 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:35:07.932146 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f229fa55-c9d5-486c-905d-83eb0b6fdc9a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:07.932752 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f229fa55-c9d5-486c-905d-83eb0b6fdc9a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:07.940369 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f229fa55-c9d5-486c-905d-83eb0b6fdc9a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:07.940911 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f229fa55-c9d5-486c-905d-83eb0b6fdc9a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:07.941686 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f229fa55-c9d5-486c-905d-83eb0b6fdc9a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:07.942204 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f229fa55-c9d5-486c-905d-83eb0b6fdc9a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:08.073545 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f229fa55-c9d5-486c-905d-83eb0b6fdc9a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:08.081793 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f229fa55-c9d5-486c-905d-83eb0b6fdc9a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:08.083272 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f229fa55-c9d5-486c-905d-83eb0b6fdc9a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:08.084434 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f229fa55-c9d5-486c-905d-83eb0b6fdc9a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.156495 Mar 03 02:35:08.084987 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 385/758] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:07 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:35:08.318493 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5ab3de6d-39d0-4290-95c2-6f06dc7652d5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:08.319314 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5ab3de6d-39d0-4290-95c2-6f06dc7652d5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:08.325085 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5ab3de6d-39d0-4290-95c2-6f06dc7652d5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:08.325531 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5ab3de6d-39d0-4290-95c2-6f06dc7652d5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:08.326298 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5ab3de6d-39d0-4290-95c2-6f06dc7652d5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:08.326728 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5ab3de6d-39d0-4290-95c2-6f06dc7652d5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:08.354431 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5ab3de6d-39d0-4290-95c2-6f06dc7652d5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039904 Mar 03 02:35:08.354969 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 374/759] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:08 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:08.554594 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d9d3e116-fddc-4293-b323-ae0709887caa tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:08.555494 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d9d3e116-fddc-4293-b323-ae0709887caa tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:08.561329 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d9d3e116-fddc-4293-b323-ae0709887caa tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:08.561853 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d9d3e116-fddc-4293-b323-ae0709887caa tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:08.562802 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d9d3e116-fddc-4293-b323-ae0709887caa tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:08.563267 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d9d3e116-fddc-4293-b323-ae0709887caa tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:08.591852 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d9d3e116-fddc-4293-b323-ae0709887caa tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041155 Mar 03 02:35:08.592391 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 386/760] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:08 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:08.804474 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1a723ffc-a747-4d7f-8229-f25dc86f7e89 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:08.805406 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1a723ffc-a747-4d7f-8229-f25dc86f7e89 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:08.811558 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1a723ffc-a747-4d7f-8229-f25dc86f7e89 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:08.812039 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1a723ffc-a747-4d7f-8229-f25dc86f7e89 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:08.812813 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1a723ffc-a747-4d7f-8229-f25dc86f7e89 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:08.813747 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1a723ffc-a747-4d7f-8229-f25dc86f7e89 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:08.841835 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1a723ffc-a747-4d7f-8229-f25dc86f7e89 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041301 Mar 03 02:35:08.842439 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 375/761] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:08 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:09.101381 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-755a4962-140b-4931-b73f-b833b90a0afe tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:09.101920 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-755a4962-140b-4931-b73f-b833b90a0afe tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:09.108146 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-755a4962-140b-4931-b73f-b833b90a0afe tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:09.108590 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-755a4962-140b-4931-b73f-b833b90a0afe tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:09.109359 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-755a4962-140b-4931-b73f-b833b90a0afe tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:09.109877 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-755a4962-140b-4931-b73f-b833b90a0afe tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:09.241319 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-755a4962-140b-4931-b73f-b833b90a0afe tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:09.249613 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-755a4962-140b-4931-b73f-b833b90a0afe tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:09.251685 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-755a4962-140b-4931-b73f-b833b90a0afe tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:09.252832 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-755a4962-140b-4931-b73f-b833b90a0afe tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.155349 Mar 03 02:35:09.253385 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 387/762] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:09 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:35:09.366675 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e4009138-fe7b-4697-a483-8ede4ea200ea tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:09.367502 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e4009138-fe7b-4697-a483-8ede4ea200ea tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:09.373591 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e4009138-fe7b-4697-a483-8ede4ea200ea tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:09.374074 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e4009138-fe7b-4697-a483-8ede4ea200ea tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:09.374841 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e4009138-fe7b-4697-a483-8ede4ea200ea tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:09.375276 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e4009138-fe7b-4697-a483-8ede4ea200ea tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:09.403009 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e4009138-fe7b-4697-a483-8ede4ea200ea tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040393 Mar 03 02:35:09.403547 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 376/763] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:09 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:09.603405 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-581cdb79-066f-4bfd-8e33-2457d0c690f8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:09.604339 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-581cdb79-066f-4bfd-8e33-2457d0c690f8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:09.610190 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-581cdb79-066f-4bfd-8e33-2457d0c690f8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:09.610634 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-581cdb79-066f-4bfd-8e33-2457d0c690f8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:09.611407 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-581cdb79-066f-4bfd-8e33-2457d0c690f8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:09.611879 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-581cdb79-066f-4bfd-8e33-2457d0c690f8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:09.639321 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-581cdb79-066f-4bfd-8e33-2457d0c690f8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039850 Mar 03 02:35:09.639836 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 388/764] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:09 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:09.853945 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-cf1cbbbe-bb69-4796-a782-fae00accea95 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:09.854841 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-cf1cbbbe-bb69-4796-a782-fae00accea95 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:09.861037 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cf1cbbbe-bb69-4796-a782-fae00accea95 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:09.861485 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cf1cbbbe-bb69-4796-a782-fae00accea95 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:09.862256 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cf1cbbbe-bb69-4796-a782-fae00accea95 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:09.862703 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cf1cbbbe-bb69-4796-a782-fae00accea95 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:09.889753 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-cf1cbbbe-bb69-4796-a782-fae00accea95 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039751 Mar 03 02:35:09.890226 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 377/765] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:09 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:10.270203 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7d636cc8-1f6c-41d5-b7bd-60f55917364d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:10.270803 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7d636cc8-1f6c-41d5-b7bd-60f55917364d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:10.277031 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7d636cc8-1f6c-41d5-b7bd-60f55917364d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:10.277479 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7d636cc8-1f6c-41d5-b7bd-60f55917364d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:10.278251 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7d636cc8-1f6c-41d5-b7bd-60f55917364d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:10.278687 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7d636cc8-1f6c-41d5-b7bd-60f55917364d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:10.412067 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-7d636cc8-1f6c-41d5-b7bd-60f55917364d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:10.414451 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ad8b5b19-2516-49f6-b032-6d7b1706e8c6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:10.415396 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ad8b5b19-2516-49f6-b032-6d7b1706e8c6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:10.420290 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-7d636cc8-1f6c-41d5-b7bd-60f55917364d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:10.421052 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ad8b5b19-2516-49f6-b032-6d7b1706e8c6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:10.421503 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ad8b5b19-2516-49f6-b032-6d7b1706e8c6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:10.421794 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-7d636cc8-1f6c-41d5-b7bd-60f55917364d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:10.422292 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ad8b5b19-2516-49f6-b032-6d7b1706e8c6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:10.423118 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ad8b5b19-2516-49f6-b032-6d7b1706e8c6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:10.423312 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7d636cc8-1f6c-41d5-b7bd-60f55917364d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.156729 Mar 03 02:35:10.423637 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 389/766] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:10 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:35:10.450261 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ad8b5b19-2516-49f6-b032-6d7b1706e8c6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039723 Mar 03 02:35:10.450806 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 378/767] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:10 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:35:10.651705 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a8bf19ba-1bf9-49c0-b2bf-348e48c40feb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:10.652613 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a8bf19ba-1bf9-49c0-b2bf-348e48c40feb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:10.658499 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a8bf19ba-1bf9-49c0-b2bf-348e48c40feb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:10.658946 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a8bf19ba-1bf9-49c0-b2bf-348e48c40feb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:10.659738 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a8bf19ba-1bf9-49c0-b2bf-348e48c40feb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:10.660172 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a8bf19ba-1bf9-49c0-b2bf-348e48c40feb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:10.687405 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a8bf19ba-1bf9-49c0-b2bf-348e48c40feb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039691 Mar 03 02:35:10.688522 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 390/768] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:10 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:10.901077 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-805de004-8b68-4b2c-9341-4b3fab7e5069 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:10.901987 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-805de004-8b68-4b2c-9341-4b3fab7e5069 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:10.908292 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-805de004-8b68-4b2c-9341-4b3fab7e5069 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:10.908749 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-805de004-8b68-4b2c-9341-4b3fab7e5069 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:10.909537 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-805de004-8b68-4b2c-9341-4b3fab7e5069 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:10.909982 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-805de004-8b68-4b2c-9341-4b3fab7e5069 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:10.937549 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-805de004-8b68-4b2c-9341-4b3fab7e5069 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040343 Mar 03 02:35:10.938812 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 379/769] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:10 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:11.441587 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4f9f6a2a-c7b5-4453-9875-dc47373294dc tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:11.442231 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4f9f6a2a-c7b5-4453-9875-dc47373294dc tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:11.448757 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4f9f6a2a-c7b5-4453-9875-dc47373294dc tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:11.449210 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4f9f6a2a-c7b5-4453-9875-dc47373294dc tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:11.449993 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4f9f6a2a-c7b5-4453-9875-dc47373294dc tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:11.450434 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4f9f6a2a-c7b5-4453-9875-dc47373294dc tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:11.462231 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b0919324-4395-4ced-b93b-4721a7843095 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:11.463188 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b0919324-4395-4ced-b93b-4721a7843095 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:11.469218 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b0919324-4395-4ced-b93b-4721a7843095 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:11.469675 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b0919324-4395-4ced-b93b-4721a7843095 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:11.470467 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b0919324-4395-4ced-b93b-4721a7843095 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:11.470913 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b0919324-4395-4ced-b93b-4721a7843095 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:11.499549 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b0919324-4395-4ced-b93b-4721a7843095 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041112 Mar 03 02:35:11.500133 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 380/770] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:11 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:35:11.582857 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4f9f6a2a-c7b5-4453-9875-dc47373294dc tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:11.590836 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4f9f6a2a-c7b5-4453-9875-dc47373294dc tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:11.592339 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4f9f6a2a-c7b5-4453-9875-dc47373294dc tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:11.593476 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4f9f6a2a-c7b5-4453-9875-dc47373294dc tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.156441 Mar 03 02:35:11.594031 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 391/771] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:11 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:35:11.699335 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-df36c8ea-df9c-49e5-87e8-a7b498680712 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:11.700198 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-df36c8ea-df9c-49e5-87e8-a7b498680712 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:11.706516 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-df36c8ea-df9c-49e5-87e8-a7b498680712 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:11.706965 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-df36c8ea-df9c-49e5-87e8-a7b498680712 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:11.707774 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-df36c8ea-df9c-49e5-87e8-a7b498680712 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:11.708215 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-df36c8ea-df9c-49e5-87e8-a7b498680712 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:11.736609 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-df36c8ea-df9c-49e5-87e8-a7b498680712 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041225 Mar 03 02:35:11.737163 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 381/772] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:11 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:11.949985 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-008e9183-bb04-4f7e-933a-f9510dc9e6f2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:11.950821 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-008e9183-bb04-4f7e-933a-f9510dc9e6f2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:11.956683 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-008e9183-bb04-4f7e-933a-f9510dc9e6f2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:11.957127 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-008e9183-bb04-4f7e-933a-f9510dc9e6f2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:11.957896 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-008e9183-bb04-4f7e-933a-f9510dc9e6f2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:11.958323 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-008e9183-bb04-4f7e-933a-f9510dc9e6f2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:11.985882 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-008e9183-bb04-4f7e-933a-f9510dc9e6f2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039469 Mar 03 02:35:11.986382 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 392/773] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:11 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:12.512979 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-fbeed6b8-470b-40db-9604-cdf5e990db1b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:12.513789 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-fbeed6b8-470b-40db-9604-cdf5e990db1b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:12.520558 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fbeed6b8-470b-40db-9604-cdf5e990db1b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:12.521004 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fbeed6b8-470b-40db-9604-cdf5e990db1b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:12.521801 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fbeed6b8-470b-40db-9604-cdf5e990db1b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:12.522236 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fbeed6b8-470b-40db-9604-cdf5e990db1b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:12.549710 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-fbeed6b8-470b-40db-9604-cdf5e990db1b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040715 Mar 03 02:35:12.550246 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 382/774] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:12 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:12.611315 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7b9b6a00-3c6b-43f2-b061-21040f4cb05b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:12.611948 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7b9b6a00-3c6b-43f2-b061-21040f4cb05b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:12.618148 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7b9b6a00-3c6b-43f2-b061-21040f4cb05b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:12.618597 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7b9b6a00-3c6b-43f2-b061-21040f4cb05b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:12.619371 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7b9b6a00-3c6b-43f2-b061-21040f4cb05b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:12.620112 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7b9b6a00-3c6b-43f2-b061-21040f4cb05b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:12.748462 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-152874bd-6e00-4cfb-b60e-5b01b8ef248c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:12.749357 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-152874bd-6e00-4cfb-b60e-5b01b8ef248c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:12.755716 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-152874bd-6e00-4cfb-b60e-5b01b8ef248c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:12.756164 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-152874bd-6e00-4cfb-b60e-5b01b8ef248c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:12.756943 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-152874bd-6e00-4cfb-b60e-5b01b8ef248c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:12.757372 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-152874bd-6e00-4cfb-b60e-5b01b8ef248c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:12.759364 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-7b9b6a00-3c6b-43f2-b061-21040f4cb05b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:12.768361 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-7b9b6a00-3c6b-43f2-b061-21040f4cb05b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:12.769790 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-7b9b6a00-3c6b-43f2-b061-21040f4cb05b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:12.770949 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7b9b6a00-3c6b-43f2-b061-21040f4cb05b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.163693 Mar 03 02:35:12.771514 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 393/775] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:12 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:35:12.785898 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-152874bd-6e00-4cfb-b60e-5b01b8ef248c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041698 Mar 03 02:35:12.786448 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 383/776] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:12 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:35:12.997553 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-16e0fb4e-6721-40af-ad19-f5883cc1c3a7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:12.998470 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-16e0fb4e-6721-40af-ad19-f5883cc1c3a7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:13.005679 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-16e0fb4e-6721-40af-ad19-f5883cc1c3a7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:13.006127 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-16e0fb4e-6721-40af-ad19-f5883cc1c3a7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:13.006939 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-16e0fb4e-6721-40af-ad19-f5883cc1c3a7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:13.007382 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-16e0fb4e-6721-40af-ad19-f5883cc1c3a7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:13.035698 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-16e0fb4e-6721-40af-ad19-f5883cc1c3a7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042299 Mar 03 02:35:13.036171 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 394/777] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:12 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:13.561043 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3154f56f-bdf1-4588-8b2c-c37237dd3f16 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:13.561883 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3154f56f-bdf1-4588-8b2c-c37237dd3f16 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:13.568809 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3154f56f-bdf1-4588-8b2c-c37237dd3f16 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:13.569267 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3154f56f-bdf1-4588-8b2c-c37237dd3f16 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:13.570054 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3154f56f-bdf1-4588-8b2c-c37237dd3f16 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:13.570495 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3154f56f-bdf1-4588-8b2c-c37237dd3f16 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:13.598574 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3154f56f-bdf1-4588-8b2c-c37237dd3f16 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041591 Mar 03 02:35:13.599117 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 384/778] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:13 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:13.789385 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d51618e7-0375-4216-9020-2840f401c00c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:13.790031 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d51618e7-0375-4216-9020-2840f401c00c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:13.796273 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d51618e7-0375-4216-9020-2840f401c00c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:13.796751 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d51618e7-0375-4216-9020-2840f401c00c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:13.797095 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-940a91fc-70f0-4ef9-bf7e-b2dd55563aac tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:13.798101 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d51618e7-0375-4216-9020-2840f401c00c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:13.798305 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-940a91fc-70f0-4ef9-bf7e-b2dd55563aac tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:13.798548 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d51618e7-0375-4216-9020-2840f401c00c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:13.803928 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-940a91fc-70f0-4ef9-bf7e-b2dd55563aac tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:13.804377 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-940a91fc-70f0-4ef9-bf7e-b2dd55563aac tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:13.805154 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-940a91fc-70f0-4ef9-bf7e-b2dd55563aac tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:13.805954 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-940a91fc-70f0-4ef9-bf7e-b2dd55563aac tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:13.837983 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-940a91fc-70f0-4ef9-bf7e-b2dd55563aac tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044719 Mar 03 02:35:13.838551 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 385/779] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:13 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:35:13.934065 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d51618e7-0375-4216-9020-2840f401c00c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:13.942284 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d51618e7-0375-4216-9020-2840f401c00c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:13.943839 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d51618e7-0375-4216-9020-2840f401c00c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:13.949607 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d51618e7-0375-4216-9020-2840f401c00c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.159673 Mar 03 02:35:13.950286 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 395/780] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:13 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:35:14.046329 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-95303025-67c3-4aa0-88bb-1b2937ffd78a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:14.047242 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-95303025-67c3-4aa0-88bb-1b2937ffd78a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:14.053103 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-95303025-67c3-4aa0-88bb-1b2937ffd78a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:14.053549 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-95303025-67c3-4aa0-88bb-1b2937ffd78a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:14.054680 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-95303025-67c3-4aa0-88bb-1b2937ffd78a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:14.055115 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-95303025-67c3-4aa0-88bb-1b2937ffd78a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:14.082614 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-95303025-67c3-4aa0-88bb-1b2937ffd78a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040238 Mar 03 02:35:14.083157 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 386/781] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:14 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:14.609568 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-93b962c1-ceb5-4bbf-9306-03251dad715b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:14.611031 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-93b962c1-ceb5-4bbf-9306-03251dad715b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:14.616863 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-93b962c1-ceb5-4bbf-9306-03251dad715b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:14.617304 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-93b962c1-ceb5-4bbf-9306-03251dad715b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:14.618073 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-93b962c1-ceb5-4bbf-9306-03251dad715b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:14.618503 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-93b962c1-ceb5-4bbf-9306-03251dad715b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:14.645990 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-93b962c1-ceb5-4bbf-9306-03251dad715b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040362 Mar 03 02:35:14.646523 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 396/782] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:14 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:14.849713 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-040b949e-f299-4231-81ba-61996ce02dfc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:14.850631 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-040b949e-f299-4231-81ba-61996ce02dfc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:14.857011 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-040b949e-f299-4231-81ba-61996ce02dfc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:14.857464 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-040b949e-f299-4231-81ba-61996ce02dfc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:14.858295 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-040b949e-f299-4231-81ba-61996ce02dfc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:14.858734 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-040b949e-f299-4231-81ba-61996ce02dfc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:14.887393 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-040b949e-f299-4231-81ba-61996ce02dfc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041572 Mar 03 02:35:14.887898 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 387/783] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:14 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:14.968226 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0ac0b265-f982-4211-bb2d-0b0dfe6cec58 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:14.968830 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0ac0b265-f982-4211-bb2d-0b0dfe6cec58 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:14.975838 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0ac0b265-f982-4211-bb2d-0b0dfe6cec58 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:14.976294 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0ac0b265-f982-4211-bb2d-0b0dfe6cec58 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:14.977067 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0ac0b265-f982-4211-bb2d-0b0dfe6cec58 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:14.977505 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0ac0b265-f982-4211-bb2d-0b0dfe6cec58 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:15.094050 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-84e89abe-f309-4dfd-86f9-d223ab3503c4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:15.095050 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-84e89abe-f309-4dfd-86f9-d223ab3503c4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:15.100784 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-84e89abe-f309-4dfd-86f9-d223ab3503c4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:15.101234 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-84e89abe-f309-4dfd-86f9-d223ab3503c4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:15.102022 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-84e89abe-f309-4dfd-86f9-d223ab3503c4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:15.102460 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-84e89abe-f309-4dfd-86f9-d223ab3503c4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:15.111145 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0ac0b265-f982-4211-bb2d-0b0dfe6cec58 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:15.119344 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0ac0b265-f982-4211-bb2d-0b0dfe6cec58 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:15.121341 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0ac0b265-f982-4211-bb2d-0b0dfe6cec58 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:15.122686 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0ac0b265-f982-4211-bb2d-0b0dfe6cec58 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.158144 Mar 03 02:35:15.123535 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 397/784] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:14 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:35:15.131470 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-84e89abe-f309-4dfd-86f9-d223ab3503c4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041285 Mar 03 02:35:15.132067 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 388/785] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:15 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:35:15.657677 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5a123a72-9341-4c39-91f4-74e9008d8988 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:15.658620 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5a123a72-9341-4c39-91f4-74e9008d8988 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:15.664629 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5a123a72-9341-4c39-91f4-74e9008d8988 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:15.665120 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5a123a72-9341-4c39-91f4-74e9008d8988 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:15.665907 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5a123a72-9341-4c39-91f4-74e9008d8988 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:15.666349 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5a123a72-9341-4c39-91f4-74e9008d8988 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:15.694729 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5a123a72-9341-4c39-91f4-74e9008d8988 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041057 Mar 03 02:35:15.695278 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 398/786] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:15 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:15.900189 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3ab1c2e3-7e76-47d5-bff1-fab90df64f31 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:15.901038 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3ab1c2e3-7e76-47d5-bff1-fab90df64f31 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:15.907762 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3ab1c2e3-7e76-47d5-bff1-fab90df64f31 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:15.908207 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3ab1c2e3-7e76-47d5-bff1-fab90df64f31 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:15.908972 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3ab1c2e3-7e76-47d5-bff1-fab90df64f31 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:15.909404 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3ab1c2e3-7e76-47d5-bff1-fab90df64f31 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:15.936918 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3ab1c2e3-7e76-47d5-bff1-fab90df64f31 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040709 Mar 03 02:35:15.937456 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 389/787] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:15 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:16.142787 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a105e8c1-1829-4fa9-8285-c1ac13268bd3 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:16.143003 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1a3072a2-3e4b-4442-ad85-1fc08b04c468 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:16.143564 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a105e8c1-1829-4fa9-8285-c1ac13268bd3 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:16.143918 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1a3072a2-3e4b-4442-ad85-1fc08b04c468 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:16.149487 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a105e8c1-1829-4fa9-8285-c1ac13268bd3 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:16.149931 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a105e8c1-1829-4fa9-8285-c1ac13268bd3 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:16.150495 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1a3072a2-3e4b-4442-ad85-1fc08b04c468 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:16.150705 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a105e8c1-1829-4fa9-8285-c1ac13268bd3 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:16.150894 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1a3072a2-3e4b-4442-ad85-1fc08b04c468 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:16.151140 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a105e8c1-1829-4fa9-8285-c1ac13268bd3 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:16.151693 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1a3072a2-3e4b-4442-ad85-1fc08b04c468 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:16.152128 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1a3072a2-3e4b-4442-ad85-1fc08b04c468 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:16.180006 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1a3072a2-3e4b-4442-ad85-1fc08b04c468 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041592 Mar 03 02:35:16.180565 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 399/788] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:16 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:16.282756 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a105e8c1-1829-4fa9-8285-c1ac13268bd3 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:16.290743 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a105e8c1-1829-4fa9-8285-c1ac13268bd3 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:16.292261 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a105e8c1-1829-4fa9-8285-c1ac13268bd3 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:16.293401 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a105e8c1-1829-4fa9-8285-c1ac13268bd3 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.155118 Mar 03 02:35:16.293952 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 390/789] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:16 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:35:16.706461 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-11e4119b-ef8b-43b9-bdaf-f7e9587d45dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:16.707367 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-11e4119b-ef8b-43b9-bdaf-f7e9587d45dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:16.713168 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-11e4119b-ef8b-43b9-bdaf-f7e9587d45dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:16.713612 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-11e4119b-ef8b-43b9-bdaf-f7e9587d45dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:16.714380 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-11e4119b-ef8b-43b9-bdaf-f7e9587d45dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:16.714810 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-11e4119b-ef8b-43b9-bdaf-f7e9587d45dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:16.743160 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-11e4119b-ef8b-43b9-bdaf-f7e9587d45dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040853 Mar 03 02:35:16.743726 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 400/790] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:16 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:16.948309 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-42717da5-07b7-49d1-b1ed-ea8b1dcb4f02 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:16.949210 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-42717da5-07b7-49d1-b1ed-ea8b1dcb4f02 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:16.955972 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-42717da5-07b7-49d1-b1ed-ea8b1dcb4f02 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:16.956418 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-42717da5-07b7-49d1-b1ed-ea8b1dcb4f02 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:16.957236 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-42717da5-07b7-49d1-b1ed-ea8b1dcb4f02 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:16.957619 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-42717da5-07b7-49d1-b1ed-ea8b1dcb4f02 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:16.985175 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-42717da5-07b7-49d1-b1ed-ea8b1dcb4f02 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040803 Mar 03 02:35:16.985709 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 391/791] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:16 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:17.191579 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0a8f36a3-49f2-4c32-8ee1-d301037a2cc9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:17.192549 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0a8f36a3-49f2-4c32-8ee1-d301037a2cc9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:17.198712 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0a8f36a3-49f2-4c32-8ee1-d301037a2cc9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:17.199163 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0a8f36a3-49f2-4c32-8ee1-d301037a2cc9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:17.199980 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0a8f36a3-49f2-4c32-8ee1-d301037a2cc9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:17.200418 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0a8f36a3-49f2-4c32-8ee1-d301037a2cc9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:17.228885 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0a8f36a3-49f2-4c32-8ee1-d301037a2cc9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041172 Mar 03 02:35:17.229364 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 401/792] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:17 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:17.310498 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6aaa7cbb-aa68-4990-b660-416b73d1dea0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:17.311106 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6aaa7cbb-aa68-4990-b660-416b73d1dea0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:17.317452 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6aaa7cbb-aa68-4990-b660-416b73d1dea0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:17.317905 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6aaa7cbb-aa68-4990-b660-416b73d1dea0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:17.318680 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6aaa7cbb-aa68-4990-b660-416b73d1dea0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:17.319116 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6aaa7cbb-aa68-4990-b660-416b73d1dea0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:17.454292 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6aaa7cbb-aa68-4990-b660-416b73d1dea0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:17.462399 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6aaa7cbb-aa68-4990-b660-416b73d1dea0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:17.463913 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6aaa7cbb-aa68-4990-b660-416b73d1dea0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:17.465045 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6aaa7cbb-aa68-4990-b660-416b73d1dea0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.158504 Mar 03 02:35:17.465597 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 392/793] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:17 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:35:17.754629 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3f8cb12c-5198-4857-846a-66f600e59574 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:17.755530 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3f8cb12c-5198-4857-846a-66f600e59574 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:17.761460 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3f8cb12c-5198-4857-846a-66f600e59574 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:17.761904 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3f8cb12c-5198-4857-846a-66f600e59574 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:17.762683 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3f8cb12c-5198-4857-846a-66f600e59574 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:17.763114 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3f8cb12c-5198-4857-846a-66f600e59574 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:17.791315 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3f8cb12c-5198-4857-846a-66f600e59574 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040843 Mar 03 02:35:17.791906 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 402/794] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:17 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:17.996838 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-fc1588c9-05a7-478d-bc05-dce7680e9068 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:17.997764 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-fc1588c9-05a7-478d-bc05-dce7680e9068 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:18.004720 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fc1588c9-05a7-478d-bc05-dce7680e9068 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:18.005112 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fc1588c9-05a7-478d-bc05-dce7680e9068 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:18.005889 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fc1588c9-05a7-478d-bc05-dce7680e9068 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:18.006322 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fc1588c9-05a7-478d-bc05-dce7680e9068 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:18.034551 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-fc1588c9-05a7-478d-bc05-dce7680e9068 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041865 Mar 03 02:35:18.035094 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 393/795] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:17 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:18.240482 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ce6d57bc-b0ad-42e5-b70d-d7bada9df619 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:18.241386 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ce6d57bc-b0ad-42e5-b70d-d7bada9df619 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:18.248044 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ce6d57bc-b0ad-42e5-b70d-d7bada9df619 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:18.248490 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ce6d57bc-b0ad-42e5-b70d-d7bada9df619 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:18.249272 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ce6d57bc-b0ad-42e5-b70d-d7bada9df619 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:18.249708 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ce6d57bc-b0ad-42e5-b70d-d7bada9df619 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:18.277512 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ce6d57bc-b0ad-42e5-b70d-d7bada9df619 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040946 Mar 03 02:35:18.277992 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 403/796] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:18 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:18.482102 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-829e424e-ae4c-4b03-b6b1-f45cf488bd07 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:18.482712 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-829e424e-ae4c-4b03-b6b1-f45cf488bd07 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:18.489184 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-829e424e-ae4c-4b03-b6b1-f45cf488bd07 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:18.489663 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-829e424e-ae4c-4b03-b6b1-f45cf488bd07 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:18.490444 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-829e424e-ae4c-4b03-b6b1-f45cf488bd07 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:18.490887 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-829e424e-ae4c-4b03-b6b1-f45cf488bd07 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:18.621833 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-829e424e-ae4c-4b03-b6b1-f45cf488bd07 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:18.631487 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-829e424e-ae4c-4b03-b6b1-f45cf488bd07 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:18.633006 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-829e424e-ae4c-4b03-b6b1-f45cf488bd07 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:18.634120 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-829e424e-ae4c-4b03-b6b1-f45cf488bd07 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.155908 Mar 03 02:35:18.634675 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 394/797] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:18 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:35:18.802532 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c7d0411d-6b05-4e22-9a51-e532b95f5b32 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:18.803437 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c7d0411d-6b05-4e22-9a51-e532b95f5b32 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:18.809698 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c7d0411d-6b05-4e22-9a51-e532b95f5b32 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:18.810150 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c7d0411d-6b05-4e22-9a51-e532b95f5b32 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:18.810927 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c7d0411d-6b05-4e22-9a51-e532b95f5b32 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:18.811359 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c7d0411d-6b05-4e22-9a51-e532b95f5b32 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:18.839230 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c7d0411d-6b05-4e22-9a51-e532b95f5b32 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041299 Mar 03 02:35:18.839809 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 404/798] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:18 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:19.045963 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6eb0eb4e-24cb-4e1a-9704-db49ed4fa277 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:19.048176 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6eb0eb4e-24cb-4e1a-9704-db49ed4fa277 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:19.054660 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6eb0eb4e-24cb-4e1a-9704-db49ed4fa277 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:19.055112 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6eb0eb4e-24cb-4e1a-9704-db49ed4fa277 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:19.055924 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6eb0eb4e-24cb-4e1a-9704-db49ed4fa277 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:19.056362 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6eb0eb4e-24cb-4e1a-9704-db49ed4fa277 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:19.084338 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6eb0eb4e-24cb-4e1a-9704-db49ed4fa277 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042336 Mar 03 02:35:19.084887 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 395/799] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:19 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:19.289023 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-517b1c63-39b8-4167-bb0f-816b1bcb9b32 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:19.289926 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-517b1c63-39b8-4167-bb0f-816b1bcb9b32 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:19.296076 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-517b1c63-39b8-4167-bb0f-816b1bcb9b32 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:19.296518 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-517b1c63-39b8-4167-bb0f-816b1bcb9b32 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:19.297348 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-517b1c63-39b8-4167-bb0f-816b1bcb9b32 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:19.297784 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-517b1c63-39b8-4167-bb0f-816b1bcb9b32 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:19.324545 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-517b1c63-39b8-4167-bb0f-816b1bcb9b32 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039386 Mar 03 02:35:19.325098 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 405/800] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:19 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:19.652308 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e5e55a5c-2c93-4ef3-b4a9-8650cbac82ff tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:19.652911 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e5e55a5c-2c93-4ef3-b4a9-8650cbac82ff tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:19.658728 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e5e55a5c-2c93-4ef3-b4a9-8650cbac82ff tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:19.659186 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e5e55a5c-2c93-4ef3-b4a9-8650cbac82ff tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:19.659992 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e5e55a5c-2c93-4ef3-b4a9-8650cbac82ff tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:19.660434 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e5e55a5c-2c93-4ef3-b4a9-8650cbac82ff tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:19.791427 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e5e55a5c-2c93-4ef3-b4a9-8650cbac82ff tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:19.800071 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e5e55a5c-2c93-4ef3-b4a9-8650cbac82ff tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:19.801580 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e5e55a5c-2c93-4ef3-b4a9-8650cbac82ff tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:19.803109 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e5e55a5c-2c93-4ef3-b4a9-8650cbac82ff tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.154597 Mar 03 02:35:19.803723 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 396/801] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:19 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:35:19.850301 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a9ad9fde-c81f-4620-a2ba-71d85ff5aa83 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:19.851213 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a9ad9fde-c81f-4620-a2ba-71d85ff5aa83 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:19.856966 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a9ad9fde-c81f-4620-a2ba-71d85ff5aa83 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:19.857420 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a9ad9fde-c81f-4620-a2ba-71d85ff5aa83 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:19.858208 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a9ad9fde-c81f-4620-a2ba-71d85ff5aa83 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:19.858651 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a9ad9fde-c81f-4620-a2ba-71d85ff5aa83 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:19.887729 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a9ad9fde-c81f-4620-a2ba-71d85ff5aa83 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041322 Mar 03 02:35:19.888281 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 406/802] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:19 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:35:20.096645 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-dd1ce5c0-3f8f-4fd4-a1e1-91424454ef26 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:20.097555 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-dd1ce5c0-3f8f-4fd4-a1e1-91424454ef26 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:20.103721 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dd1ce5c0-3f8f-4fd4-a1e1-91424454ef26 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:20.104168 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dd1ce5c0-3f8f-4fd4-a1e1-91424454ef26 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:20.104944 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dd1ce5c0-3f8f-4fd4-a1e1-91424454ef26 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:20.105380 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dd1ce5c0-3f8f-4fd4-a1e1-91424454ef26 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:20.134739 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-dd1ce5c0-3f8f-4fd4-a1e1-91424454ef26 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042482 Mar 03 02:35:20.135277 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 397/803] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:20 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:20.335076 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e54d7617-47d0-4da5-9337-93b0da70c82c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:20.336013 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e54d7617-47d0-4da5-9337-93b0da70c82c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:20.342567 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e54d7617-47d0-4da5-9337-93b0da70c82c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:20.343011 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e54d7617-47d0-4da5-9337-93b0da70c82c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:20.344679 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e54d7617-47d0-4da5-9337-93b0da70c82c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:20.345114 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e54d7617-47d0-4da5-9337-93b0da70c82c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:20.372526 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e54d7617-47d0-4da5-9337-93b0da70c82c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041399 Mar 03 02:35:20.373064 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 407/804] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:20 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:20.821758 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f777e844-b9d7-4150-a535-9c08504eb8c1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:20.822275 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f777e844-b9d7-4150-a535-9c08504eb8c1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:20.828903 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f777e844-b9d7-4150-a535-9c08504eb8c1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:20.829315 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f777e844-b9d7-4150-a535-9c08504eb8c1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:20.830112 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f777e844-b9d7-4150-a535-9c08504eb8c1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:20.830563 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f777e844-b9d7-4150-a535-9c08504eb8c1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:20.899525 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d262558d-b3c2-4396-b190-71deba4c67c8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:20.900451 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d262558d-b3c2-4396-b190-71deba4c67c8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:20.906064 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d262558d-b3c2-4396-b190-71deba4c67c8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:20.907181 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d262558d-b3c2-4396-b190-71deba4c67c8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:20.907994 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d262558d-b3c2-4396-b190-71deba4c67c8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:20.908421 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d262558d-b3c2-4396-b190-71deba4c67c8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:20.936484 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d262558d-b3c2-4396-b190-71deba4c67c8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040950 Mar 03 02:35:20.937043 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 408/805] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:20 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:35:20.960776 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f777e844-b9d7-4150-a535-9c08504eb8c1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:20.968864 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f777e844-b9d7-4150-a535-9c08504eb8c1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:20.971151 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f777e844-b9d7-4150-a535-9c08504eb8c1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:20.972330 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f777e844-b9d7-4150-a535-9c08504eb8c1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.154517 Mar 03 02:35:20.972892 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 398/806] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:20 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:35:21.147127 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ce2cb041-4146-42e1-b09e-ec54af6021c7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:21.148069 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ce2cb041-4146-42e1-b09e-ec54af6021c7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:21.153974 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ce2cb041-4146-42e1-b09e-ec54af6021c7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:21.154423 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ce2cb041-4146-42e1-b09e-ec54af6021c7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:21.155198 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ce2cb041-4146-42e1-b09e-ec54af6021c7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:21.155653 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ce2cb041-4146-42e1-b09e-ec54af6021c7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:21.183341 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ce2cb041-4146-42e1-b09e-ec54af6021c7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040285 Mar 03 02:35:21.183913 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 409/807] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:21 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:21.383880 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1cb38554-b1f2-4e2d-ad5a-2d1fb379cc19 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:21.384825 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1cb38554-b1f2-4e2d-ad5a-2d1fb379cc19 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:21.391665 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1cb38554-b1f2-4e2d-ad5a-2d1fb379cc19 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:21.392126 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1cb38554-b1f2-4e2d-ad5a-2d1fb379cc19 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:21.392900 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1cb38554-b1f2-4e2d-ad5a-2d1fb379cc19 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:21.393342 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1cb38554-b1f2-4e2d-ad5a-2d1fb379cc19 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:21.420904 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1cb38554-b1f2-4e2d-ad5a-2d1fb379cc19 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040907 Mar 03 02:35:21.421388 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 399/808] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:21 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:21.948346 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b989c575-2b4b-46bb-abe9-0d7c41ac1dd1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:21.949262 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b989c575-2b4b-46bb-abe9-0d7c41ac1dd1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:21.956658 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b989c575-2b4b-46bb-abe9-0d7c41ac1dd1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:21.957111 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b989c575-2b4b-46bb-abe9-0d7c41ac1dd1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:21.957895 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b989c575-2b4b-46bb-abe9-0d7c41ac1dd1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:21.958329 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b989c575-2b4b-46bb-abe9-0d7c41ac1dd1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:21.986033 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b989c575-2b4b-46bb-abe9-0d7c41ac1dd1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041662 Mar 03 02:35:21.986747 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 410/809] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:21 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:21.990425 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6325ea30-7b46-43e7-b326-6d5f2f16f457 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:21.991029 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6325ea30-7b46-43e7-b326-6d5f2f16f457 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:21.997066 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6325ea30-7b46-43e7-b326-6d5f2f16f457 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:21.997516 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6325ea30-7b46-43e7-b326-6d5f2f16f457 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:21.998331 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6325ea30-7b46-43e7-b326-6d5f2f16f457 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:21.998770 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6325ea30-7b46-43e7-b326-6d5f2f16f457 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:22.132109 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6325ea30-7b46-43e7-b326-6d5f2f16f457 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:22.140285 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6325ea30-7b46-43e7-b326-6d5f2f16f457 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:22.142037 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6325ea30-7b46-43e7-b326-6d5f2f16f457 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:22.143187 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6325ea30-7b46-43e7-b326-6d5f2f16f457 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.156826 Mar 03 02:35:22.143783 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 400/810] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:21 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:35:22.194865 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-10cc372a-90ed-4007-8317-fb532858065e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:22.195815 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-10cc372a-90ed-4007-8317-fb532858065e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:22.201568 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-10cc372a-90ed-4007-8317-fb532858065e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:22.201951 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-10cc372a-90ed-4007-8317-fb532858065e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:22.202717 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-10cc372a-90ed-4007-8317-fb532858065e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:22.203156 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-10cc372a-90ed-4007-8317-fb532858065e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:22.229791 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-10cc372a-90ed-4007-8317-fb532858065e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038803 Mar 03 02:35:22.230328 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 411/811] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:22 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:22.432395 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3de5e9a7-f201-40cd-9df9-6b822dfe10cd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:22.433303 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3de5e9a7-f201-40cd-9df9-6b822dfe10cd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:22.440254 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3de5e9a7-f201-40cd-9df9-6b822dfe10cd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:22.440732 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3de5e9a7-f201-40cd-9df9-6b822dfe10cd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:22.441509 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3de5e9a7-f201-40cd-9df9-6b822dfe10cd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:22.441979 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3de5e9a7-f201-40cd-9df9-6b822dfe10cd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:22.470133 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3de5e9a7-f201-40cd-9df9-6b822dfe10cd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040640 Mar 03 02:35:22.470627 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 401/812] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:22 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:22.997479 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a39900e2-8d20-4801-bf1c-2d9f00d16b84 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:22.998398 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a39900e2-8d20-4801-bf1c-2d9f00d16b84 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:23.004727 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a39900e2-8d20-4801-bf1c-2d9f00d16b84 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:23.005182 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a39900e2-8d20-4801-bf1c-2d9f00d16b84 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:23.005975 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a39900e2-8d20-4801-bf1c-2d9f00d16b84 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:23.006420 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a39900e2-8d20-4801-bf1c-2d9f00d16b84 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:23.034916 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a39900e2-8d20-4801-bf1c-2d9f00d16b84 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041670 Mar 03 02:35:23.035468 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 412/813] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:22 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:23.162522 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-760391ea-0cbc-417a-a9dd-4a2357ce4fc9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:23.163214 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-760391ea-0cbc-417a-a9dd-4a2357ce4fc9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:23.169456 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-760391ea-0cbc-417a-a9dd-4a2357ce4fc9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:23.169912 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-760391ea-0cbc-417a-a9dd-4a2357ce4fc9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:23.170693 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-760391ea-0cbc-417a-a9dd-4a2357ce4fc9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:23.171132 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-760391ea-0cbc-417a-a9dd-4a2357ce4fc9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:23.241467 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-285f6431-5666-442e-b77e-7d3948eba4de tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:23.242489 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-285f6431-5666-442e-b77e-7d3948eba4de tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:23.248559 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-285f6431-5666-442e-b77e-7d3948eba4de tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:23.248981 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-285f6431-5666-442e-b77e-7d3948eba4de tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:23.249812 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-285f6431-5666-442e-b77e-7d3948eba4de tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:23.251033 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-285f6431-5666-442e-b77e-7d3948eba4de tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:23.280142 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-285f6431-5666-442e-b77e-7d3948eba4de tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042669 Mar 03 02:35:23.280715 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 413/814] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:23 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:35:23.304537 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-760391ea-0cbc-417a-a9dd-4a2357ce4fc9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:23.313507 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-760391ea-0cbc-417a-a9dd-4a2357ce4fc9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:23.315157 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-760391ea-0cbc-417a-a9dd-4a2357ce4fc9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:23.316350 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-760391ea-0cbc-417a-a9dd-4a2357ce4fc9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.157800 Mar 03 02:35:23.316905 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 402/815] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:23 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:35:23.481701 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e273dc7a-f094-400d-949c-c447520d417c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:23.482618 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e273dc7a-f094-400d-949c-c447520d417c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:23.489005 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e273dc7a-f094-400d-949c-c447520d417c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:23.489456 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e273dc7a-f094-400d-949c-c447520d417c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:23.490235 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e273dc7a-f094-400d-949c-c447520d417c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:23.490678 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e273dc7a-f094-400d-949c-c447520d417c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:23.519402 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e273dc7a-f094-400d-949c-c447520d417c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041590 Mar 03 02:35:23.519927 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 414/816] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:23 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:24.048207 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b918ccef-2e80-4fec-aac5-8e49f1545eda tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:24.049145 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b918ccef-2e80-4fec-aac5-8e49f1545eda tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:24.055343 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b918ccef-2e80-4fec-aac5-8e49f1545eda tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:24.055904 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b918ccef-2e80-4fec-aac5-8e49f1545eda tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:24.056741 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b918ccef-2e80-4fec-aac5-8e49f1545eda tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:24.057186 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b918ccef-2e80-4fec-aac5-8e49f1545eda tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:24.086948 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b918ccef-2e80-4fec-aac5-8e49f1545eda tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044305 Mar 03 02:35:24.087498 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 403/817] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:24 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:24.291514 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-94daa8de-3ac7-4609-b3aa-62a755bddb60 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:24.292446 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-94daa8de-3ac7-4609-b3aa-62a755bddb60 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:24.298691 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-94daa8de-3ac7-4609-b3aa-62a755bddb60 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:24.299087 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-94daa8de-3ac7-4609-b3aa-62a755bddb60 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:24.299900 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-94daa8de-3ac7-4609-b3aa-62a755bddb60 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:24.300337 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-94daa8de-3ac7-4609-b3aa-62a755bddb60 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:24.328366 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-94daa8de-3ac7-4609-b3aa-62a755bddb60 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040641 Mar 03 02:35:24.329375 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 415/818] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:24 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:24.336644 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1728b925-312b-4903-be23-f2b5f39399be tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:24.337254 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1728b925-312b-4903-be23-f2b5f39399be tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:24.343426 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1728b925-312b-4903-be23-f2b5f39399be tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:24.344073 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1728b925-312b-4903-be23-f2b5f39399be tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:24.344899 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1728b925-312b-4903-be23-f2b5f39399be tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:24.345341 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1728b925-312b-4903-be23-f2b5f39399be tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:24.476731 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1728b925-312b-4903-be23-f2b5f39399be tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:24.485543 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1728b925-312b-4903-be23-f2b5f39399be tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:24.487026 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1728b925-312b-4903-be23-f2b5f39399be tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:24.488232 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1728b925-312b-4903-be23-f2b5f39399be tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.155408 Mar 03 02:35:24.488785 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 404/819] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:24 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:35:24.530652 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3e4393f1-33fe-43be-9a84-9f84c7c3ac6e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:24.531805 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3e4393f1-33fe-43be-9a84-9f84c7c3ac6e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:24.537670 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3e4393f1-33fe-43be-9a84-9f84c7c3ac6e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:24.538125 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3e4393f1-33fe-43be-9a84-9f84c7c3ac6e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:24.538964 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3e4393f1-33fe-43be-9a84-9f84c7c3ac6e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:24.539403 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3e4393f1-33fe-43be-9a84-9f84c7c3ac6e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:24.567526 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3e4393f1-33fe-43be-9a84-9f84c7c3ac6e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040734 Mar 03 02:35:24.568184 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 416/820] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:24 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:25.100147 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2d0ad951-5fc1-46ce-ad2a-a7ad854b212d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:25.101397 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2d0ad951-5fc1-46ce-ad2a-a7ad854b212d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:25.107918 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2d0ad951-5fc1-46ce-ad2a-a7ad854b212d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:25.108373 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2d0ad951-5fc1-46ce-ad2a-a7ad854b212d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:25.109158 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2d0ad951-5fc1-46ce-ad2a-a7ad854b212d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:25.110353 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2d0ad951-5fc1-46ce-ad2a-a7ad854b212d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:25.139776 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2d0ad951-5fc1-46ce-ad2a-a7ad854b212d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044800 Mar 03 02:35:25.140337 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 405/821] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:25 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:25.340624 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7fe436c4-abe9-4b92-b407-266534127bcc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:25.341549 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7fe436c4-abe9-4b92-b407-266534127bcc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:25.348507 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7fe436c4-abe9-4b92-b407-266534127bcc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:25.348949 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7fe436c4-abe9-4b92-b407-266534127bcc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:25.349718 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7fe436c4-abe9-4b92-b407-266534127bcc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:25.350153 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7fe436c4-abe9-4b92-b407-266534127bcc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:25.377697 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7fe436c4-abe9-4b92-b407-266534127bcc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040998 Mar 03 02:35:25.378245 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 417/822] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:25 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:25.511843 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e87c9df2-eb12-47c9-a3c8-41b0e0502fb2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:25.512514 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e87c9df2-eb12-47c9-a3c8-41b0e0502fb2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:25.521395 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e87c9df2-eb12-47c9-a3c8-41b0e0502fb2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:25.521915 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e87c9df2-eb12-47c9-a3c8-41b0e0502fb2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:25.522780 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e87c9df2-eb12-47c9-a3c8-41b0e0502fb2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:25.523223 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e87c9df2-eb12-47c9-a3c8-41b0e0502fb2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:25.579283 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-913ffb5a-5b67-4309-bcf1-f2685b333161 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:25.580381 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-913ffb5a-5b67-4309-bcf1-f2685b333161 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:25.586207 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-913ffb5a-5b67-4309-bcf1-f2685b333161 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:25.586662 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-913ffb5a-5b67-4309-bcf1-f2685b333161 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:25.587536 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-913ffb5a-5b67-4309-bcf1-f2685b333161 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:25.588022 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-913ffb5a-5b67-4309-bcf1-f2685b333161 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:25.618262 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-913ffb5a-5b67-4309-bcf1-f2685b333161 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043695 Mar 03 02:35:25.618831 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 418/823] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:25 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:35:25.662738 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e87c9df2-eb12-47c9-a3c8-41b0e0502fb2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:25.670823 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e87c9df2-eb12-47c9-a3c8-41b0e0502fb2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:25.672388 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e87c9df2-eb12-47c9-a3c8-41b0e0502fb2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:25.673699 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e87c9df2-eb12-47c9-a3c8-41b0e0502fb2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.167412 Mar 03 02:35:25.674259 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 406/824] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:25 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:35:26.153028 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4c894bc6-d9dc-4e98-b75b-bb8e27537afb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:26.153938 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4c894bc6-d9dc-4e98-b75b-bb8e27537afb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:26.159754 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4c894bc6-d9dc-4e98-b75b-bb8e27537afb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:26.160205 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4c894bc6-d9dc-4e98-b75b-bb8e27537afb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:26.160981 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4c894bc6-d9dc-4e98-b75b-bb8e27537afb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:26.161417 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4c894bc6-d9dc-4e98-b75b-bb8e27537afb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:26.193739 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4c894bc6-d9dc-4e98-b75b-bb8e27537afb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044891 Mar 03 02:35:26.194294 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 419/825] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:26 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:26.389280 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-312998a0-fb3c-4747-8ff1-06fb8721aba2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:26.390199 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-312998a0-fb3c-4747-8ff1-06fb8721aba2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:26.396027 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-312998a0-fb3c-4747-8ff1-06fb8721aba2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:26.396477 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-312998a0-fb3c-4747-8ff1-06fb8721aba2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:26.397261 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-312998a0-fb3c-4747-8ff1-06fb8721aba2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:26.397702 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-312998a0-fb3c-4747-8ff1-06fb8721aba2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:26.426387 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-312998a0-fb3c-4747-8ff1-06fb8721aba2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041102 Mar 03 02:35:26.426939 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 407/826] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:26 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:26.630032 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-cb4a7016-0b85-4f4e-80f1-baf2642415ca tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:26.630949 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-cb4a7016-0b85-4f4e-80f1-baf2642415ca tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:26.637698 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cb4a7016-0b85-4f4e-80f1-baf2642415ca tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:26.638151 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cb4a7016-0b85-4f4e-80f1-baf2642415ca tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:26.638931 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cb4a7016-0b85-4f4e-80f1-baf2642415ca tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:26.639427 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cb4a7016-0b85-4f4e-80f1-baf2642415ca tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:26.668079 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-cb4a7016-0b85-4f4e-80f1-baf2642415ca tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042089 Mar 03 02:35:26.668628 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 420/827] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:26 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:26.691291 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6d0e6644-71eb-47cd-b8e6-00afc725be26 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:26.691924 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6d0e6644-71eb-47cd-b8e6-00afc725be26 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:26.697812 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6d0e6644-71eb-47cd-b8e6-00afc725be26 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:26.698254 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6d0e6644-71eb-47cd-b8e6-00afc725be26 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:26.699023 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6d0e6644-71eb-47cd-b8e6-00afc725be26 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:26.699453 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6d0e6644-71eb-47cd-b8e6-00afc725be26 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:26.831054 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6d0e6644-71eb-47cd-b8e6-00afc725be26 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:26.839186 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6d0e6644-71eb-47cd-b8e6-00afc725be26 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:26.840753 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6d0e6644-71eb-47cd-b8e6-00afc725be26 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:26.841921 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6d0e6644-71eb-47cd-b8e6-00afc725be26 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.154438 Mar 03 02:35:26.842477 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 408/828] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:26 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:35:27.206967 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-95d0445e-503a-4930-aeee-d286ae383c30 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:27.208598 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-95d0445e-503a-4930-aeee-d286ae383c30 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:27.215782 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-95d0445e-503a-4930-aeee-d286ae383c30 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:27.216230 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-95d0445e-503a-4930-aeee-d286ae383c30 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:27.217005 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-95d0445e-503a-4930-aeee-d286ae383c30 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:27.217438 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-95d0445e-503a-4930-aeee-d286ae383c30 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:27.244889 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-95d0445e-503a-4930-aeee-d286ae383c30 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042902 Mar 03 02:35:27.245442 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 421/829] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:27 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:27.437549 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-558b0bee-d388-4c5b-8573-e27b7343c365 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:27.439204 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-558b0bee-d388-4c5b-8573-e27b7343c365 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:27.444993 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-558b0bee-d388-4c5b-8573-e27b7343c365 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:27.445437 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-558b0bee-d388-4c5b-8573-e27b7343c365 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:27.446207 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-558b0bee-d388-4c5b-8573-e27b7343c365 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:27.446640 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-558b0bee-d388-4c5b-8573-e27b7343c365 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:27.473316 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-558b0bee-d388-4c5b-8573-e27b7343c365 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039724 Mar 03 02:35:27.473862 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 409/830] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:27 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:27.679530 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c98d1c5d-b9d2-434e-a7f9-01559cdb5f5d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:27.680466 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c98d1c5d-b9d2-434e-a7f9-01559cdb5f5d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:27.686586 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c98d1c5d-b9d2-434e-a7f9-01559cdb5f5d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:27.687116 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c98d1c5d-b9d2-434e-a7f9-01559cdb5f5d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:27.688556 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c98d1c5d-b9d2-434e-a7f9-01559cdb5f5d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:27.688987 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c98d1c5d-b9d2-434e-a7f9-01559cdb5f5d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:27.715771 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c98d1c5d-b9d2-434e-a7f9-01559cdb5f5d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040073 Mar 03 02:35:27.716312 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 422/831] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:27 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:27.861144 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2254998c-590a-48d6-89d8-98df399e1c70 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:27.861789 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2254998c-590a-48d6-89d8-98df399e1c70 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:27.869926 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2254998c-590a-48d6-89d8-98df399e1c70 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:27.870558 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2254998c-590a-48d6-89d8-98df399e1c70 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:27.871544 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2254998c-590a-48d6-89d8-98df399e1c70 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:27.872347 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2254998c-590a-48d6-89d8-98df399e1c70 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:28.011928 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2254998c-590a-48d6-89d8-98df399e1c70 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:28.020584 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2254998c-590a-48d6-89d8-98df399e1c70 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:28.022087 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2254998c-590a-48d6-89d8-98df399e1c70 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:28.023227 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2254998c-590a-48d6-89d8-98df399e1c70 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.166837 Mar 03 02:35:28.023956 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 410/832] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:27 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:35:28.257502 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5be6fc28-315d-4d21-b86b-18f3b2f1da28 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:28.258324 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5be6fc28-315d-4d21-b86b-18f3b2f1da28 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:28.264552 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5be6fc28-315d-4d21-b86b-18f3b2f1da28 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:28.264945 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5be6fc28-315d-4d21-b86b-18f3b2f1da28 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:28.266356 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5be6fc28-315d-4d21-b86b-18f3b2f1da28 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:28.266864 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5be6fc28-315d-4d21-b86b-18f3b2f1da28 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:28.294291 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5be6fc28-315d-4d21-b86b-18f3b2f1da28 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040823 Mar 03 02:35:28.294828 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 423/833] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:28 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:28.484737 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1ac1bb40-8282-425d-a45f-ec6c437baa6c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:28.485683 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1ac1bb40-8282-425d-a45f-ec6c437baa6c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:28.493504 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1ac1bb40-8282-425d-a45f-ec6c437baa6c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:28.493982 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1ac1bb40-8282-425d-a45f-ec6c437baa6c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:28.495061 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1ac1bb40-8282-425d-a45f-ec6c437baa6c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:28.495502 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1ac1bb40-8282-425d-a45f-ec6c437baa6c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:28.526870 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1ac1bb40-8282-425d-a45f-ec6c437baa6c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045988 Mar 03 02:35:28.527344 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 411/834] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:28 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:28.727885 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-bfb912c1-5d24-4317-b1f5-4ae8cd42437f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:28.728798 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-bfb912c1-5d24-4317-b1f5-4ae8cd42437f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:28.736139 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bfb912c1-5d24-4317-b1f5-4ae8cd42437f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:28.736614 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bfb912c1-5d24-4317-b1f5-4ae8cd42437f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:28.737408 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bfb912c1-5d24-4317-b1f5-4ae8cd42437f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:28.737849 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bfb912c1-5d24-4317-b1f5-4ae8cd42437f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:28.767568 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-bfb912c1-5d24-4317-b1f5-4ae8cd42437f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043736 Mar 03 02:35:28.768150 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 424/835] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:28 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:29.042156 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f3dbbdfd-43c7-4ed5-b782-db9c3fc67581 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:29.042754 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f3dbbdfd-43c7-4ed5-b782-db9c3fc67581 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:29.049504 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f3dbbdfd-43c7-4ed5-b782-db9c3fc67581 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:29.049949 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f3dbbdfd-43c7-4ed5-b782-db9c3fc67581 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:29.050724 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f3dbbdfd-43c7-4ed5-b782-db9c3fc67581 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:29.051153 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f3dbbdfd-43c7-4ed5-b782-db9c3fc67581 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:29.180215 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f3dbbdfd-43c7-4ed5-b782-db9c3fc67581 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:29.189513 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f3dbbdfd-43c7-4ed5-b782-db9c3fc67581 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:29.191018 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f3dbbdfd-43c7-4ed5-b782-db9c3fc67581 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:29.192199 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f3dbbdfd-43c7-4ed5-b782-db9c3fc67581 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.154003 Mar 03 02:35:29.192758 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 412/836] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:29 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:35:29.305945 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-37d3bf0a-06ee-4834-a39c-bdbc5caddcb1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:29.306787 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-37d3bf0a-06ee-4834-a39c-bdbc5caddcb1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:29.313230 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-37d3bf0a-06ee-4834-a39c-bdbc5caddcb1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:29.313363 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-37d3bf0a-06ee-4834-a39c-bdbc5caddcb1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:29.314083 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-37d3bf0a-06ee-4834-a39c-bdbc5caddcb1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:29.314514 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-37d3bf0a-06ee-4834-a39c-bdbc5caddcb1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:29.341834 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-37d3bf0a-06ee-4834-a39c-bdbc5caddcb1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039891 Mar 03 02:35:29.342378 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 425/837] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:29 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:29.538596 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0579504d-9e39-402f-93f4-914b4dab5fa7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:29.539562 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0579504d-9e39-402f-93f4-914b4dab5fa7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:29.545496 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0579504d-9e39-402f-93f4-914b4dab5fa7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:29.545944 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0579504d-9e39-402f-93f4-914b4dab5fa7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:29.546732 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0579504d-9e39-402f-93f4-914b4dab5fa7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:29.548322 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0579504d-9e39-402f-93f4-914b4dab5fa7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:29.575502 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0579504d-9e39-402f-93f4-914b4dab5fa7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040839 Mar 03 02:35:29.576074 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 413/838] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:29 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:29.778247 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-83287a27-e391-49ec-b999-380570009574 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:29.779160 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-83287a27-e391-49ec-b999-380570009574 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:29.786141 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-83287a27-e391-49ec-b999-380570009574 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:29.786596 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-83287a27-e391-49ec-b999-380570009574 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:29.787382 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-83287a27-e391-49ec-b999-380570009574 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:29.787867 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-83287a27-e391-49ec-b999-380570009574 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:29.815421 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-83287a27-e391-49ec-b999-380570009574 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041050 Mar 03 02:35:29.816002 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 426/839] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:29 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:30.212244 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-42fc6b04-74cb-47df-be8b-e7550cb5a9bb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:30.212845 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-42fc6b04-74cb-47df-be8b-e7550cb5a9bb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:30.218988 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-42fc6b04-74cb-47df-be8b-e7550cb5a9bb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:30.219446 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-42fc6b04-74cb-47df-be8b-e7550cb5a9bb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:30.220255 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-42fc6b04-74cb-47df-be8b-e7550cb5a9bb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:30.220694 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-42fc6b04-74cb-47df-be8b-e7550cb5a9bb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:30.354000 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1ef0e419-f0f6-44e0-b15c-6f7fe49476a2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:30.354912 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1ef0e419-f0f6-44e0-b15c-6f7fe49476a2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:30.355837 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-42fc6b04-74cb-47df-be8b-e7550cb5a9bb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:30.361833 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1ef0e419-f0f6-44e0-b15c-6f7fe49476a2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:30.362278 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1ef0e419-f0f6-44e0-b15c-6f7fe49476a2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:30.363063 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1ef0e419-f0f6-44e0-b15c-6f7fe49476a2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:30.363497 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1ef0e419-f0f6-44e0-b15c-6f7fe49476a2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:30.364498 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-42fc6b04-74cb-47df-be8b-e7550cb5a9bb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:30.365979 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-42fc6b04-74cb-47df-be8b-e7550cb5a9bb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:30.367119 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-42fc6b04-74cb-47df-be8b-e7550cb5a9bb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.160160 Mar 03 02:35:30.367694 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 414/840] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:30 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:35:30.391830 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1ef0e419-f0f6-44e0-b15c-6f7fe49476a2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041824 Mar 03 02:35:30.392377 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 427/841] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:30 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:35:30.587401 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-403c6ba7-379e-4865-aec1-984692a7e17f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:30.588338 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-403c6ba7-379e-4865-aec1-984692a7e17f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:30.594759 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-403c6ba7-379e-4865-aec1-984692a7e17f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:30.595299 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-403c6ba7-379e-4865-aec1-984692a7e17f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:30.596188 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-403c6ba7-379e-4865-aec1-984692a7e17f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:30.596627 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-403c6ba7-379e-4865-aec1-984692a7e17f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:30.624720 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-403c6ba7-379e-4865-aec1-984692a7e17f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041297 Mar 03 02:35:30.625387 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 415/842] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:30 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:30.828020 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f50e5501-6248-4e77-82f9-de6e55920af1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:30.829696 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f50e5501-6248-4e77-82f9-de6e55920af1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:30.836294 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f50e5501-6248-4e77-82f9-de6e55920af1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:30.836556 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f50e5501-6248-4e77-82f9-de6e55920af1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:30.837330 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f50e5501-6248-4e77-82f9-de6e55920af1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:30.837812 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f50e5501-6248-4e77-82f9-de6e55920af1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:30.864754 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f50e5501-6248-4e77-82f9-de6e55920af1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040636 Mar 03 02:35:30.865294 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 428/843] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:30 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:31.385381 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0721e328-5d0f-43d4-b4aa-c625d8613ebf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:31.385980 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0721e328-5d0f-43d4-b4aa-c625d8613ebf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:31.393176 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0721e328-5d0f-43d4-b4aa-c625d8613ebf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:31.393627 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0721e328-5d0f-43d4-b4aa-c625d8613ebf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:31.394539 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0721e328-5d0f-43d4-b4aa-c625d8613ebf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:31.395130 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0721e328-5d0f-43d4-b4aa-c625d8613ebf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:31.402565 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7d3f3ec8-bb10-476d-89f7-2f0d208a74be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:31.403480 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7d3f3ec8-bb10-476d-89f7-2f0d208a74be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:31.410179 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7d3f3ec8-bb10-476d-89f7-2f0d208a74be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:31.410732 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7d3f3ec8-bb10-476d-89f7-2f0d208a74be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:31.412272 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7d3f3ec8-bb10-476d-89f7-2f0d208a74be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:31.413068 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7d3f3ec8-bb10-476d-89f7-2f0d208a74be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:31.448239 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7d3f3ec8-bb10-476d-89f7-2f0d208a74be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049732 Mar 03 02:35:31.448808 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 429/844] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:31 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:35:31.538471 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0721e328-5d0f-43d4-b4aa-c625d8613ebf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:31.546694 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0721e328-5d0f-43d4-b4aa-c625d8613ebf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:31.548878 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0721e328-5d0f-43d4-b4aa-c625d8613ebf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:31.550037 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0721e328-5d0f-43d4-b4aa-c625d8613ebf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.168532 Mar 03 02:35:31.550595 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 416/845] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:31 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:35:31.636343 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-397851ac-3e70-42bb-971f-6e5c75ceeba2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:31.637280 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-397851ac-3e70-42bb-971f-6e5c75ceeba2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:31.646437 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-397851ac-3e70-42bb-971f-6e5c75ceeba2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:31.647002 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-397851ac-3e70-42bb-971f-6e5c75ceeba2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:31.647873 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-397851ac-3e70-42bb-971f-6e5c75ceeba2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:31.648318 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-397851ac-3e70-42bb-971f-6e5c75ceeba2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:31.679805 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-397851ac-3e70-42bb-971f-6e5c75ceeba2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047328 Mar 03 02:35:31.680359 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 430/846] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:31 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:31.877085 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-fc5ed817-3bb3-4915-843d-a4b6326724b5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:31.877986 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-fc5ed817-3bb3-4915-843d-a4b6326724b5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:31.883952 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fc5ed817-3bb3-4915-843d-a4b6326724b5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:31.884399 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fc5ed817-3bb3-4915-843d-a4b6326724b5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:31.885173 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fc5ed817-3bb3-4915-843d-a4b6326724b5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:31.885601 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fc5ed817-3bb3-4915-843d-a4b6326724b5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:31.912358 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-fc5ed817-3bb3-4915-843d-a4b6326724b5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039892 Mar 03 02:35:31.912897 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 417/847] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:31 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:32.460139 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1f5c040b-65a2-45f0-8ce1-7d5c7115d51f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:32.461051 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1f5c040b-65a2-45f0-8ce1-7d5c7115d51f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:32.467222 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1f5c040b-65a2-45f0-8ce1-7d5c7115d51f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:32.467701 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1f5c040b-65a2-45f0-8ce1-7d5c7115d51f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:32.468478 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1f5c040b-65a2-45f0-8ce1-7d5c7115d51f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:32.469571 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1f5c040b-65a2-45f0-8ce1-7d5c7115d51f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:32.568215 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c0ed2939-bb21-442f-8d2e-f808a20d1652 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:32.568825 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c0ed2939-bb21-442f-8d2e-f808a20d1652 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:32.575458 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c0ed2939-bb21-442f-8d2e-f808a20d1652 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:32.575960 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c0ed2939-bb21-442f-8d2e-f808a20d1652 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:32.576742 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c0ed2939-bb21-442f-8d2e-f808a20d1652 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:32.577185 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c0ed2939-bb21-442f-8d2e-f808a20d1652 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:32.650958 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1f5c040b-65a2-45f0-8ce1-7d5c7115d51f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.194824 Mar 03 02:35:32.651522 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 431/848] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:32 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:32.691057 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b4864b24-d086-4254-8fd9-eb9148d9cfbf tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:32.691975 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b4864b24-d086-4254-8fd9-eb9148d9cfbf tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:32.697558 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b4864b24-d086-4254-8fd9-eb9148d9cfbf tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:32.697999 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b4864b24-d086-4254-8fd9-eb9148d9cfbf tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:32.698770 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b4864b24-d086-4254-8fd9-eb9148d9cfbf tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:32.699201 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b4864b24-d086-4254-8fd9-eb9148d9cfbf tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:32.712603 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c0ed2939-bb21-442f-8d2e-f808a20d1652 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:32.721610 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c0ed2939-bb21-442f-8d2e-f808a20d1652 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:32.723107 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c0ed2939-bb21-442f-8d2e-f808a20d1652 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:32.724293 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c0ed2939-bb21-442f-8d2e-f808a20d1652 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.160231 Mar 03 02:35:32.724852 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 418/849] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:32 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:35:32.727994 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b4864b24-d086-4254-8fd9-eb9148d9cfbf tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040934 Mar 03 02:35:32.728685 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 432/850] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:32 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:35:32.938925 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e891888f-144b-41cb-aa07-e2c5998efd97 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:32.940125 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e891888f-144b-41cb-aa07-e2c5998efd97 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:32.945889 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e891888f-144b-41cb-aa07-e2c5998efd97 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:32.946375 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e891888f-144b-41cb-aa07-e2c5998efd97 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:32.947159 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e891888f-144b-41cb-aa07-e2c5998efd97 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:32.947610 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e891888f-144b-41cb-aa07-e2c5998efd97 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:32.977007 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e891888f-144b-41cb-aa07-e2c5998efd97 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042116 Mar 03 02:35:32.977497 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 419/851] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:32 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:33.662446 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b6e4258d-8580-4a58-8371-3a7654cea39b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:33.663358 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b6e4258d-8580-4a58-8371-3a7654cea39b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:33.669607 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b6e4258d-8580-4a58-8371-3a7654cea39b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:33.670058 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b6e4258d-8580-4a58-8371-3a7654cea39b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:33.670842 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b6e4258d-8580-4a58-8371-3a7654cea39b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:33.671284 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b6e4258d-8580-4a58-8371-3a7654cea39b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:33.699812 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b6e4258d-8580-4a58-8371-3a7654cea39b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041282 Mar 03 02:35:33.700378 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 433/852] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:33 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:33.739089 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7d5e2e16-e728-4f84-aa39-57a7be333365 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:33.740054 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7d5e2e16-e728-4f84-aa39-57a7be333365 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:33.741758 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b07d2b6a-9b5e-4e93-bd55-d24ec749f531 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:33.742349 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b07d2b6a-9b5e-4e93-bd55-d24ec749f531 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:33.746709 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7d5e2e16-e728-4f84-aa39-57a7be333365 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:33.747162 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7d5e2e16-e728-4f84-aa39-57a7be333365 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:33.747980 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7d5e2e16-e728-4f84-aa39-57a7be333365 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:33.748165 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b07d2b6a-9b5e-4e93-bd55-d24ec749f531 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:33.748418 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7d5e2e16-e728-4f84-aa39-57a7be333365 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:33.748595 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b07d2b6a-9b5e-4e93-bd55-d24ec749f531 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:33.749365 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b07d2b6a-9b5e-4e93-bd55-d24ec749f531 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:33.749797 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b07d2b6a-9b5e-4e93-bd55-d24ec749f531 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:33.776083 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7d5e2e16-e728-4f84-aa39-57a7be333365 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041690 Mar 03 02:35:33.776654 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 420/853] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:33 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:33.880958 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b07d2b6a-9b5e-4e93-bd55-d24ec749f531 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:33.888941 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b07d2b6a-9b5e-4e93-bd55-d24ec749f531 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:33.890430 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b07d2b6a-9b5e-4e93-bd55-d24ec749f531 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:33.891560 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b07d2b6a-9b5e-4e93-bd55-d24ec749f531 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.153545 Mar 03 02:35:33.892496 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 434/854] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:33 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:35:33.988045 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9d0334b3-ea7c-46c4-abf8-d13033c24b66 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:33.988952 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9d0334b3-ea7c-46c4-abf8-d13033c24b66 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:33.994981 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9d0334b3-ea7c-46c4-abf8-d13033c24b66 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:33.995458 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9d0334b3-ea7c-46c4-abf8-d13033c24b66 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:33.996285 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9d0334b3-ea7c-46c4-abf8-d13033c24b66 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:33.996750 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9d0334b3-ea7c-46c4-abf8-d13033c24b66 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:34.024007 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9d0334b3-ea7c-46c4-abf8-d13033c24b66 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040244 Mar 03 02:35:34.024554 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 421/855] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:33 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:34.711916 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ac459568-d8f9-4fd7-af43-b1d85f3382a6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:34.712820 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ac459568-d8f9-4fd7-af43-b1d85f3382a6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:34.718963 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ac459568-d8f9-4fd7-af43-b1d85f3382a6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:34.719410 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ac459568-d8f9-4fd7-af43-b1d85f3382a6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:34.720223 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ac459568-d8f9-4fd7-af43-b1d85f3382a6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:34.720657 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ac459568-d8f9-4fd7-af43-b1d85f3382a6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:34.748444 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ac459568-d8f9-4fd7-af43-b1d85f3382a6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040501 Mar 03 02:35:34.748974 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 435/856] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:34 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:34.787621 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-812f690b-b16a-4a40-8b53-acc78d4a3b6f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:34.788553 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-812f690b-b16a-4a40-8b53-acc78d4a3b6f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:34.794686 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-812f690b-b16a-4a40-8b53-acc78d4a3b6f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:34.795138 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-812f690b-b16a-4a40-8b53-acc78d4a3b6f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:34.795954 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-812f690b-b16a-4a40-8b53-acc78d4a3b6f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:34.796396 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-812f690b-b16a-4a40-8b53-acc78d4a3b6f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:34.827447 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-812f690b-b16a-4a40-8b53-acc78d4a3b6f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043743 Mar 03 02:35:34.828038 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 422/857] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:34 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:34.909682 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2d7bc9a9-79ef-41b5-839e-71619bb0f42f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:34.910260 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2d7bc9a9-79ef-41b5-839e-71619bb0f42f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:34.916061 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2d7bc9a9-79ef-41b5-839e-71619bb0f42f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:34.916506 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2d7bc9a9-79ef-41b5-839e-71619bb0f42f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:34.917296 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2d7bc9a9-79ef-41b5-839e-71619bb0f42f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:34.917729 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2d7bc9a9-79ef-41b5-839e-71619bb0f42f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:35.036645 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1c6aedbb-55c1-4803-8e4e-9bb273cac1c6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:35.037805 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1c6aedbb-55c1-4803-8e4e-9bb273cac1c6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:35.043646 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1c6aedbb-55c1-4803-8e4e-9bb273cac1c6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:35.044170 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1c6aedbb-55c1-4803-8e4e-9bb273cac1c6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:35.045025 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1c6aedbb-55c1-4803-8e4e-9bb273cac1c6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:35.045534 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1c6aedbb-55c1-4803-8e4e-9bb273cac1c6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:35.051319 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2d7bc9a9-79ef-41b5-839e-71619bb0f42f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:35.059663 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2d7bc9a9-79ef-41b5-839e-71619bb0f42f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:35.061173 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2d7bc9a9-79ef-41b5-839e-71619bb0f42f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:35.062322 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2d7bc9a9-79ef-41b5-839e-71619bb0f42f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.156659 Mar 03 02:35:35.062865 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 436/858] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:34 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:35:35.075700 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1c6aedbb-55c1-4803-8e4e-9bb273cac1c6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043836 Mar 03 02:35:35.076242 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 423/859] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:35 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:35.760371 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-88807170-2a99-40d1-81b4-ac2b6ca6904a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:35.761280 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-88807170-2a99-40d1-81b4-ac2b6ca6904a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:35.768058 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-88807170-2a99-40d1-81b4-ac2b6ca6904a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:35.768503 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-88807170-2a99-40d1-81b4-ac2b6ca6904a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:35.769288 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-88807170-2a99-40d1-81b4-ac2b6ca6904a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:35.769727 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-88807170-2a99-40d1-81b4-ac2b6ca6904a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:35.797681 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-88807170-2a99-40d1-81b4-ac2b6ca6904a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041244 Mar 03 02:35:35.798411 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 437/860] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:35 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:35.838914 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ba5bc44f-b097-4f99-9331-01da174131eb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:35.839884 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ba5bc44f-b097-4f99-9331-01da174131eb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:35.846721 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ba5bc44f-b097-4f99-9331-01da174131eb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:35.847162 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ba5bc44f-b097-4f99-9331-01da174131eb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:35.847986 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ba5bc44f-b097-4f99-9331-01da174131eb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:35.848423 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ba5bc44f-b097-4f99-9331-01da174131eb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:35.876755 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ba5bc44f-b097-4f99-9331-01da174131eb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041620 Mar 03 02:35:35.877451 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 424/861] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:35 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:36.082719 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f6463d0b-1203-48ed-b261-bfa5e748da17 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:36.083326 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f6463d0b-1203-48ed-b261-bfa5e748da17 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:36.089701 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f6463d0b-1203-48ed-b261-bfa5e748da17 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:36.089837 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9fed9961-9947-4346-8716-52271bd3f8b2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:36.090278 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f6463d0b-1203-48ed-b261-bfa5e748da17 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:36.090901 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9fed9961-9947-4346-8716-52271bd3f8b2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:36.091018 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f6463d0b-1203-48ed-b261-bfa5e748da17 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:36.091359 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f6463d0b-1203-48ed-b261-bfa5e748da17 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:36.097008 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9fed9961-9947-4346-8716-52271bd3f8b2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:36.097454 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9fed9961-9947-4346-8716-52271bd3f8b2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:36.098234 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9fed9961-9947-4346-8716-52271bd3f8b2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:36.098662 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9fed9961-9947-4346-8716-52271bd3f8b2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:36.126984 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9fed9961-9947-4346-8716-52271bd3f8b2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043254 Mar 03 02:35:36.127689 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 425/862] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:36 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:36.225049 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f6463d0b-1203-48ed-b261-bfa5e748da17 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:36.233108 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f6463d0b-1203-48ed-b261-bfa5e748da17 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:36.234594 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f6463d0b-1203-48ed-b261-bfa5e748da17 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:36.235840 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f6463d0b-1203-48ed-b261-bfa5e748da17 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.158287 Mar 03 02:35:36.236391 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 438/863] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:36 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:35:36.809651 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-fca2b535-02db-40b8-876c-8d50e51ceba6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:36.810512 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-fca2b535-02db-40b8-876c-8d50e51ceba6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:36.816400 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fca2b535-02db-40b8-876c-8d50e51ceba6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:36.816841 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fca2b535-02db-40b8-876c-8d50e51ceba6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:36.817632 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fca2b535-02db-40b8-876c-8d50e51ceba6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:36.818066 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fca2b535-02db-40b8-876c-8d50e51ceba6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:36.850663 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-fca2b535-02db-40b8-876c-8d50e51ceba6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045082 Mar 03 02:35:36.851231 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 426/864] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:36 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:36.888228 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a6370263-eb03-42f0-9a19-979e3234aaed tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:36.889130 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a6370263-eb03-42f0-9a19-979e3234aaed tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:36.895351 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a6370263-eb03-42f0-9a19-979e3234aaed tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:36.895830 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a6370263-eb03-42f0-9a19-979e3234aaed tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:36.896600 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a6370263-eb03-42f0-9a19-979e3234aaed tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:36.897030 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a6370263-eb03-42f0-9a19-979e3234aaed tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:36.925396 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a6370263-eb03-42f0-9a19-979e3234aaed tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041138 Mar 03 02:35:36.925929 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 439/865] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:36 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:37.138330 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c91f552b-690a-455e-8143-ffd36a1275ef tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:37.139242 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c91f552b-690a-455e-8143-ffd36a1275ef tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:37.145125 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c91f552b-690a-455e-8143-ffd36a1275ef tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:37.145577 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c91f552b-690a-455e-8143-ffd36a1275ef tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:37.146358 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c91f552b-690a-455e-8143-ffd36a1275ef tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:37.146798 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c91f552b-690a-455e-8143-ffd36a1275ef tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:37.174063 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c91f552b-690a-455e-8143-ffd36a1275ef tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039590 Mar 03 02:35:37.174613 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 427/866] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:37 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:37.254501 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3f616011-e347-478f-87a7-52e528c75b04 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:37.255132 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3f616011-e347-478f-87a7-52e528c75b04 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:37.260894 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3f616011-e347-478f-87a7-52e528c75b04 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:37.261342 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3f616011-e347-478f-87a7-52e528c75b04 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:37.262117 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3f616011-e347-478f-87a7-52e528c75b04 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:37.262553 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3f616011-e347-478f-87a7-52e528c75b04 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:37.391047 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3f616011-e347-478f-87a7-52e528c75b04 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:37.399182 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3f616011-e347-478f-87a7-52e528c75b04 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:37.400717 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3f616011-e347-478f-87a7-52e528c75b04 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:37.401898 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3f616011-e347-478f-87a7-52e528c75b04 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.151899 Mar 03 02:35:37.402449 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 440/867] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:37 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:35:37.862219 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1e38244f-8205-4119-8d80-f616fd5c070b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:37.863122 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1e38244f-8205-4119-8d80-f616fd5c070b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:37.869378 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1e38244f-8205-4119-8d80-f616fd5c070b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:37.870114 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1e38244f-8205-4119-8d80-f616fd5c070b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:37.870894 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1e38244f-8205-4119-8d80-f616fd5c070b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:37.871335 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1e38244f-8205-4119-8d80-f616fd5c070b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:37.901639 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1e38244f-8205-4119-8d80-f616fd5c070b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043263 Mar 03 02:35:37.902413 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 428/868] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:37 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:37.937015 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e6208b1f-50bd-4599-a3c2-d02313b9ae1f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:37.937921 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e6208b1f-50bd-4599-a3c2-d02313b9ae1f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:37.944302 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e6208b1f-50bd-4599-a3c2-d02313b9ae1f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:37.944692 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e6208b1f-50bd-4599-a3c2-d02313b9ae1f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:37.945471 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e6208b1f-50bd-4599-a3c2-d02313b9ae1f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:37.945906 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e6208b1f-50bd-4599-a3c2-d02313b9ae1f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:37.974168 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e6208b1f-50bd-4599-a3c2-d02313b9ae1f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041265 Mar 03 02:35:37.974708 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 441/869] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:37 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:38.185033 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1693b599-240e-4320-89f9-019f64e8d9ba tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:38.185996 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1693b599-240e-4320-89f9-019f64e8d9ba tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:38.192473 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1693b599-240e-4320-89f9-019f64e8d9ba tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:38.192916 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1693b599-240e-4320-89f9-019f64e8d9ba tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:38.193690 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1693b599-240e-4320-89f9-019f64e8d9ba tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:38.194121 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1693b599-240e-4320-89f9-019f64e8d9ba tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:38.221735 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1693b599-240e-4320-89f9-019f64e8d9ba tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040920 Mar 03 02:35:38.222213 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 429/870] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:38 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:38.420112 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a5b8f9fd-0771-4496-a302-ed6c737407af tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:38.420715 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a5b8f9fd-0771-4496-a302-ed6c737407af tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:38.426901 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a5b8f9fd-0771-4496-a302-ed6c737407af tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:38.427354 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a5b8f9fd-0771-4496-a302-ed6c737407af tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:38.428165 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a5b8f9fd-0771-4496-a302-ed6c737407af tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:38.428608 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a5b8f9fd-0771-4496-a302-ed6c737407af tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:38.561022 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a5b8f9fd-0771-4496-a302-ed6c737407af tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:38.577254 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a5b8f9fd-0771-4496-a302-ed6c737407af tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:38.578755 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a5b8f9fd-0771-4496-a302-ed6c737407af tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:38.581306 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a5b8f9fd-0771-4496-a302-ed6c737407af tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.164578 Mar 03 02:35:38.581842 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 442/871] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:38 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:35:38.914502 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8fa12dd4-eb8c-46f2-a44e-75f957462576 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:38.915395 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8fa12dd4-eb8c-46f2-a44e-75f957462576 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:38.921538 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8fa12dd4-eb8c-46f2-a44e-75f957462576 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:38.921983 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8fa12dd4-eb8c-46f2-a44e-75f957462576 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:38.923288 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8fa12dd4-eb8c-46f2-a44e-75f957462576 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:38.923753 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8fa12dd4-eb8c-46f2-a44e-75f957462576 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:38.951374 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8fa12dd4-eb8c-46f2-a44e-75f957462576 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040773 Mar 03 02:35:38.951951 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 430/872] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:38 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:35:38.986269 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-43eb139c-3f2f-4823-bac6-91a328ff3aa0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:38.987187 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-43eb139c-3f2f-4823-bac6-91a328ff3aa0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:38.993403 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-43eb139c-3f2f-4823-bac6-91a328ff3aa0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:38.993859 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-43eb139c-3f2f-4823-bac6-91a328ff3aa0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:38.994903 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-43eb139c-3f2f-4823-bac6-91a328ff3aa0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:38.995345 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-43eb139c-3f2f-4823-bac6-91a328ff3aa0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:39.025318 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-43eb139c-3f2f-4823-bac6-91a328ff3aa0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043719 Mar 03 02:35:39.025870 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 443/873] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:38 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:39.238613 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-678b6000-1408-4329-9782-c49d71e80e64 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:39.239928 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-678b6000-1408-4329-9782-c49d71e80e64 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:39.246417 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-678b6000-1408-4329-9782-c49d71e80e64 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:39.246862 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-678b6000-1408-4329-9782-c49d71e80e64 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:39.247667 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-678b6000-1408-4329-9782-c49d71e80e64 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:39.248101 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-678b6000-1408-4329-9782-c49d71e80e64 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:39.275628 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-678b6000-1408-4329-9782-c49d71e80e64 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046433 Mar 03 02:35:39.276204 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 431/874] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:39 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:39.600889 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a1309cf4-8333-4cae-b8d0-9727ba2d9d9e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:39.601521 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a1309cf4-8333-4cae-b8d0-9727ba2d9d9e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:39.607291 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a1309cf4-8333-4cae-b8d0-9727ba2d9d9e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:39.607774 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a1309cf4-8333-4cae-b8d0-9727ba2d9d9e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:39.608561 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a1309cf4-8333-4cae-b8d0-9727ba2d9d9e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:39.608999 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a1309cf4-8333-4cae-b8d0-9727ba2d9d9e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:39.738638 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a1309cf4-8333-4cae-b8d0-9727ba2d9d9e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:39.747092 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a1309cf4-8333-4cae-b8d0-9727ba2d9d9e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:39.748653 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a1309cf4-8333-4cae-b8d0-9727ba2d9d9e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:39.749812 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a1309cf4-8333-4cae-b8d0-9727ba2d9d9e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.152907 Mar 03 02:35:39.750365 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 444/875] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:39 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:35:39.962786 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ad4801d4-f693-4a62-967b-e10ed7538c4f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:39.963765 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ad4801d4-f693-4a62-967b-e10ed7538c4f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:39.969936 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ad4801d4-f693-4a62-967b-e10ed7538c4f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:39.970391 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ad4801d4-f693-4a62-967b-e10ed7538c4f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:39.971168 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ad4801d4-f693-4a62-967b-e10ed7538c4f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:39.971627 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ad4801d4-f693-4a62-967b-e10ed7538c4f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:39.999545 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ad4801d4-f693-4a62-967b-e10ed7538c4f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040800 Mar 03 02:35:40.000212 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 432/876] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:39 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:40.136031 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a906ea6a-5342-4657-aeff-0a92ca5c4f14 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:40.136978 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a906ea6a-5342-4657-aeff-0a92ca5c4f14 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:40.142860 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a906ea6a-5342-4657-aeff-0a92ca5c4f14 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:40.143311 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a906ea6a-5342-4657-aeff-0a92ca5c4f14 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:40.144118 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a906ea6a-5342-4657-aeff-0a92ca5c4f14 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:40.144549 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a906ea6a-5342-4657-aeff-0a92ca5c4f14 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:40.171754 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a906ea6a-5342-4657-aeff-0a92ca5c4f14 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138009 Mar 03 02:35:40.172286 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 445/877] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:40 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:40.287900 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-05421b9b-a703-46e2-9556-3842ff9d17d8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:40.288872 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-05421b9b-a703-46e2-9556-3842ff9d17d8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:40.294715 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-05421b9b-a703-46e2-9556-3842ff9d17d8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:40.295170 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-05421b9b-a703-46e2-9556-3842ff9d17d8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:40.295998 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-05421b9b-a703-46e2-9556-3842ff9d17d8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:40.296439 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-05421b9b-a703-46e2-9556-3842ff9d17d8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:40.325379 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-05421b9b-a703-46e2-9556-3842ff9d17d8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041399 Mar 03 02:35:40.325928 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 433/878] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:40 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:40.769070 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-01968a83-2162-45d7-9dca-d3c791c688d3 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:40.769853 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-01968a83-2162-45d7-9dca-d3c791c688d3 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:40.775679 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-01968a83-2162-45d7-9dca-d3c791c688d3 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:40.776125 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-01968a83-2162-45d7-9dca-d3c791c688d3 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:40.776897 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-01968a83-2162-45d7-9dca-d3c791c688d3 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:40.777331 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-01968a83-2162-45d7-9dca-d3c791c688d3 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:40.957705 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-01968a83-2162-45d7-9dca-d3c791c688d3 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:40.965743 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-01968a83-2162-45d7-9dca-d3c791c688d3 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:40.967213 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-01968a83-2162-45d7-9dca-d3c791c688d3 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:40.968369 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-01968a83-2162-45d7-9dca-d3c791c688d3 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.203636 Mar 03 02:35:40.968911 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 446/879] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:40 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:35:41.010633 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0e81c78f-a335-4185-ae3a-7a0140fd67be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:41.011539 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0e81c78f-a335-4185-ae3a-7a0140fd67be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:41.018505 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0e81c78f-a335-4185-ae3a-7a0140fd67be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:41.018958 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0e81c78f-a335-4185-ae3a-7a0140fd67be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:41.019834 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0e81c78f-a335-4185-ae3a-7a0140fd67be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:41.020224 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0e81c78f-a335-4185-ae3a-7a0140fd67be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:41.048770 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0e81c78f-a335-4185-ae3a-7a0140fd67be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042028 Mar 03 02:35:41.049337 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 434/880] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:41 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:41.183842 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-968bba52-b119-4143-a038-6438465f73a7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:41.184775 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-968bba52-b119-4143-a038-6438465f73a7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:41.192445 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-968bba52-b119-4143-a038-6438465f73a7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:41.192897 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-968bba52-b119-4143-a038-6438465f73a7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:41.193688 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-968bba52-b119-4143-a038-6438465f73a7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:41.194759 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-968bba52-b119-4143-a038-6438465f73a7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:41.225365 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-968bba52-b119-4143-a038-6438465f73a7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045423 Mar 03 02:35:41.225914 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 447/881] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:41 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:41.336647 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-33fa770c-1ca7-45e5-b33b-cdc1df5517ba tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:41.337561 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-33fa770c-1ca7-45e5-b33b-cdc1df5517ba tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:41.343320 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-33fa770c-1ca7-45e5-b33b-cdc1df5517ba tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:41.343817 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-33fa770c-1ca7-45e5-b33b-cdc1df5517ba tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:41.344604 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-33fa770c-1ca7-45e5-b33b-cdc1df5517ba tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:41.345046 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-33fa770c-1ca7-45e5-b33b-cdc1df5517ba tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:41.372298 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-33fa770c-1ca7-45e5-b33b-cdc1df5517ba tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039523 Mar 03 02:35:41.372844 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 435/882] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:41 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:35:41.987736 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9a0b2c09-dd92-43c1-b1ff-b6a25a734e3a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:41.988349 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9a0b2c09-dd92-43c1-b1ff-b6a25a734e3a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:41.994148 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9a0b2c09-dd92-43c1-b1ff-b6a25a734e3a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:41.994864 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9a0b2c09-dd92-43c1-b1ff-b6a25a734e3a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:41.995679 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9a0b2c09-dd92-43c1-b1ff-b6a25a734e3a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:41.996127 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9a0b2c09-dd92-43c1-b1ff-b6a25a734e3a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:42.060295 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2e234c27-1373-447f-8a4a-f4f9e5bf6f06 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:42.061246 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2e234c27-1373-447f-8a4a-f4f9e5bf6f06 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:42.068095 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2e234c27-1373-447f-8a4a-f4f9e5bf6f06 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:42.068553 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2e234c27-1373-447f-8a4a-f4f9e5bf6f06 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:42.069411 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2e234c27-1373-447f-8a4a-f4f9e5bf6f06 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:42.069875 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2e234c27-1373-447f-8a4a-f4f9e5bf6f06 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:42.098832 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2e234c27-1373-447f-8a4a-f4f9e5bf6f06 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042470 Mar 03 02:35:42.099398 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 436/883] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:42 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:35:42.131440 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9a0b2c09-dd92-43c1-b1ff-b6a25a734e3a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:42.139433 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9a0b2c09-dd92-43c1-b1ff-b6a25a734e3a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:42.140930 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9a0b2c09-dd92-43c1-b1ff-b6a25a734e3a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:42.142686 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9a0b2c09-dd92-43c1-b1ff-b6a25a734e3a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.158969 Mar 03 02:35:42.143237 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 448/884] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:41 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:35:42.237542 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-edf78e69-aa10-4891-a870-594e6c8c7331 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:42.238490 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-edf78e69-aa10-4891-a870-594e6c8c7331 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:42.244188 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-edf78e69-aa10-4891-a870-594e6c8c7331 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:42.244902 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-edf78e69-aa10-4891-a870-594e6c8c7331 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:42.245675 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-edf78e69-aa10-4891-a870-594e6c8c7331 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:42.246107 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-edf78e69-aa10-4891-a870-594e6c8c7331 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:42.274429 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-edf78e69-aa10-4891-a870-594e6c8c7331 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040951 Mar 03 02:35:42.274968 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 437/885] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:42 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:42.387192 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-cf0ec9c8-df26-42c4-a086-851dd4bdeec9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:42.388136 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-cf0ec9c8-df26-42c4-a086-851dd4bdeec9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:42.394847 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cf0ec9c8-df26-42c4-a086-851dd4bdeec9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:42.395300 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cf0ec9c8-df26-42c4-a086-851dd4bdeec9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:42.396115 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cf0ec9c8-df26-42c4-a086-851dd4bdeec9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:42.396552 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cf0ec9c8-df26-42c4-a086-851dd4bdeec9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:42.425295 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-cf0ec9c8-df26-42c4-a086-851dd4bdeec9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042094 Mar 03 02:35:42.425878 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 449/886] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:42 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:42.947775 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 02:35:42.948337 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: Thu Mar 3 02:35:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 03 02:35:43.110172 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4c47ce62-99b0-4e09-9c86-52faf71ca11a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:43.111075 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4c47ce62-99b0-4e09-9c86-52faf71ca11a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:43.117865 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4c47ce62-99b0-4e09-9c86-52faf71ca11a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:43.118312 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4c47ce62-99b0-4e09-9c86-52faf71ca11a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:43.119084 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4c47ce62-99b0-4e09-9c86-52faf71ca11a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:43.119519 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4c47ce62-99b0-4e09-9c86-52faf71ca11a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:43.146815 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4c47ce62-99b0-4e09-9c86-52faf71ca11a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040589 Mar 03 02:35:43.147352 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 438/887] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:43 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:43.161522 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0d6cc3b6-03d9-402e-bfb0-1b89dfaaae23 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:43.162125 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0d6cc3b6-03d9-402e-bfb0-1b89dfaaae23 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:43.167909 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0d6cc3b6-03d9-402e-bfb0-1b89dfaaae23 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:43.168361 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0d6cc3b6-03d9-402e-bfb0-1b89dfaaae23 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:43.169137 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0d6cc3b6-03d9-402e-bfb0-1b89dfaaae23 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:43.169574 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0d6cc3b6-03d9-402e-bfb0-1b89dfaaae23 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:43.286955 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-fca3914a-ccdd-40e7-838a-056d463e5051 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:43.287920 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-fca3914a-ccdd-40e7-838a-056d463e5051 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:43.293554 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fca3914a-ccdd-40e7-838a-056d463e5051 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:43.294000 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fca3914a-ccdd-40e7-838a-056d463e5051 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:43.294768 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fca3914a-ccdd-40e7-838a-056d463e5051 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:43.295195 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fca3914a-ccdd-40e7-838a-056d463e5051 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:43.301662 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0d6cc3b6-03d9-402e-bfb0-1b89dfaaae23 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:43.309746 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0d6cc3b6-03d9-402e-bfb0-1b89dfaaae23 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:43.311245 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0d6cc3b6-03d9-402e-bfb0-1b89dfaaae23 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:43.312417 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0d6cc3b6-03d9-402e-bfb0-1b89dfaaae23 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.155959 Mar 03 02:35:43.312968 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 450/888] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:43 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:35:43.323477 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-fca3914a-ccdd-40e7-838a-056d463e5051 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041497 Mar 03 02:35:43.324066 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 439/889] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:43 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:35:43.436770 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3005f812-41c5-4b58-b2bf-58a3e3671160 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:43.437673 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3005f812-41c5-4b58-b2bf-58a3e3671160 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:43.444574 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3005f812-41c5-4b58-b2bf-58a3e3671160 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:43.445023 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3005f812-41c5-4b58-b2bf-58a3e3671160 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:43.445840 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3005f812-41c5-4b58-b2bf-58a3e3671160 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:43.446264 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3005f812-41c5-4b58-b2bf-58a3e3671160 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:43.474514 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3005f812-41c5-4b58-b2bf-58a3e3671160 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041576 Mar 03 02:35:43.475058 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 451/890] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:43 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:44.122158 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 02:35:44.122321 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: Thu Mar 3 02:35:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 03 02:35:44.158571 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8b352d45-80a5-4e08-8147-494b25d5e04c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:44.159934 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8b352d45-80a5-4e08-8147-494b25d5e04c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:44.166518 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b352d45-80a5-4e08-8147-494b25d5e04c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:44.167046 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b352d45-80a5-4e08-8147-494b25d5e04c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:44.167880 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b352d45-80a5-4e08-8147-494b25d5e04c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:44.168324 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b352d45-80a5-4e08-8147-494b25d5e04c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:44.198884 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8b352d45-80a5-4e08-8147-494b25d5e04c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044656 Mar 03 02:35:44.199435 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 440/891] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:44 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:35:44.331035 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-47f5553c-d5df-43f2-90b4-afeeac47d760 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:44.331660 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-47f5553c-d5df-43f2-90b4-afeeac47d760 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:44.334142 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c2085eae-3329-4835-a6d2-a7a5e0ce6dce tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:44.335082 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c2085eae-3329-4835-a6d2-a7a5e0ce6dce tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:44.337569 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-47f5553c-d5df-43f2-90b4-afeeac47d760 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:44.338023 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-47f5553c-d5df-43f2-90b4-afeeac47d760 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:44.338803 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-47f5553c-d5df-43f2-90b4-afeeac47d760 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:44.339241 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-47f5553c-d5df-43f2-90b4-afeeac47d760 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:44.340804 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c2085eae-3329-4835-a6d2-a7a5e0ce6dce tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:44.341253 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c2085eae-3329-4835-a6d2-a7a5e0ce6dce tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:44.342036 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c2085eae-3329-4835-a6d2-a7a5e0ce6dce tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:44.342475 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c2085eae-3329-4835-a6d2-a7a5e0ce6dce tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:44.372088 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c2085eae-3329-4835-a6d2-a7a5e0ce6dce tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041782 Mar 03 02:35:44.372750 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 441/892] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:44 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:35:44.474682 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-47f5553c-d5df-43f2-90b4-afeeac47d760 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:44.486389 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-47f5553c-d5df-43f2-90b4-afeeac47d760 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:44.486681 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0881fc39-8ba9-46a2-8a75-32aa574d38d0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:44.487587 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0881fc39-8ba9-46a2-8a75-32aa574d38d0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:44.487914 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-47f5553c-d5df-43f2-90b4-afeeac47d760 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:44.489072 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-47f5553c-d5df-43f2-90b4-afeeac47d760 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.162121 Mar 03 02:35:44.489804 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 452/893] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:44 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:35:44.497948 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0881fc39-8ba9-46a2-8a75-32aa574d38d0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:44.497948 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0881fc39-8ba9-46a2-8a75-32aa574d38d0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:44.497948 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0881fc39-8ba9-46a2-8a75-32aa574d38d0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:44.497948 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0881fc39-8ba9-46a2-8a75-32aa574d38d0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:44.527568 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0881fc39-8ba9-46a2-8a75-32aa574d38d0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045287 Mar 03 02:35:44.528658 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 442/894] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:44 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:45.210901 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-15c222fc-43d5-4596-9584-d1d1e342ff41 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:45.212061 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-15c222fc-43d5-4596-9584-d1d1e342ff41 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:45.217805 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-15c222fc-43d5-4596-9584-d1d1e342ff41 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:45.218252 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-15c222fc-43d5-4596-9584-d1d1e342ff41 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:45.219023 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-15c222fc-43d5-4596-9584-d1d1e342ff41 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:45.219502 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-15c222fc-43d5-4596-9584-d1d1e342ff41 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:45.246208 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-15c222fc-43d5-4596-9584-d1d1e342ff41 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039270 Mar 03 02:35:45.246738 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 453/895] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:45 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:45.383927 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-59249cd9-7357-41cc-a450-643e4168299e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:45.384832 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-59249cd9-7357-41cc-a450-643e4168299e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:45.390990 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-59249cd9-7357-41cc-a450-643e4168299e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:45.391465 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-59249cd9-7357-41cc-a450-643e4168299e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:45.392270 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-59249cd9-7357-41cc-a450-643e4168299e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:45.392702 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-59249cd9-7357-41cc-a450-643e4168299e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:45.420116 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-59249cd9-7357-41cc-a450-643e4168299e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040223 Mar 03 02:35:45.420659 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 443/896] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:45 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:45.506940 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-632c97c7-5808-4bce-9e90-e47151b148a0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:45.507548 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-632c97c7-5808-4bce-9e90-e47151b148a0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:45.515539 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-632c97c7-5808-4bce-9e90-e47151b148a0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:45.516022 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-632c97c7-5808-4bce-9e90-e47151b148a0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:45.516825 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-632c97c7-5808-4bce-9e90-e47151b148a0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:45.517267 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-632c97c7-5808-4bce-9e90-e47151b148a0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:45.538362 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-de448bde-9c0c-41f9-9904-7d88a75a6c88 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:45.539380 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-de448bde-9c0c-41f9-9904-7d88a75a6c88 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:45.549291 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-de448bde-9c0c-41f9-9904-7d88a75a6c88 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:45.549291 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-de448bde-9c0c-41f9-9904-7d88a75a6c88 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:45.549291 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-de448bde-9c0c-41f9-9904-7d88a75a6c88 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:45.549291 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-de448bde-9c0c-41f9-9904-7d88a75a6c88 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:45.576795 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-de448bde-9c0c-41f9-9904-7d88a75a6c88 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042359 Mar 03 02:35:45.577657 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 444/897] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:45 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:45.655004 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-632c97c7-5808-4bce-9e90-e47151b148a0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:45.664258 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-632c97c7-5808-4bce-9e90-e47151b148a0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:45.665750 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-632c97c7-5808-4bce-9e90-e47151b148a0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:45.666902 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-632c97c7-5808-4bce-9e90-e47151b148a0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.163921 Mar 03 02:35:45.667443 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 454/898] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:45 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:35:46.257848 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7f883128-e764-4505-b326-dbd78d400502 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:46.258851 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7f883128-e764-4505-b326-dbd78d400502 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:46.264741 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7f883128-e764-4505-b326-dbd78d400502 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:46.265196 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7f883128-e764-4505-b326-dbd78d400502 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:46.265975 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7f883128-e764-4505-b326-dbd78d400502 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:46.266993 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7f883128-e764-4505-b326-dbd78d400502 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:46.295211 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7f883128-e764-4505-b326-dbd78d400502 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041291 Mar 03 02:35:46.295786 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 445/899] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:46 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:46.432069 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d9533560-dab3-4374-841b-2ce27a91f2a3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:46.432977 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d9533560-dab3-4374-841b-2ce27a91f2a3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:46.439402 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d9533560-dab3-4374-841b-2ce27a91f2a3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:46.439883 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d9533560-dab3-4374-841b-2ce27a91f2a3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:46.440654 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d9533560-dab3-4374-841b-2ce27a91f2a3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:46.441085 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d9533560-dab3-4374-841b-2ce27a91f2a3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:46.468386 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d9533560-dab3-4374-841b-2ce27a91f2a3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040193 Mar 03 02:35:46.468910 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 455/900] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:46 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:46.588419 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d106eeea-26e7-466e-8b34-cbd6e7b35338 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:46.589323 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d106eeea-26e7-466e-8b34-cbd6e7b35338 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:46.595184 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d106eeea-26e7-466e-8b34-cbd6e7b35338 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:46.595657 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d106eeea-26e7-466e-8b34-cbd6e7b35338 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:46.596445 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d106eeea-26e7-466e-8b34-cbd6e7b35338 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:46.596963 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d106eeea-26e7-466e-8b34-cbd6e7b35338 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:46.623788 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d106eeea-26e7-466e-8b34-cbd6e7b35338 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039165 Mar 03 02:35:46.624324 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 446/901] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:46 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:46.685284 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3c88b24a-d12b-4c2a-a12d-168afd732112 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:46.685829 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3c88b24a-d12b-4c2a-a12d-168afd732112 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:46.692551 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3c88b24a-d12b-4c2a-a12d-168afd732112 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:46.693002 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3c88b24a-d12b-4c2a-a12d-168afd732112 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:46.693810 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3c88b24a-d12b-4c2a-a12d-168afd732112 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:46.694252 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3c88b24a-d12b-4c2a-a12d-168afd732112 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:46.825679 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3c88b24a-d12b-4c2a-a12d-168afd732112 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:46.834603 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3c88b24a-d12b-4c2a-a12d-168afd732112 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:46.836131 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3c88b24a-d12b-4c2a-a12d-168afd732112 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:46.837274 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3c88b24a-d12b-4c2a-a12d-168afd732112 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.155895 Mar 03 02:35:46.837823 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 456/902] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:46 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:35:47.306740 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b9b9bfe6-0db6-4e2c-89d4-d3258d77731b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:47.307540 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b9b9bfe6-0db6-4e2c-89d4-d3258d77731b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:47.313273 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b9b9bfe6-0db6-4e2c-89d4-d3258d77731b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:47.313899 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b9b9bfe6-0db6-4e2c-89d4-d3258d77731b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:47.315049 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b9b9bfe6-0db6-4e2c-89d4-d3258d77731b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:47.315489 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b9b9bfe6-0db6-4e2c-89d4-d3258d77731b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:47.343165 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b9b9bfe6-0db6-4e2c-89d4-d3258d77731b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040440 Mar 03 02:35:47.344072 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 447/903] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:47 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:35:47.479900 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-85cc75e0-564d-469c-91fb-104458bac6ef tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:47.480824 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-85cc75e0-564d-469c-91fb-104458bac6ef tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:47.487569 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-85cc75e0-564d-469c-91fb-104458bac6ef tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:47.488052 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-85cc75e0-564d-469c-91fb-104458bac6ef tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:47.488966 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-85cc75e0-564d-469c-91fb-104458bac6ef tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:47.489438 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-85cc75e0-564d-469c-91fb-104458bac6ef tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:47.516791 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-85cc75e0-564d-469c-91fb-104458bac6ef tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040756 Mar 03 02:35:47.517335 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 457/904] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:47 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:47.635727 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-58c7a5bd-f028-40d1-bda4-c224c4a4b60f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:47.636591 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-58c7a5bd-f028-40d1-bda4-c224c4a4b60f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:47.643714 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-58c7a5bd-f028-40d1-bda4-c224c4a4b60f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:47.644174 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-58c7a5bd-f028-40d1-bda4-c224c4a4b60f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:47.645006 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-58c7a5bd-f028-40d1-bda4-c224c4a4b60f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:47.645448 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-58c7a5bd-f028-40d1-bda4-c224c4a4b60f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:47.673438 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-58c7a5bd-f028-40d1-bda4-c224c4a4b60f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041732 Mar 03 02:35:47.673990 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 448/905] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:47 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:47.856124 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-aa786b82-5003-45e6-ba35-0ff8d4886b34 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:47.856639 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-aa786b82-5003-45e6-ba35-0ff8d4886b34 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:47.863063 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aa786b82-5003-45e6-ba35-0ff8d4886b34 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:47.863508 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aa786b82-5003-45e6-ba35-0ff8d4886b34 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:47.864319 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aa786b82-5003-45e6-ba35-0ff8d4886b34 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:47.864755 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aa786b82-5003-45e6-ba35-0ff8d4886b34 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:47.996446 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-aa786b82-5003-45e6-ba35-0ff8d4886b34 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:48.005561 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-aa786b82-5003-45e6-ba35-0ff8d4886b34 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:48.007055 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-aa786b82-5003-45e6-ba35-0ff8d4886b34 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:48.008237 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-aa786b82-5003-45e6-ba35-0ff8d4886b34 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.156366 Mar 03 02:35:48.008791 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 458/906] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:47 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:35:48.355618 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-bfa7b8ec-6082-47ef-a968-5f13a51c5d8a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:48.356555 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-bfa7b8ec-6082-47ef-a968-5f13a51c5d8a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:48.362817 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bfa7b8ec-6082-47ef-a968-5f13a51c5d8a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:48.363288 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bfa7b8ec-6082-47ef-a968-5f13a51c5d8a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:48.364094 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bfa7b8ec-6082-47ef-a968-5f13a51c5d8a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:48.364524 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bfa7b8ec-6082-47ef-a968-5f13a51c5d8a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:48.392451 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-bfa7b8ec-6082-47ef-a968-5f13a51c5d8a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040649 Mar 03 02:35:48.392965 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 449/907] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:48 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:48.528308 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d3445163-fe1e-42d5-9f0a-7d18113bf6a5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:48.529209 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d3445163-fe1e-42d5-9f0a-7d18113bf6a5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:48.535128 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d3445163-fe1e-42d5-9f0a-7d18113bf6a5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:48.535571 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d3445163-fe1e-42d5-9f0a-7d18113bf6a5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:48.536499 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d3445163-fe1e-42d5-9f0a-7d18113bf6a5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:48.537898 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d3445163-fe1e-42d5-9f0a-7d18113bf6a5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:48.565760 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d3445163-fe1e-42d5-9f0a-7d18113bf6a5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041360 Mar 03 02:35:48.566287 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 459/908] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:48 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:35:48.684896 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b9165a68-d9e8-40dc-b605-815caec28877 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:48.685794 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b9165a68-d9e8-40dc-b605-815caec28877 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:48.692241 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b9165a68-d9e8-40dc-b605-815caec28877 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:48.692690 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b9165a68-d9e8-40dc-b605-815caec28877 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:48.693473 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b9165a68-d9e8-40dc-b605-815caec28877 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:48.693903 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b9165a68-d9e8-40dc-b605-815caec28877 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:48.722462 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b9165a68-d9e8-40dc-b605-815caec28877 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041384 Mar 03 02:35:48.723002 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 450/909] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:48 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:49.026319 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0f058db7-0a26-42e0-9b4b-ebe7771d27d1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:49.026843 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0f058db7-0a26-42e0-9b4b-ebe7771d27d1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:49.033532 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0f058db7-0a26-42e0-9b4b-ebe7771d27d1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:49.034008 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0f058db7-0a26-42e0-9b4b-ebe7771d27d1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:49.034790 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0f058db7-0a26-42e0-9b4b-ebe7771d27d1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:49.035220 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0f058db7-0a26-42e0-9b4b-ebe7771d27d1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:49.163895 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0f058db7-0a26-42e0-9b4b-ebe7771d27d1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:49.171982 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0f058db7-0a26-42e0-9b4b-ebe7771d27d1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:49.173475 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0f058db7-0a26-42e0-9b4b-ebe7771d27d1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:49.174798 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0f058db7-0a26-42e0-9b4b-ebe7771d27d1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.152482 Mar 03 02:35:49.175350 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 460/910] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:49 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:35:49.404126 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7a39636b-8686-48c5-b728-2751aaa90ed3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:49.405061 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7a39636b-8686-48c5-b728-2751aaa90ed3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:49.411507 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7a39636b-8686-48c5-b728-2751aaa90ed3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:49.411981 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7a39636b-8686-48c5-b728-2751aaa90ed3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:49.412749 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7a39636b-8686-48c5-b728-2751aaa90ed3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:49.413182 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7a39636b-8686-48c5-b728-2751aaa90ed3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:49.440473 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7a39636b-8686-48c5-b728-2751aaa90ed3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040349 Mar 03 02:35:49.441018 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 451/911] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:49 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:49.576689 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d44b92cd-9093-4fb3-a4cc-ad5a45838f55 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:49.577624 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d44b92cd-9093-4fb3-a4cc-ad5a45838f55 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:49.583856 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d44b92cd-9093-4fb3-a4cc-ad5a45838f55 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:49.584304 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d44b92cd-9093-4fb3-a4cc-ad5a45838f55 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:49.585101 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d44b92cd-9093-4fb3-a4cc-ad5a45838f55 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:49.585532 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d44b92cd-9093-4fb3-a4cc-ad5a45838f55 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:49.613572 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d44b92cd-9093-4fb3-a4cc-ad5a45838f55 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040829 Mar 03 02:35:49.614105 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 461/912] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:49 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:49.733851 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-85712575-44db-4b52-b0f3-5e93b618e681 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:49.734762 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-85712575-44db-4b52-b0f3-5e93b618e681 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:49.741267 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-85712575-44db-4b52-b0f3-5e93b618e681 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:49.741700 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-85712575-44db-4b52-b0f3-5e93b618e681 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:49.742480 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-85712575-44db-4b52-b0f3-5e93b618e681 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:49.742920 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-85712575-44db-4b52-b0f3-5e93b618e681 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:49.770553 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-85712575-44db-4b52-b0f3-5e93b618e681 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040627 Mar 03 02:35:49.771102 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 452/913] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:49 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:50.193281 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-fd0bdb30-e2f7-435e-995e-5dafe4fd84de tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:50.193881 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-fd0bdb30-e2f7-435e-995e-5dafe4fd84de tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:50.200116 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fd0bdb30-e2f7-435e-995e-5dafe4fd84de tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:50.200563 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fd0bdb30-e2f7-435e-995e-5dafe4fd84de tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:50.201336 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fd0bdb30-e2f7-435e-995e-5dafe4fd84de tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:50.201769 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fd0bdb30-e2f7-435e-995e-5dafe4fd84de tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:50.333136 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-fd0bdb30-e2f7-435e-995e-5dafe4fd84de tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:50.341207 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-fd0bdb30-e2f7-435e-995e-5dafe4fd84de tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:50.342815 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-fd0bdb30-e2f7-435e-995e-5dafe4fd84de tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:50.344270 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-fd0bdb30-e2f7-435e-995e-5dafe4fd84de tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.155250 Mar 03 02:35:50.344819 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 462/914] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:50 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:35:50.451777 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e2b8acb1-c217-41e0-8aa0-1a77e06541b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:50.452675 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e2b8acb1-c217-41e0-8aa0-1a77e06541b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:50.459218 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e2b8acb1-c217-41e0-8aa0-1a77e06541b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:50.459702 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e2b8acb1-c217-41e0-8aa0-1a77e06541b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:50.460518 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e2b8acb1-c217-41e0-8aa0-1a77e06541b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:50.460962 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e2b8acb1-c217-41e0-8aa0-1a77e06541b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:50.488261 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e2b8acb1-c217-41e0-8aa0-1a77e06541b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040426 Mar 03 02:35:50.488804 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 453/915] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:50 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:50.625310 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8568de70-9e60-4fc5-8984-c7a3e15a9a18 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:50.626145 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8568de70-9e60-4fc5-8984-c7a3e15a9a18 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:50.632697 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8568de70-9e60-4fc5-8984-c7a3e15a9a18 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:50.633143 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8568de70-9e60-4fc5-8984-c7a3e15a9a18 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:50.633949 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8568de70-9e60-4fc5-8984-c7a3e15a9a18 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:50.634382 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8568de70-9e60-4fc5-8984-c7a3e15a9a18 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:50.661561 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8568de70-9e60-4fc5-8984-c7a3e15a9a18 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040214 Mar 03 02:35:50.662102 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 463/916] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:50 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:50.781870 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4ab7f025-c763-40cf-8c43-82fb1cf3fa61 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:50.782772 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4ab7f025-c763-40cf-8c43-82fb1cf3fa61 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:50.789184 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4ab7f025-c763-40cf-8c43-82fb1cf3fa61 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:50.789633 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4ab7f025-c763-40cf-8c43-82fb1cf3fa61 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:50.790421 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4ab7f025-c763-40cf-8c43-82fb1cf3fa61 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:50.790858 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4ab7f025-c763-40cf-8c43-82fb1cf3fa61 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:50.821642 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4ab7f025-c763-40cf-8c43-82fb1cf3fa61 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043695 Mar 03 02:35:50.822260 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 454/917] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:50 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:51.362206 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-04ecc19d-aaa8-4934-84e9-514c9aefb651 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:51.362830 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-04ecc19d-aaa8-4934-84e9-514c9aefb651 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:51.369080 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-04ecc19d-aaa8-4934-84e9-514c9aefb651 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:51.369775 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-04ecc19d-aaa8-4934-84e9-514c9aefb651 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:51.370542 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-04ecc19d-aaa8-4934-84e9-514c9aefb651 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:51.370974 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-04ecc19d-aaa8-4934-84e9-514c9aefb651 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:51.498188 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-04ecc19d-aaa8-4934-84e9-514c9aefb651 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:51.500246 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ce6f3504-065e-49f5-8bdb-f5829a8b0744 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:51.501156 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ce6f3504-065e-49f5-8bdb-f5829a8b0744 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:51.506629 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-04ecc19d-aaa8-4934-84e9-514c9aefb651 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:51.506776 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ce6f3504-065e-49f5-8bdb-f5829a8b0744 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:51.507222 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ce6f3504-065e-49f5-8bdb-f5829a8b0744 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:51.508041 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ce6f3504-065e-49f5-8bdb-f5829a8b0744 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:51.508147 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-04ecc19d-aaa8-4934-84e9-514c9aefb651 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:51.508481 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ce6f3504-065e-49f5-8bdb-f5829a8b0744 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:51.509304 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-04ecc19d-aaa8-4934-84e9-514c9aefb651 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.151042 Mar 03 02:35:51.509852 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 464/918] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:51 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:35:51.537650 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ce6f3504-065e-49f5-8bdb-f5829a8b0744 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041485 Mar 03 02:35:51.538197 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 455/919] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:51 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:35:51.673191 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-fa956f38-94c5-4174-b165-89748ac5b114 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:51.674152 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-fa956f38-94c5-4174-b165-89748ac5b114 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:51.680040 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fa956f38-94c5-4174-b165-89748ac5b114 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:51.680551 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fa956f38-94c5-4174-b165-89748ac5b114 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:51.681307 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fa956f38-94c5-4174-b165-89748ac5b114 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:51.681742 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fa956f38-94c5-4174-b165-89748ac5b114 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:51.710337 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-fa956f38-94c5-4174-b165-89748ac5b114 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041283 Mar 03 02:35:51.710872 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 465/920] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:51 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:51.833627 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8f21a621-6a00-49ab-a21c-c84c697b1dc0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:51.834525 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8f21a621-6a00-49ab-a21c-c84c697b1dc0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:51.840246 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8f21a621-6a00-49ab-a21c-c84c697b1dc0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:51.840689 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8f21a621-6a00-49ab-a21c-c84c697b1dc0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:51.841469 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8f21a621-6a00-49ab-a21c-c84c697b1dc0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:51.841867 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8f21a621-6a00-49ab-a21c-c84c697b1dc0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:51.869307 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8f21a621-6a00-49ab-a21c-c84c697b1dc0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040504 Mar 03 02:35:51.870122 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 456/921] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:51 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:52.549696 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-94fd8750-49f9-4f5a-8b8b-fb7b2948e207 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:52.550602 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-94fd8750-49f9-4f5a-8b8b-fb7b2948e207 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:52.556410 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-94fd8750-49f9-4f5a-8b8b-fb7b2948e207 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:52.556870 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-94fd8750-49f9-4f5a-8b8b-fb7b2948e207 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:52.557654 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-94fd8750-49f9-4f5a-8b8b-fb7b2948e207 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:52.558091 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-94fd8750-49f9-4f5a-8b8b-fb7b2948e207 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:52.585726 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-94fd8750-49f9-4f5a-8b8b-fb7b2948e207 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040543 Mar 03 02:35:52.586283 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 457/922] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:52 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:35:52.623437 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b25ebe8a-2839-4b8d-b588-353ce3f3a5f9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:52.624074 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b25ebe8a-2839-4b8d-b588-353ce3f3a5f9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:52.629868 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b25ebe8a-2839-4b8d-b588-353ce3f3a5f9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:52.630318 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b25ebe8a-2839-4b8d-b588-353ce3f3a5f9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:52.631089 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b25ebe8a-2839-4b8d-b588-353ce3f3a5f9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:52.631535 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b25ebe8a-2839-4b8d-b588-353ce3f3a5f9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:52.722203 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9b603523-c3a2-4a42-8002-95af2bf9e278 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:52.723115 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9b603523-c3a2-4a42-8002-95af2bf9e278 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:52.728858 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9b603523-c3a2-4a42-8002-95af2bf9e278 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:52.729311 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9b603523-c3a2-4a42-8002-95af2bf9e278 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:52.730110 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9b603523-c3a2-4a42-8002-95af2bf9e278 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:52.730551 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9b603523-c3a2-4a42-8002-95af2bf9e278 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:52.759686 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9b603523-c3a2-4a42-8002-95af2bf9e278 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041775 Mar 03 02:35:52.760255 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 458/923] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:52 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:35:52.766878 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b25ebe8a-2839-4b8d-b588-353ce3f3a5f9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:52.775139 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b25ebe8a-2839-4b8d-b588-353ce3f3a5f9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:52.776656 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b25ebe8a-2839-4b8d-b588-353ce3f3a5f9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:52.777803 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b25ebe8a-2839-4b8d-b588-353ce3f3a5f9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.254106 Mar 03 02:35:52.778342 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 466/924] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:52 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:35:52.880893 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b2bc1279-72dc-4c92-8303-bfca6c90e681 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:52.881803 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b2bc1279-72dc-4c92-8303-bfca6c90e681 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:52.887975 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b2bc1279-72dc-4c92-8303-bfca6c90e681 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:52.888422 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b2bc1279-72dc-4c92-8303-bfca6c90e681 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:52.889204 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b2bc1279-72dc-4c92-8303-bfca6c90e681 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:52.889644 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b2bc1279-72dc-4c92-8303-bfca6c90e681 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:52.919263 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b2bc1279-72dc-4c92-8303-bfca6c90e681 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042255 Mar 03 02:35:52.919990 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 459/925] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:52 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:53.598406 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d74f6b08-a8f2-4d94-b036-a33cdd3699b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:53.599240 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d74f6b08-a8f2-4d94-b036-a33cdd3699b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:53.605417 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d74f6b08-a8f2-4d94-b036-a33cdd3699b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:53.605871 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d74f6b08-a8f2-4d94-b036-a33cdd3699b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:53.606653 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d74f6b08-a8f2-4d94-b036-a33cdd3699b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:53.607092 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d74f6b08-a8f2-4d94-b036-a33cdd3699b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:53.635348 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d74f6b08-a8f2-4d94-b036-a33cdd3699b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041915 Mar 03 02:35:53.635979 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 467/926] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:53 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:53.770332 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d14f94b3-a6d1-43cc-b38b-dac60cec6a0c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:53.771226 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d14f94b3-a6d1-43cc-b38b-dac60cec6a0c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:53.776993 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d14f94b3-a6d1-43cc-b38b-dac60cec6a0c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:53.777436 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d14f94b3-a6d1-43cc-b38b-dac60cec6a0c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:53.778207 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d14f94b3-a6d1-43cc-b38b-dac60cec6a0c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:53.778637 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d14f94b3-a6d1-43cc-b38b-dac60cec6a0c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:53.796477 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-84778582-4309-48df-bf49-6edea28c764d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:53.797081 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-84778582-4309-48df-bf49-6edea28c764d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:53.803412 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-84778582-4309-48df-bf49-6edea28c764d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:53.803911 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-84778582-4309-48df-bf49-6edea28c764d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:53.804700 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-84778582-4309-48df-bf49-6edea28c764d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:53.805142 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-84778582-4309-48df-bf49-6edea28c764d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:53.806829 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d14f94b3-a6d1-43cc-b38b-dac60cec6a0c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040475 Mar 03 02:35:53.807384 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 460/927] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:53 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:53.930768 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-33698051-e2c1-44c5-85f9-22c06d830eef tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:53.931859 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-33698051-e2c1-44c5-85f9-22c06d830eef tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:53.937807 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-33698051-e2c1-44c5-85f9-22c06d830eef tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:53.938262 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-33698051-e2c1-44c5-85f9-22c06d830eef tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:53.939098 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-33698051-e2c1-44c5-85f9-22c06d830eef tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:53.939544 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-33698051-e2c1-44c5-85f9-22c06d830eef tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:53.942118 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-84778582-4309-48df-bf49-6edea28c764d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:53.950285 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-84778582-4309-48df-bf49-6edea28c764d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:53.951799 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-84778582-4309-48df-bf49-6edea28c764d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:53.952940 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-84778582-4309-48df-bf49-6edea28c764d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.160316 Mar 03 02:35:53.963488 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 468/928] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:53 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:35:53.969212 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-33698051-e2c1-44c5-85f9-22c06d830eef tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042303 Mar 03 02:35:53.969839 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 461/929] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:53 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:35:54.056723 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 02:35:54.056897 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: Thu Mar 3 02:35:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 03 02:35:54.647668 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f8da5ceb-1c21-47ee-b6c9-d19eadd66c4a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:54.648584 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f8da5ceb-1c21-47ee-b6c9-d19eadd66c4a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:54.654740 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f8da5ceb-1c21-47ee-b6c9-d19eadd66c4a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:54.655193 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f8da5ceb-1c21-47ee-b6c9-d19eadd66c4a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:54.656004 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f8da5ceb-1c21-47ee-b6c9-d19eadd66c4a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:54.656444 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f8da5ceb-1c21-47ee-b6c9-d19eadd66c4a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:54.684277 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f8da5ceb-1c21-47ee-b6c9-d19eadd66c4a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040729 Mar 03 02:35:54.684815 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 469/930] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:54 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:35:54.818939 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4beda2b8-a74b-4a2e-994d-97dd6e567795 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:54.819879 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4beda2b8-a74b-4a2e-994d-97dd6e567795 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:54.825672 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4beda2b8-a74b-4a2e-994d-97dd6e567795 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:54.826122 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4beda2b8-a74b-4a2e-994d-97dd6e567795 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:54.826904 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4beda2b8-a74b-4a2e-994d-97dd6e567795 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:54.827337 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4beda2b8-a74b-4a2e-994d-97dd6e567795 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:54.854844 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4beda2b8-a74b-4a2e-994d-97dd6e567795 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040449 Mar 03 02:35:54.855392 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 462/931] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:54 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:54.970893 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f068f371-bb52-4aa6-95b0-aff9a4ac5721 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:54.971403 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f068f371-bb52-4aa6-95b0-aff9a4ac5721 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:54.977269 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f068f371-bb52-4aa6-95b0-aff9a4ac5721 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:54.977725 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f068f371-bb52-4aa6-95b0-aff9a4ac5721 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:54.978506 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f068f371-bb52-4aa6-95b0-aff9a4ac5721 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:54.978944 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f068f371-bb52-4aa6-95b0-aff9a4ac5721 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:54.981288 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-34218b1b-e351-4b2b-82d3-674f0d6beafd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:54.982099 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-34218b1b-e351-4b2b-82d3-674f0d6beafd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:54.988369 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-34218b1b-e351-4b2b-82d3-674f0d6beafd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:54.988816 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-34218b1b-e351-4b2b-82d3-674f0d6beafd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:54.989611 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-34218b1b-e351-4b2b-82d3-674f0d6beafd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:54.990023 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-34218b1b-e351-4b2b-82d3-674f0d6beafd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:55.029845 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-34218b1b-e351-4b2b-82d3-674f0d6beafd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052420 Mar 03 02:35:55.030602 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 463/932] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:54 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:35:55.112845 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f068f371-bb52-4aa6-95b0-aff9a4ac5721 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:55.121288 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f068f371-bb52-4aa6-95b0-aff9a4ac5721 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:55.122775 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f068f371-bb52-4aa6-95b0-aff9a4ac5721 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:55.124102 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f068f371-bb52-4aa6-95b0-aff9a4ac5721 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.157255 Mar 03 02:35:55.124652 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 470/933] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:54 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:35:55.695944 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1a90038f-6682-4e93-8a99-ce7d398bd99d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:55.696844 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1a90038f-6682-4e93-8a99-ce7d398bd99d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:55.702589 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1a90038f-6682-4e93-8a99-ce7d398bd99d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:55.703032 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1a90038f-6682-4e93-8a99-ce7d398bd99d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:55.703828 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1a90038f-6682-4e93-8a99-ce7d398bd99d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:55.704264 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1a90038f-6682-4e93-8a99-ce7d398bd99d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:55.731480 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1a90038f-6682-4e93-8a99-ce7d398bd99d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039496 Mar 03 02:35:55.732053 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 464/934] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:55 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:55.866729 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d73fcd2a-75f2-4791-9ea7-6093af3b834a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:55.867569 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d73fcd2a-75f2-4791-9ea7-6093af3b834a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:55.873999 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d73fcd2a-75f2-4791-9ea7-6093af3b834a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:55.874451 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d73fcd2a-75f2-4791-9ea7-6093af3b834a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:55.875235 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d73fcd2a-75f2-4791-9ea7-6093af3b834a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:55.875707 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d73fcd2a-75f2-4791-9ea7-6093af3b834a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:55.904096 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d73fcd2a-75f2-4791-9ea7-6093af3b834a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041494 Mar 03 02:35:55.904632 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 471/935] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:55 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:56.041711 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ddead47d-a3d5-446c-9c1b-afcc9c488e81 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:56.043281 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ddead47d-a3d5-446c-9c1b-afcc9c488e81 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:56.050103 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ddead47d-a3d5-446c-9c1b-afcc9c488e81 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:56.050400 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ddead47d-a3d5-446c-9c1b-afcc9c488e81 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:56.051196 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ddead47d-a3d5-446c-9c1b-afcc9c488e81 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:56.051649 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ddead47d-a3d5-446c-9c1b-afcc9c488e81 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:56.080714 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ddead47d-a3d5-446c-9c1b-afcc9c488e81 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042418 Mar 03 02:35:56.081309 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 465/936] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:56 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:56.143712 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-27b2ba97-388d-473a-88e1-09093105eceb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:56.144240 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-27b2ba97-388d-473a-88e1-09093105eceb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:56.150099 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-27b2ba97-388d-473a-88e1-09093105eceb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:56.150549 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-27b2ba97-388d-473a-88e1-09093105eceb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:56.151319 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-27b2ba97-388d-473a-88e1-09093105eceb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:56.151784 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-27b2ba97-388d-473a-88e1-09093105eceb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:56.286021 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-27b2ba97-388d-473a-88e1-09093105eceb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:56.293955 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-27b2ba97-388d-473a-88e1-09093105eceb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:56.295431 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-27b2ba97-388d-473a-88e1-09093105eceb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:56.296606 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-27b2ba97-388d-473a-88e1-09093105eceb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.157518 Mar 03 02:35:56.297146 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 472/937] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:56 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:35:56.742922 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c1e7e726-ae24-4291-b807-175dacd7312a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:56.743870 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c1e7e726-ae24-4291-b807-175dacd7312a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:56.749860 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c1e7e726-ae24-4291-b807-175dacd7312a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:56.750305 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c1e7e726-ae24-4291-b807-175dacd7312a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:56.751076 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c1e7e726-ae24-4291-b807-175dacd7312a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:56.751512 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c1e7e726-ae24-4291-b807-175dacd7312a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:56.779368 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c1e7e726-ae24-4291-b807-175dacd7312a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040456 Mar 03 02:35:56.779942 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 466/938] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:56 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:56.915527 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7913b3d1-a840-4fd3-aa80-1f97821723b8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:56.916464 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7913b3d1-a840-4fd3-aa80-1f97821723b8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:56.922634 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7913b3d1-a840-4fd3-aa80-1f97821723b8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:56.923090 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7913b3d1-a840-4fd3-aa80-1f97821723b8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:56.924512 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7913b3d1-a840-4fd3-aa80-1f97821723b8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:56.924957 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7913b3d1-a840-4fd3-aa80-1f97821723b8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:56.952280 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7913b3d1-a840-4fd3-aa80-1f97821723b8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040691 Mar 03 02:35:56.952822 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 473/939] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:56 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:57.091999 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c35ef585-85c6-4c3c-bbf2-7c7a4949255d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:57.092904 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c35ef585-85c6-4c3c-bbf2-7c7a4949255d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:57.099949 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c35ef585-85c6-4c3c-bbf2-7c7a4949255d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:57.100374 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c35ef585-85c6-4c3c-bbf2-7c7a4949255d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:57.101339 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c35ef585-85c6-4c3c-bbf2-7c7a4949255d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:57.101577 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c35ef585-85c6-4c3c-bbf2-7c7a4949255d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:57.135789 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c35ef585-85c6-4c3c-bbf2-7c7a4949255d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047658 Mar 03 02:35:57.136273 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 467/940] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:57 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:57.314405 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b300451c-7a6a-4155-b76f-b8cd057b4f36 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:57.314931 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b300451c-7a6a-4155-b76f-b8cd057b4f36 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:57.320739 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b300451c-7a6a-4155-b76f-b8cd057b4f36 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:57.321183 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b300451c-7a6a-4155-b76f-b8cd057b4f36 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:57.321948 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b300451c-7a6a-4155-b76f-b8cd057b4f36 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:57.322377 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b300451c-7a6a-4155-b76f-b8cd057b4f36 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:57.450145 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b300451c-7a6a-4155-b76f-b8cd057b4f36 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:57.458794 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b300451c-7a6a-4155-b76f-b8cd057b4f36 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:57.460339 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b300451c-7a6a-4155-b76f-b8cd057b4f36 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:57.461491 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b300451c-7a6a-4155-b76f-b8cd057b4f36 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.151021 Mar 03 02:35:57.462025 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 474/941] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:57 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:35:57.790386 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8b623f6d-23fd-401d-a650-fdf95c16c47e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:57.791285 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8b623f6d-23fd-401d-a650-fdf95c16c47e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:57.797060 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b623f6d-23fd-401d-a650-fdf95c16c47e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:57.797501 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b623f6d-23fd-401d-a650-fdf95c16c47e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:57.798270 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b623f6d-23fd-401d-a650-fdf95c16c47e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:57.798992 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b623f6d-23fd-401d-a650-fdf95c16c47e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:57.827032 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8b623f6d-23fd-401d-a650-fdf95c16c47e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040565 Mar 03 02:35:57.827583 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 468/942] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:57 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:57.963868 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-51fd15ff-a965-404c-a4f4-bbc939a0b466 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:57.964784 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-51fd15ff-a965-404c-a4f4-bbc939a0b466 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:57.971178 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-51fd15ff-a965-404c-a4f4-bbc939a0b466 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:57.971701 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-51fd15ff-a965-404c-a4f4-bbc939a0b466 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:57.972546 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-51fd15ff-a965-404c-a4f4-bbc939a0b466 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:57.972987 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-51fd15ff-a965-404c-a4f4-bbc939a0b466 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:58.000950 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-51fd15ff-a965-404c-a4f4-bbc939a0b466 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041021 Mar 03 02:35:58.002068 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 475/943] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:57 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:58.146733 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-152c3c59-66af-4dc1-bf76-ea423270d986 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:58.147661 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-152c3c59-66af-4dc1-bf76-ea423270d986 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:58.153786 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-152c3c59-66af-4dc1-bf76-ea423270d986 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:58.154235 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-152c3c59-66af-4dc1-bf76-ea423270d986 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:58.155018 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-152c3c59-66af-4dc1-bf76-ea423270d986 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:58.155452 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-152c3c59-66af-4dc1-bf76-ea423270d986 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:58.184392 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-152c3c59-66af-4dc1-bf76-ea423270d986 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041538 Mar 03 02:35:58.184947 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 469/944] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:58 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:58.479902 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5ce96f4a-c6be-4d3e-96af-eff0a952ea85 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:58.480496 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5ce96f4a-c6be-4d3e-96af-eff0a952ea85 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:58.486910 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5ce96f4a-c6be-4d3e-96af-eff0a952ea85 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:58.487448 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5ce96f4a-c6be-4d3e-96af-eff0a952ea85 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:58.488249 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5ce96f4a-c6be-4d3e-96af-eff0a952ea85 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:58.488683 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5ce96f4a-c6be-4d3e-96af-eff0a952ea85 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:58.627879 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5ce96f4a-c6be-4d3e-96af-eff0a952ea85 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:58.636357 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5ce96f4a-c6be-4d3e-96af-eff0a952ea85 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:58.637965 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5ce96f4a-c6be-4d3e-96af-eff0a952ea85 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:58.639309 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5ce96f4a-c6be-4d3e-96af-eff0a952ea85 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.163243 Mar 03 02:35:58.643212 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 476/945] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:58 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:35:58.838419 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f5806635-a93e-47a0-9ff1-d4710c03a5cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:58.839317 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f5806635-a93e-47a0-9ff1-d4710c03a5cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:58.845034 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f5806635-a93e-47a0-9ff1-d4710c03a5cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:58.845629 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f5806635-a93e-47a0-9ff1-d4710c03a5cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:58.846469 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f5806635-a93e-47a0-9ff1-d4710c03a5cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:58.846903 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f5806635-a93e-47a0-9ff1-d4710c03a5cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:58.875102 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f5806635-a93e-47a0-9ff1-d4710c03a5cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040652 Mar 03 02:35:58.875657 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 470/946] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:58 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:59.013352 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2a4f9d4d-94d9-427f-adde-c451b203e692 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:59.014260 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2a4f9d4d-94d9-427f-adde-c451b203e692 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:59.020690 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2a4f9d4d-94d9-427f-adde-c451b203e692 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:59.021150 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2a4f9d4d-94d9-427f-adde-c451b203e692 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:59.021932 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2a4f9d4d-94d9-427f-adde-c451b203e692 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:59.022369 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2a4f9d4d-94d9-427f-adde-c451b203e692 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:59.050323 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2a4f9d4d-94d9-427f-adde-c451b203e692 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041050 Mar 03 02:35:59.050875 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 477/947] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:59 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:59.196617 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d6444599-ae3a-4046-9a21-95f4b05d0cb2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:59.197676 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d6444599-ae3a-4046-9a21-95f4b05d0cb2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:59.203831 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d6444599-ae3a-4046-9a21-95f4b05d0cb2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:59.204274 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d6444599-ae3a-4046-9a21-95f4b05d0cb2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:59.205465 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d6444599-ae3a-4046-9a21-95f4b05d0cb2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:59.205807 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d6444599-ae3a-4046-9a21-95f4b05d0cb2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:59.234566 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d6444599-ae3a-4046-9a21-95f4b05d0cb2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041803 Mar 03 02:35:59.235642 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 471/948] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:59 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:35:59.659277 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d3255a3d-ca37-4e93-a9f9-697faf62c61e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:59.659930 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d3255a3d-ca37-4e93-a9f9-697faf62c61e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:59.665688 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d3255a3d-ca37-4e93-a9f9-697faf62c61e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:59.666131 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d3255a3d-ca37-4e93-a9f9-697faf62c61e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:59.666899 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d3255a3d-ca37-4e93-a9f9-697faf62c61e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:59.667330 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d3255a3d-ca37-4e93-a9f9-697faf62c61e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:59.798428 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d3255a3d-ca37-4e93-a9f9-697faf62c61e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:59.806466 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d3255a3d-ca37-4e93-a9f9-697faf62c61e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:59.807976 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d3255a3d-ca37-4e93-a9f9-697faf62c61e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:35:59.809119 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d3255a3d-ca37-4e93-a9f9-697faf62c61e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.154481 Mar 03 02:35:59.809950 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 478/949] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:35:59 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:35:59.888400 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e4e40406-630b-471b-b1e3-c8f5bc2f1ffb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:35:59.889877 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e4e40406-630b-471b-b1e3-c8f5bc2f1ffb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:35:59.897501 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e4e40406-630b-471b-b1e3-c8f5bc2f1ffb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:59.897945 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e4e40406-630b-471b-b1e3-c8f5bc2f1ffb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:59.898722 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e4e40406-630b-471b-b1e3-c8f5bc2f1ffb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:35:59.899151 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e4e40406-630b-471b-b1e3-c8f5bc2f1ffb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:35:59.926519 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e4e40406-630b-471b-b1e3-c8f5bc2f1ffb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042945 Mar 03 02:35:59.926990 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 472/950] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:35:59 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:36:00.062180 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-afc37140-4d69-47ee-89d7-082d41256c8e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:00.063082 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-afc37140-4d69-47ee-89d7-082d41256c8e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:00.070136 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-afc37140-4d69-47ee-89d7-082d41256c8e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:00.070581 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-afc37140-4d69-47ee-89d7-082d41256c8e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:00.071399 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-afc37140-4d69-47ee-89d7-082d41256c8e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:00.071862 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-afc37140-4d69-47ee-89d7-082d41256c8e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:00.103253 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-afc37140-4d69-47ee-89d7-082d41256c8e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044752 Mar 03 02:36:00.103985 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 479/951] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:00 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:00.246636 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c318a989-ed27-446b-8af6-18558d31549b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:00.247662 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c318a989-ed27-446b-8af6-18558d31549b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:00.254718 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c318a989-ed27-446b-8af6-18558d31549b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:00.255169 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c318a989-ed27-446b-8af6-18558d31549b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:00.255981 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c318a989-ed27-446b-8af6-18558d31549b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:00.256441 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c318a989-ed27-446b-8af6-18558d31549b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:00.293621 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c318a989-ed27-446b-8af6-18558d31549b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051055 Mar 03 02:36:00.294238 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 473/952] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:00 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:00.827979 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-84658e1b-8ae7-4cfe-a178-0d78118b31ff tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:00.828587 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-84658e1b-8ae7-4cfe-a178-0d78118b31ff tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:00.835173 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-84658e1b-8ae7-4cfe-a178-0d78118b31ff tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:00.835647 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-84658e1b-8ae7-4cfe-a178-0d78118b31ff tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:00.836439 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-84658e1b-8ae7-4cfe-a178-0d78118b31ff tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:00.836877 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-84658e1b-8ae7-4cfe-a178-0d78118b31ff tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:00.937918 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-bcdb69f9-d320-4728-b0ca-dfbae182094b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:00.938832 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-bcdb69f9-d320-4728-b0ca-dfbae182094b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:00.945532 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bcdb69f9-d320-4728-b0ca-dfbae182094b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:00.945986 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bcdb69f9-d320-4728-b0ca-dfbae182094b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:00.946781 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bcdb69f9-d320-4728-b0ca-dfbae182094b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:00.947228 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bcdb69f9-d320-4728-b0ca-dfbae182094b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:00.969805 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-84658e1b-8ae7-4cfe-a178-0d78118b31ff tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:00.975960 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-bcdb69f9-d320-4728-b0ca-dfbae182094b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041967 Mar 03 02:36:00.976533 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 474/953] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:00 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:36:00.978474 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-84658e1b-8ae7-4cfe-a178-0d78118b31ff tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:00.979993 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-84658e1b-8ae7-4cfe-a178-0d78118b31ff tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:00.981168 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-84658e1b-8ae7-4cfe-a178-0d78118b31ff tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.157176 Mar 03 02:36:00.981706 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 480/954] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:00 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:36:01.114945 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-cd824b38-07e4-473f-adc6-cd33be29d3a9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:01.115823 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-cd824b38-07e4-473f-adc6-cd33be29d3a9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:01.121953 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cd824b38-07e4-473f-adc6-cd33be29d3a9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:01.122404 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cd824b38-07e4-473f-adc6-cd33be29d3a9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:01.123184 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cd824b38-07e4-473f-adc6-cd33be29d3a9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:01.123644 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cd824b38-07e4-473f-adc6-cd33be29d3a9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:01.153407 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-cd824b38-07e4-473f-adc6-cd33be29d3a9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043095 Mar 03 02:36:01.153962 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 475/955] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:01 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:01.307654 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1e1950f5-61a8-4222-b3c1-fb56123e9e60 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:01.308574 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1e1950f5-61a8-4222-b3c1-fb56123e9e60 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:01.315292 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1e1950f5-61a8-4222-b3c1-fb56123e9e60 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:01.315786 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1e1950f5-61a8-4222-b3c1-fb56123e9e60 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:01.316656 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1e1950f5-61a8-4222-b3c1-fb56123e9e60 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:01.317092 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1e1950f5-61a8-4222-b3c1-fb56123e9e60 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:01.346462 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1e1950f5-61a8-4222-b3c1-fb56123e9e60 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042769 Mar 03 02:36:01.347171 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 481/956] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:01 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:01.988511 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9ee608e2-e62e-42bd-8565-45f09d059964 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:01.989446 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9ee608e2-e62e-42bd-8565-45f09d059964 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:01.995937 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9ee608e2-e62e-42bd-8565-45f09d059964 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:01.996394 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9ee608e2-e62e-42bd-8565-45f09d059964 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:01.997182 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9ee608e2-e62e-42bd-8565-45f09d059964 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:01.997620 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9ee608e2-e62e-42bd-8565-45f09d059964 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:01.998592 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6eada0d5-6968-44aa-b9b2-ab761d21f601 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:01.999198 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6eada0d5-6968-44aa-b9b2-ab761d21f601 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:02.005756 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6eada0d5-6968-44aa-b9b2-ab761d21f601 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:02.006199 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6eada0d5-6968-44aa-b9b2-ab761d21f601 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:02.007015 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6eada0d5-6968-44aa-b9b2-ab761d21f601 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:02.007446 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6eada0d5-6968-44aa-b9b2-ab761d21f601 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:02.026839 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9ee608e2-e62e-42bd-8565-45f09d059964 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043299 Mar 03 02:36:02.027399 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 476/957] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:01 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:02.136793 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-6eada0d5-6968-44aa-b9b2-ab761d21f601 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:02.145262 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-6eada0d5-6968-44aa-b9b2-ab761d21f601 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:02.146788 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-6eada0d5-6968-44aa-b9b2-ab761d21f601 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:02.147981 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6eada0d5-6968-44aa-b9b2-ab761d21f601 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.153598 Mar 03 02:36:02.148535 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 482/958] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:01 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:36:02.164989 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-39fd75fc-c733-466e-9ab9-4f00727301b4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:02.165881 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-39fd75fc-c733-466e-9ab9-4f00727301b4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:02.171669 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-39fd75fc-c733-466e-9ab9-4f00727301b4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:02.172119 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-39fd75fc-c733-466e-9ab9-4f00727301b4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:02.172883 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-39fd75fc-c733-466e-9ab9-4f00727301b4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:02.174139 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-39fd75fc-c733-466e-9ab9-4f00727301b4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:02.201218 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-39fd75fc-c733-466e-9ab9-4f00727301b4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040326 Mar 03 02:36:02.201757 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 477/959] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:02 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:02.358145 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-37735467-4df8-479c-909f-78fac417ae3e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:02.359049 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-37735467-4df8-479c-909f-78fac417ae3e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:02.366051 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-37735467-4df8-479c-909f-78fac417ae3e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:02.366497 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-37735467-4df8-479c-909f-78fac417ae3e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:02.367306 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-37735467-4df8-479c-909f-78fac417ae3e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:02.367779 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-37735467-4df8-479c-909f-78fac417ae3e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:02.395499 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-37735467-4df8-479c-909f-78fac417ae3e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041240 Mar 03 02:36:02.398185 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 483/960] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:02 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:03.037650 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1585cd1f-3346-41e1-9fc2-7135e71d82bc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:03.038574 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1585cd1f-3346-41e1-9fc2-7135e71d82bc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:03.044814 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1585cd1f-3346-41e1-9fc2-7135e71d82bc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:03.045266 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1585cd1f-3346-41e1-9fc2-7135e71d82bc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:03.046028 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1585cd1f-3346-41e1-9fc2-7135e71d82bc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:03.046458 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1585cd1f-3346-41e1-9fc2-7135e71d82bc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:03.075866 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1585cd1f-3346-41e1-9fc2-7135e71d82bc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042079 Mar 03 02:36:03.076423 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 478/961] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:03 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:03.167323 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ee2c82b4-88fa-435a-8998-9e39a3cd953f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:03.168055 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ee2c82b4-88fa-435a-8998-9e39a3cd953f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:03.174391 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ee2c82b4-88fa-435a-8998-9e39a3cd953f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:03.174892 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ee2c82b4-88fa-435a-8998-9e39a3cd953f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:03.175778 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ee2c82b4-88fa-435a-8998-9e39a3cd953f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:03.176274 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ee2c82b4-88fa-435a-8998-9e39a3cd953f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:03.212397 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-fc4bf15d-d2b3-4648-8933-a6e4c52b9689 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:03.213371 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-fc4bf15d-d2b3-4648-8933-a6e4c52b9689 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:03.219466 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fc4bf15d-d2b3-4648-8933-a6e4c52b9689 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:03.220023 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fc4bf15d-d2b3-4648-8933-a6e4c52b9689 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:03.220858 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fc4bf15d-d2b3-4648-8933-a6e4c52b9689 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:03.221318 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fc4bf15d-d2b3-4648-8933-a6e4c52b9689 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:03.249541 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-fc4bf15d-d2b3-4648-8933-a6e4c52b9689 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040929 Mar 03 02:36:03.250104 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 479/962] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:03 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:36:03.309758 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ee2c82b4-88fa-435a-8998-9e39a3cd953f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:03.318621 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ee2c82b4-88fa-435a-8998-9e39a3cd953f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:03.320150 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ee2c82b4-88fa-435a-8998-9e39a3cd953f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:03.321297 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ee2c82b4-88fa-435a-8998-9e39a3cd953f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.158457 Mar 03 02:36:03.321847 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 484/963] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:03 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:36:03.406169 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-35353d74-eace-4814-9355-66b0bf02bc36 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:03.407210 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-35353d74-eace-4814-9355-66b0bf02bc36 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:03.413605 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-35353d74-eace-4814-9355-66b0bf02bc36 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:03.414053 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-35353d74-eace-4814-9355-66b0bf02bc36 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:03.414826 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-35353d74-eace-4814-9355-66b0bf02bc36 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:03.415259 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-35353d74-eace-4814-9355-66b0bf02bc36 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:03.442773 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-35353d74-eace-4814-9355-66b0bf02bc36 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040440 Mar 03 02:36:03.443333 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 480/964] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:03 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:04.087896 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c72c8954-4692-4fba-ad6c-92caa4306bb0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:04.088808 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c72c8954-4692-4fba-ad6c-92caa4306bb0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:04.094992 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c72c8954-4692-4fba-ad6c-92caa4306bb0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:04.095751 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c72c8954-4692-4fba-ad6c-92caa4306bb0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:04.096550 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c72c8954-4692-4fba-ad6c-92caa4306bb0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:04.096989 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c72c8954-4692-4fba-ad6c-92caa4306bb0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:04.124877 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c72c8954-4692-4fba-ad6c-92caa4306bb0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040963 Mar 03 02:36:04.125409 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 485/965] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:04 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:04.261459 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f9eaa174-a463-4aad-82f5-be207fc5ba90 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:04.262357 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f9eaa174-a463-4aad-82f5-be207fc5ba90 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:04.268617 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f9eaa174-a463-4aad-82f5-be207fc5ba90 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:04.269060 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f9eaa174-a463-4aad-82f5-be207fc5ba90 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:04.269825 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f9eaa174-a463-4aad-82f5-be207fc5ba90 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:04.270257 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f9eaa174-a463-4aad-82f5-be207fc5ba90 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:04.297108 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f9eaa174-a463-4aad-82f5-be207fc5ba90 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039572 Mar 03 02:36:04.297646 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 481/966] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:04 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:04.340186 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e9ed13af-fb49-4e67-8bf6-c7fb5f1fed9c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:04.340786 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e9ed13af-fb49-4e67-8bf6-c7fb5f1fed9c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:04.346577 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e9ed13af-fb49-4e67-8bf6-c7fb5f1fed9c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:04.347024 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e9ed13af-fb49-4e67-8bf6-c7fb5f1fed9c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:04.347833 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e9ed13af-fb49-4e67-8bf6-c7fb5f1fed9c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:04.348275 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e9ed13af-fb49-4e67-8bf6-c7fb5f1fed9c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:04.454513 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d3220319-201e-4d4f-b310-6f20fb7bcaf2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:04.455641 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d3220319-201e-4d4f-b310-6f20fb7bcaf2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:04.461371 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d3220319-201e-4d4f-b310-6f20fb7bcaf2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:04.462167 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d3220319-201e-4d4f-b310-6f20fb7bcaf2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:04.462610 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d3220319-201e-4d4f-b310-6f20fb7bcaf2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:04.463041 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d3220319-201e-4d4f-b310-6f20fb7bcaf2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:04.483210 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e9ed13af-fb49-4e67-8bf6-c7fb5f1fed9c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:04.493672 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e9ed13af-fb49-4e67-8bf6-c7fb5f1fed9c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:04.495644 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e9ed13af-fb49-4e67-8bf6-c7fb5f1fed9c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:04.496963 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e9ed13af-fb49-4e67-8bf6-c7fb5f1fed9c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.160605 Mar 03 02:36:04.497780 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 486/967] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:04 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:36:04.501246 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d3220319-201e-4d4f-b310-6f20fb7bcaf2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050588 Mar 03 02:36:04.505061 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 482/968] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:04 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:05.137207 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8779ab34-e541-424c-8b8f-1347618c51d1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:05.138111 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8779ab34-e541-424c-8b8f-1347618c51d1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:05.144857 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8779ab34-e541-424c-8b8f-1347618c51d1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:05.145302 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8779ab34-e541-424c-8b8f-1347618c51d1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:05.146072 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8779ab34-e541-424c-8b8f-1347618c51d1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:05.146504 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8779ab34-e541-424c-8b8f-1347618c51d1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:05.174690 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8779ab34-e541-424c-8b8f-1347618c51d1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041433 Mar 03 02:36:05.175254 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 487/969] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:05 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:05.309166 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f97cc4f3-f976-409a-8193-b1e560592a74 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:05.310099 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f97cc4f3-f976-409a-8193-b1e560592a74 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:05.317122 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f97cc4f3-f976-409a-8193-b1e560592a74 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:05.317578 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f97cc4f3-f976-409a-8193-b1e560592a74 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:05.318352 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f97cc4f3-f976-409a-8193-b1e560592a74 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:05.318791 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f97cc4f3-f976-409a-8193-b1e560592a74 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:05.347290 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f97cc4f3-f976-409a-8193-b1e560592a74 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042048 Mar 03 02:36:05.347925 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 483/970] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:05 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:05.512686 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7fc5dc07-12c0-497e-93cc-1ab48d67fdf6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:05.513735 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7fc5dc07-12c0-497e-93cc-1ab48d67fdf6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:05.515701 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-43a4fdf7-856a-40ec-bcb5-6f28cb7a0eaa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:05.516307 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-43a4fdf7-856a-40ec-bcb5-6f28cb7a0eaa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:05.520759 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7fc5dc07-12c0-497e-93cc-1ab48d67fdf6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:05.521216 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7fc5dc07-12c0-497e-93cc-1ab48d67fdf6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:05.522007 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7fc5dc07-12c0-497e-93cc-1ab48d67fdf6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:05.522447 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7fc5dc07-12c0-497e-93cc-1ab48d67fdf6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:05.522879 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-43a4fdf7-856a-40ec-bcb5-6f28cb7a0eaa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:05.523338 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-43a4fdf7-856a-40ec-bcb5-6f28cb7a0eaa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:05.524169 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-43a4fdf7-856a-40ec-bcb5-6f28cb7a0eaa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:05.524613 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-43a4fdf7-856a-40ec-bcb5-6f28cb7a0eaa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:05.552786 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7fc5dc07-12c0-497e-93cc-1ab48d67fdf6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043931 Mar 03 02:36:05.556630 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 488/971] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:05 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:05.713486 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-43a4fdf7-856a-40ec-bcb5-6f28cb7a0eaa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:05.721674 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-43a4fdf7-856a-40ec-bcb5-6f28cb7a0eaa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:05.723163 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-43a4fdf7-856a-40ec-bcb5-6f28cb7a0eaa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:05.724364 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-43a4fdf7-856a-40ec-bcb5-6f28cb7a0eaa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.212535 Mar 03 02:36:05.724916 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 484/972] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:05 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:36:06.278455 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a066cd6c-73d5-44eb-81cf-110b2e73e165 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:06.279447 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a066cd6c-73d5-44eb-81cf-110b2e73e165 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:06.286069 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a066cd6c-73d5-44eb-81cf-110b2e73e165 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:06.286519 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a066cd6c-73d5-44eb-81cf-110b2e73e165 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:06.287305 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a066cd6c-73d5-44eb-81cf-110b2e73e165 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:06.287806 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a066cd6c-73d5-44eb-81cf-110b2e73e165 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:06.317200 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a066cd6c-73d5-44eb-81cf-110b2e73e165 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134615 Mar 03 02:36:06.317717 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 489/973] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:06 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:06.358172 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-04291e40-d7a8-4d54-a71f-306ff9b509ea tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:06.359076 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-04291e40-d7a8-4d54-a71f-306ff9b509ea tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:06.365356 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-04291e40-d7a8-4d54-a71f-306ff9b509ea tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:06.365806 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-04291e40-d7a8-4d54-a71f-306ff9b509ea tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:06.366585 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-04291e40-d7a8-4d54-a71f-306ff9b509ea tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:06.367016 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-04291e40-d7a8-4d54-a71f-306ff9b509ea tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:06.395155 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-04291e40-d7a8-4d54-a71f-306ff9b509ea tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040830 Mar 03 02:36:06.395723 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 485/974] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:06 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:36:06.564306 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-fcf1a006-7dc1-46df-905a-4436245eaafd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:06.565254 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-fcf1a006-7dc1-46df-905a-4436245eaafd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:06.571302 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fcf1a006-7dc1-46df-905a-4436245eaafd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:06.571742 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fcf1a006-7dc1-46df-905a-4436245eaafd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:06.572537 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fcf1a006-7dc1-46df-905a-4436245eaafd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:06.572982 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fcf1a006-7dc1-46df-905a-4436245eaafd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:06.609108 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-fcf1a006-7dc1-46df-905a-4436245eaafd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048982 Mar 03 02:36:06.609848 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 490/975] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:06 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:06.742308 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8a8c8140-6b41-4c09-b08c-7af608abb98c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:06.742905 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8a8c8140-6b41-4c09-b08c-7af608abb98c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:06.749010 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8a8c8140-6b41-4c09-b08c-7af608abb98c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:06.749455 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8a8c8140-6b41-4c09-b08c-7af608abb98c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:06.750225 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8a8c8140-6b41-4c09-b08c-7af608abb98c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:06.750657 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8a8c8140-6b41-4c09-b08c-7af608abb98c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:06.881136 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8a8c8140-6b41-4c09-b08c-7af608abb98c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:06.889268 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8a8c8140-6b41-4c09-b08c-7af608abb98c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:06.890773 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8a8c8140-6b41-4c09-b08c-7af608abb98c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:06.892565 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8a8c8140-6b41-4c09-b08c-7af608abb98c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.153478 Mar 03 02:36:06.893276 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 486/976] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:06 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:36:07.328566 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7cef54b7-23bb-45f3-8b40-29a2516e13ce tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:07.329966 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7cef54b7-23bb-45f3-8b40-29a2516e13ce tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:07.336137 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7cef54b7-23bb-45f3-8b40-29a2516e13ce tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:07.336583 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7cef54b7-23bb-45f3-8b40-29a2516e13ce tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:07.337390 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7cef54b7-23bb-45f3-8b40-29a2516e13ce tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:07.338009 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7cef54b7-23bb-45f3-8b40-29a2516e13ce tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:07.365659 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7cef54b7-23bb-45f3-8b40-29a2516e13ce tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041107 Mar 03 02:36:07.366202 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 491/977] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:07 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:07.406197 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7d92a3a8-5158-432c-b4db-feb53a2a0923 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:07.407098 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7d92a3a8-5158-432c-b4db-feb53a2a0923 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:07.413822 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7d92a3a8-5158-432c-b4db-feb53a2a0923 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:07.414260 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7d92a3a8-5158-432c-b4db-feb53a2a0923 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:07.415028 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7d92a3a8-5158-432c-b4db-feb53a2a0923 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:07.415464 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7d92a3a8-5158-432c-b4db-feb53a2a0923 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:07.442917 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7d92a3a8-5158-432c-b4db-feb53a2a0923 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040615 Mar 03 02:36:07.443458 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 487/978] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:07 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:07.620783 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-150ab407-55bb-4242-846c-ee3a077a1069 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:07.621733 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-150ab407-55bb-4242-846c-ee3a077a1069 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:07.628168 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-150ab407-55bb-4242-846c-ee3a077a1069 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:07.628622 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-150ab407-55bb-4242-846c-ee3a077a1069 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:07.629420 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-150ab407-55bb-4242-846c-ee3a077a1069 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:07.629874 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-150ab407-55bb-4242-846c-ee3a077a1069 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:07.658320 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-150ab407-55bb-4242-846c-ee3a077a1069 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041763 Mar 03 02:36:07.658992 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 492/979] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:07 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:07.911133 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9f4cfd8d-933c-4310-946e-60c7cfb76ce3 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:07.911775 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9f4cfd8d-933c-4310-946e-60c7cfb76ce3 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:07.917555 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9f4cfd8d-933c-4310-946e-60c7cfb76ce3 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:07.917999 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9f4cfd8d-933c-4310-946e-60c7cfb76ce3 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:07.918769 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9f4cfd8d-933c-4310-946e-60c7cfb76ce3 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:07.919187 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9f4cfd8d-933c-4310-946e-60c7cfb76ce3 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:08.051390 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9f4cfd8d-933c-4310-946e-60c7cfb76ce3 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:08.059636 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9f4cfd8d-933c-4310-946e-60c7cfb76ce3 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:08.061140 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9f4cfd8d-933c-4310-946e-60c7cfb76ce3 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:08.062292 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9f4cfd8d-933c-4310-946e-60c7cfb76ce3 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.155213 Mar 03 02:36:08.062851 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 488/980] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:07 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:36:08.377589 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8ed61bd7-f4d6-4546-8c9f-ec58c3603212 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:08.378501 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8ed61bd7-f4d6-4546-8c9f-ec58c3603212 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:08.384733 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8ed61bd7-f4d6-4546-8c9f-ec58c3603212 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:08.385185 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8ed61bd7-f4d6-4546-8c9f-ec58c3603212 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:08.385965 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8ed61bd7-f4d6-4546-8c9f-ec58c3603212 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:08.386474 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8ed61bd7-f4d6-4546-8c9f-ec58c3603212 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:08.414425 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8ed61bd7-f4d6-4546-8c9f-ec58c3603212 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041296 Mar 03 02:36:08.414972 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 493/981] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:08 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:08.454108 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e2d1b541-ddb6-4f2d-9920-65e55ad0cf8b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:08.455141 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e2d1b541-ddb6-4f2d-9920-65e55ad0cf8b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:08.461351 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e2d1b541-ddb6-4f2d-9920-65e55ad0cf8b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:08.461802 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e2d1b541-ddb6-4f2d-9920-65e55ad0cf8b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:08.462612 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e2d1b541-ddb6-4f2d-9920-65e55ad0cf8b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:08.463055 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e2d1b541-ddb6-4f2d-9920-65e55ad0cf8b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:08.491254 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e2d1b541-ddb6-4f2d-9920-65e55ad0cf8b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041083 Mar 03 02:36:08.491828 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 489/982] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:08 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:08.669412 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f5ebafe3-fb2d-424b-86c6-da5c0b53b2dc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:08.670325 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f5ebafe3-fb2d-424b-86c6-da5c0b53b2dc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:08.676405 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f5ebafe3-fb2d-424b-86c6-da5c0b53b2dc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:08.676971 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f5ebafe3-fb2d-424b-86c6-da5c0b53b2dc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:08.678011 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f5ebafe3-fb2d-424b-86c6-da5c0b53b2dc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:08.678595 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f5ebafe3-fb2d-424b-86c6-da5c0b53b2dc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:08.709239 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f5ebafe3-fb2d-424b-86c6-da5c0b53b2dc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043964 Mar 03 02:36:08.709799 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 494/983] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:08 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:09.081486 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b5d0d41e-9347-4da4-9075-42c8bea7a9ec tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:09.082091 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b5d0d41e-9347-4da4-9075-42c8bea7a9ec tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:09.087914 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b5d0d41e-9347-4da4-9075-42c8bea7a9ec tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:09.088362 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b5d0d41e-9347-4da4-9075-42c8bea7a9ec tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:09.089169 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b5d0d41e-9347-4da4-9075-42c8bea7a9ec tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:09.089607 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b5d0d41e-9347-4da4-9075-42c8bea7a9ec tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:09.221023 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b5d0d41e-9347-4da4-9075-42c8bea7a9ec tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:09.229156 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b5d0d41e-9347-4da4-9075-42c8bea7a9ec tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:09.230642 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b5d0d41e-9347-4da4-9075-42c8bea7a9ec tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:09.231820 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b5d0d41e-9347-4da4-9075-42c8bea7a9ec tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.154975 Mar 03 02:36:09.232386 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 490/984] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:09 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:36:09.426335 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5364b007-1afb-4234-831b-5f1c74e8a4a7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:09.427236 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5364b007-1afb-4234-831b-5f1c74e8a4a7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:09.433562 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5364b007-1afb-4234-831b-5f1c74e8a4a7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:09.434009 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5364b007-1afb-4234-831b-5f1c74e8a4a7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:09.434776 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5364b007-1afb-4234-831b-5f1c74e8a4a7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:09.435210 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5364b007-1afb-4234-831b-5f1c74e8a4a7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:09.463071 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5364b007-1afb-4234-831b-5f1c74e8a4a7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041178 Mar 03 02:36:09.463623 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 495/985] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:09 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:09.502690 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-70c7687a-7897-42a5-8df9-7840916fe16e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:09.503592 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-70c7687a-7897-42a5-8df9-7840916fe16e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:09.509795 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-70c7687a-7897-42a5-8df9-7840916fe16e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:09.510252 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-70c7687a-7897-42a5-8df9-7840916fe16e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:09.511030 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-70c7687a-7897-42a5-8df9-7840916fe16e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:09.511469 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-70c7687a-7897-42a5-8df9-7840916fe16e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:09.539064 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-70c7687a-7897-42a5-8df9-7840916fe16e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040958 Mar 03 02:36:09.539613 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 491/986] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:09 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:09.721407 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-607394d8-a920-4291-ae5d-2972d79065f3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:09.722382 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-607394d8-a920-4291-ae5d-2972d79065f3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:09.728256 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-607394d8-a920-4291-ae5d-2972d79065f3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:09.728708 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-607394d8-a920-4291-ae5d-2972d79065f3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:09.729488 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-607394d8-a920-4291-ae5d-2972d79065f3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:09.729927 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-607394d8-a920-4291-ae5d-2972d79065f3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:09.758050 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-607394d8-a920-4291-ae5d-2972d79065f3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041125 Mar 03 02:36:09.758592 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 496/987] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:09 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:10.250458 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ccce73a8-bf40-4158-8631-dce692b6befd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:10.251057 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ccce73a8-bf40-4158-8631-dce692b6befd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:10.257737 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ccce73a8-bf40-4158-8631-dce692b6befd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:10.258183 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ccce73a8-bf40-4158-8631-dce692b6befd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:10.258956 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ccce73a8-bf40-4158-8631-dce692b6befd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:10.259387 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ccce73a8-bf40-4158-8631-dce692b6befd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:10.386886 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ccce73a8-bf40-4158-8631-dce692b6befd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:10.395281 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ccce73a8-bf40-4158-8631-dce692b6befd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:10.396782 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ccce73a8-bf40-4158-8631-dce692b6befd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:10.397932 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ccce73a8-bf40-4158-8631-dce692b6befd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.151376 Mar 03 02:36:10.398473 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 492/988] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:10 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:36:10.474445 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-56c1941d-4c84-4bdf-b0b3-49e562f5d4e5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:10.475359 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-56c1941d-4c84-4bdf-b0b3-49e562f5d4e5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:10.481621 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-56c1941d-4c84-4bdf-b0b3-49e562f5d4e5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:10.482078 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-56c1941d-4c84-4bdf-b0b3-49e562f5d4e5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:10.482860 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-56c1941d-4c84-4bdf-b0b3-49e562f5d4e5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:10.483301 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-56c1941d-4c84-4bdf-b0b3-49e562f5d4e5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:10.511722 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-56c1941d-4c84-4bdf-b0b3-49e562f5d4e5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041903 Mar 03 02:36:10.512275 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 497/989] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:10 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:10.551095 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2eb1d8a5-9571-4bce-a84b-035b8fbe53ca tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:10.552038 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2eb1d8a5-9571-4bce-a84b-035b8fbe53ca tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:10.558691 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2eb1d8a5-9571-4bce-a84b-035b8fbe53ca tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:10.559132 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2eb1d8a5-9571-4bce-a84b-035b8fbe53ca tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:10.559939 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2eb1d8a5-9571-4bce-a84b-035b8fbe53ca tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:10.560373 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2eb1d8a5-9571-4bce-a84b-035b8fbe53ca tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:10.587626 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2eb1d8a5-9571-4bce-a84b-035b8fbe53ca tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041091 Mar 03 02:36:10.588101 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 493/990] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:10 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:10.769645 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-be959163-2880-43d3-a578-5e7d097fbd19 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:10.770601 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-be959163-2880-43d3-a578-5e7d097fbd19 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:10.776552 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-be959163-2880-43d3-a578-5e7d097fbd19 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:10.777005 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-be959163-2880-43d3-a578-5e7d097fbd19 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:10.777778 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-be959163-2880-43d3-a578-5e7d097fbd19 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:10.778218 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-be959163-2880-43d3-a578-5e7d097fbd19 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:10.806228 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-be959163-2880-43d3-a578-5e7d097fbd19 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040618 Mar 03 02:36:10.806772 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 498/991] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:10 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:11.416318 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-fed22b95-e8b3-4f48-8580-877b7c83b6af tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:11.416928 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-fed22b95-e8b3-4f48-8580-877b7c83b6af tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:11.422755 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fed22b95-e8b3-4f48-8580-877b7c83b6af tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:11.423318 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fed22b95-e8b3-4f48-8580-877b7c83b6af tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:11.424583 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fed22b95-e8b3-4f48-8580-877b7c83b6af tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:11.425022 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fed22b95-e8b3-4f48-8580-877b7c83b6af tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:11.524242 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-25c238a3-3f30-4787-90b5-f36fb0bcfab1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:11.525336 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-25c238a3-3f30-4787-90b5-f36fb0bcfab1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:11.531525 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-25c238a3-3f30-4787-90b5-f36fb0bcfab1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:11.532011 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-25c238a3-3f30-4787-90b5-f36fb0bcfab1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:11.532848 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-25c238a3-3f30-4787-90b5-f36fb0bcfab1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:11.533297 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-25c238a3-3f30-4787-90b5-f36fb0bcfab1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:11.557309 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-fed22b95-e8b3-4f48-8580-877b7c83b6af tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:11.561871 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-25c238a3-3f30-4787-90b5-f36fb0bcfab1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041332 Mar 03 02:36:11.562443 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 499/992] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:11 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:36:11.566689 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-fed22b95-e8b3-4f48-8580-877b7c83b6af tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:11.568204 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-fed22b95-e8b3-4f48-8580-877b7c83b6af tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:11.569336 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-fed22b95-e8b3-4f48-8580-877b7c83b6af tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.156961 Mar 03 02:36:11.569873 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 494/993] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:11 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:36:11.598214 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7566e3dc-4059-48ec-aeb0-1edc58455879 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:11.599056 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7566e3dc-4059-48ec-aeb0-1edc58455879 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:11.604798 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7566e3dc-4059-48ec-aeb0-1edc58455879 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:11.605249 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7566e3dc-4059-48ec-aeb0-1edc58455879 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:11.606019 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7566e3dc-4059-48ec-aeb0-1edc58455879 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:11.606450 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7566e3dc-4059-48ec-aeb0-1edc58455879 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:11.635559 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7566e3dc-4059-48ec-aeb0-1edc58455879 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041173 Mar 03 02:36:11.636114 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 500/994] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:11 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:36:11.820548 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c77beeab-089e-45b1-b89b-6099742fa04e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:11.821920 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c77beeab-089e-45b1-b89b-6099742fa04e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:11.828115 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c77beeab-089e-45b1-b89b-6099742fa04e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:11.828558 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c77beeab-089e-45b1-b89b-6099742fa04e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:11.829338 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c77beeab-089e-45b1-b89b-6099742fa04e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:11.829968 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c77beeab-089e-45b1-b89b-6099742fa04e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:11.856408 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c77beeab-089e-45b1-b89b-6099742fa04e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042300 Mar 03 02:36:11.856888 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 495/995] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:11 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:12.574815 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b5bc8d94-0cfc-4db0-8856-44719c67379d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:12.575755 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b5bc8d94-0cfc-4db0-8856-44719c67379d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:12.582755 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b5bc8d94-0cfc-4db0-8856-44719c67379d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:12.583212 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b5bc8d94-0cfc-4db0-8856-44719c67379d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:12.584034 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b5bc8d94-0cfc-4db0-8856-44719c67379d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:12.584475 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b5bc8d94-0cfc-4db0-8856-44719c67379d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:12.587040 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7b103d17-2154-475e-b074-fb2529502d1f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:12.587664 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7b103d17-2154-475e-b074-fb2529502d1f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:12.593876 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7b103d17-2154-475e-b074-fb2529502d1f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:12.594319 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7b103d17-2154-475e-b074-fb2529502d1f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:12.595771 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7b103d17-2154-475e-b074-fb2529502d1f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:12.596305 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7b103d17-2154-475e-b074-fb2529502d1f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:12.613383 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b5bc8d94-0cfc-4db0-8856-44719c67379d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042788 Mar 03 02:36:12.614303 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 501/996] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:12 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:12.646840 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-245f2e71-666f-49f0-93ef-1d34d6dba7e1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:12.647772 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-245f2e71-666f-49f0-93ef-1d34d6dba7e1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:12.653529 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-245f2e71-666f-49f0-93ef-1d34d6dba7e1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:12.653980 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-245f2e71-666f-49f0-93ef-1d34d6dba7e1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:12.654754 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-245f2e71-666f-49f0-93ef-1d34d6dba7e1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:12.655183 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-245f2e71-666f-49f0-93ef-1d34d6dba7e1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:12.684838 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-245f2e71-666f-49f0-93ef-1d34d6dba7e1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041820 Mar 03 02:36:12.685396 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 502/997] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:12 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:36:12.726385 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-7b103d17-2154-475e-b074-fb2529502d1f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:12.735344 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-7b103d17-2154-475e-b074-fb2529502d1f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:12.737438 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-7b103d17-2154-475e-b074-fb2529502d1f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:12.738575 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7b103d17-2154-475e-b074-fb2529502d1f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.155503 Mar 03 02:36:12.739128 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 496/998] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:12 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:36:12.867786 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1192e1f7-5bd5-4b52-acea-e4094e275f94 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:12.868617 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1192e1f7-5bd5-4b52-acea-e4094e275f94 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:12.874615 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1192e1f7-5bd5-4b52-acea-e4094e275f94 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:12.875063 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1192e1f7-5bd5-4b52-acea-e4094e275f94 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:12.875859 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1192e1f7-5bd5-4b52-acea-e4094e275f94 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:12.876812 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1192e1f7-5bd5-4b52-acea-e4094e275f94 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:12.904246 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1192e1f7-5bd5-4b52-acea-e4094e275f94 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040522 Mar 03 02:36:12.904772 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 503/999] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:12 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:13.625245 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8fd2236c-017f-4b3b-88ea-4385c631c74b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:13.626071 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8fd2236c-017f-4b3b-88ea-4385c631c74b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:13.633287 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8fd2236c-017f-4b3b-88ea-4385c631c74b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:13.633734 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8fd2236c-017f-4b3b-88ea-4385c631c74b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:13.634520 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8fd2236c-017f-4b3b-88ea-4385c631c74b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:13.634955 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8fd2236c-017f-4b3b-88ea-4385c631c74b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:13.663641 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8fd2236c-017f-4b3b-88ea-4385c631c74b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042516 Mar 03 02:36:13.664189 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 497/1000] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:13 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:13.696044 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5496cd75-369e-4715-be7d-5cf2335b8208 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:13.697001 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5496cd75-369e-4715-be7d-5cf2335b8208 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:13.703101 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5496cd75-369e-4715-be7d-5cf2335b8208 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:13.703545 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5496cd75-369e-4715-be7d-5cf2335b8208 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:13.704352 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5496cd75-369e-4715-be7d-5cf2335b8208 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:13.705309 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5496cd75-369e-4715-be7d-5cf2335b8208 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:13.732174 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5496cd75-369e-4715-be7d-5cf2335b8208 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040036 Mar 03 02:36:13.732715 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 504/1001] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:13 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:13.757939 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-cc8cb0d1-7469-4781-b32d-05b114b682d7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:13.758540 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-cc8cb0d1-7469-4781-b32d-05b114b682d7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:13.764393 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cc8cb0d1-7469-4781-b32d-05b114b682d7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:13.764848 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cc8cb0d1-7469-4781-b32d-05b114b682d7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:13.765619 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cc8cb0d1-7469-4781-b32d-05b114b682d7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:13.766055 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cc8cb0d1-7469-4781-b32d-05b114b682d7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:13.900452 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-cc8cb0d1-7469-4781-b32d-05b114b682d7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:13.908705 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-cc8cb0d1-7469-4781-b32d-05b114b682d7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:13.910319 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-cc8cb0d1-7469-4781-b32d-05b114b682d7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:13.911481 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-cc8cb0d1-7469-4781-b32d-05b114b682d7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.157403 Mar 03 02:36:13.912110 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 498/1002] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:13 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:36:13.915377 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-14585389-4a18-4aab-906f-000d6c3728a3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:13.916345 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-14585389-4a18-4aab-906f-000d6c3728a3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:13.922021 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-14585389-4a18-4aab-906f-000d6c3728a3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:13.922465 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-14585389-4a18-4aab-906f-000d6c3728a3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:13.923770 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-14585389-4a18-4aab-906f-000d6c3728a3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:13.924207 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-14585389-4a18-4aab-906f-000d6c3728a3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:13.951355 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-14585389-4a18-4aab-906f-000d6c3728a3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040271 Mar 03 02:36:13.951921 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 505/1003] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:13 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:36:14.675461 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-73e9b535-6b71-4c86-9202-a2d045454815 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:14.676410 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-73e9b535-6b71-4c86-9202-a2d045454815 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:14.682554 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-73e9b535-6b71-4c86-9202-a2d045454815 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:14.683001 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-73e9b535-6b71-4c86-9202-a2d045454815 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:14.683806 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-73e9b535-6b71-4c86-9202-a2d045454815 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:14.684245 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-73e9b535-6b71-4c86-9202-a2d045454815 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:14.712647 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-73e9b535-6b71-4c86-9202-a2d045454815 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041583 Mar 03 02:36:14.713193 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 499/1004] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:14 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:14.743608 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-96b20014-92bb-4c53-ad00-ac8f8ab61e13 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:14.744818 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-96b20014-92bb-4c53-ad00-ac8f8ab61e13 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:14.750946 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-96b20014-92bb-4c53-ad00-ac8f8ab61e13 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:14.751446 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-96b20014-92bb-4c53-ad00-ac8f8ab61e13 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:14.752323 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-96b20014-92bb-4c53-ad00-ac8f8ab61e13 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:14.752755 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-96b20014-92bb-4c53-ad00-ac8f8ab61e13 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:14.780217 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-96b20014-92bb-4c53-ad00-ac8f8ab61e13 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040591 Mar 03 02:36:14.780936 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 506/1005] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:14 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:14.929809 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ba46d01f-9360-47ab-bd5d-90cadef58d53 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:14.930327 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ba46d01f-9360-47ab-bd5d-90cadef58d53 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:14.936248 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ba46d01f-9360-47ab-bd5d-90cadef58d53 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:14.936702 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ba46d01f-9360-47ab-bd5d-90cadef58d53 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:14.937480 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ba46d01f-9360-47ab-bd5d-90cadef58d53 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:14.937926 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ba46d01f-9360-47ab-bd5d-90cadef58d53 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:14.962764 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-98142534-3185-4891-a704-456596558197 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:14.963694 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-98142534-3185-4891-a704-456596558197 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:14.969571 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-98142534-3185-4891-a704-456596558197 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:14.970429 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-98142534-3185-4891-a704-456596558197 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:14.971252 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-98142534-3185-4891-a704-456596558197 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:14.971717 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-98142534-3185-4891-a704-456596558197 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:15.002501 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-98142534-3185-4891-a704-456596558197 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042610 Mar 03 02:36:15.003049 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 507/1006] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:14 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:36:15.069928 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ba46d01f-9360-47ab-bd5d-90cadef58d53 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:15.078061 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ba46d01f-9360-47ab-bd5d-90cadef58d53 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:15.080216 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ba46d01f-9360-47ab-bd5d-90cadef58d53 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:15.081358 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ba46d01f-9360-47ab-bd5d-90cadef58d53 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.155577 Mar 03 02:36:15.081904 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 500/1007] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:14 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:36:15.723915 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-fa36a55e-b80e-4529-8ee4-93d64d6a15e5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:15.725363 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-fa36a55e-b80e-4529-8ee4-93d64d6a15e5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:15.731282 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fa36a55e-b80e-4529-8ee4-93d64d6a15e5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:15.731757 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fa36a55e-b80e-4529-8ee4-93d64d6a15e5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:15.732533 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fa36a55e-b80e-4529-8ee4-93d64d6a15e5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:15.732966 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fa36a55e-b80e-4529-8ee4-93d64d6a15e5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:15.760966 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-fa36a55e-b80e-4529-8ee4-93d64d6a15e5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041100 Mar 03 02:36:15.761548 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 508/1008] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:15 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:15.791865 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ebee39b6-9db1-47a9-9777-cc4a32e70beb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:15.792776 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ebee39b6-9db1-47a9-9777-cc4a32e70beb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:15.799540 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ebee39b6-9db1-47a9-9777-cc4a32e70beb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:15.800021 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ebee39b6-9db1-47a9-9777-cc4a32e70beb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:15.800838 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ebee39b6-9db1-47a9-9777-cc4a32e70beb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:15.801281 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ebee39b6-9db1-47a9-9777-cc4a32e70beb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:15.829201 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ebee39b6-9db1-47a9-9777-cc4a32e70beb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041331 Mar 03 02:36:15.829873 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 501/1009] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:15 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:16.013509 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f1a5ca9a-774f-4270-b89c-63b17d6b961f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:16.014343 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f1a5ca9a-774f-4270-b89c-63b17d6b961f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:16.020457 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f1a5ca9a-774f-4270-b89c-63b17d6b961f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:16.020909 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f1a5ca9a-774f-4270-b89c-63b17d6b961f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:16.021690 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f1a5ca9a-774f-4270-b89c-63b17d6b961f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:16.022127 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f1a5ca9a-774f-4270-b89c-63b17d6b961f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:16.050052 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f1a5ca9a-774f-4270-b89c-63b17d6b961f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040593 Mar 03 02:36:16.050597 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 509/1010] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:16 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:16.099932 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-19f35ce1-b436-43c6-b835-b6ac0bd8e677 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:16.100536 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-19f35ce1-b436-43c6-b835-b6ac0bd8e677 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:16.106312 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-19f35ce1-b436-43c6-b835-b6ac0bd8e677 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:16.106760 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-19f35ce1-b436-43c6-b835-b6ac0bd8e677 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:16.107533 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-19f35ce1-b436-43c6-b835-b6ac0bd8e677 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:16.107999 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-19f35ce1-b436-43c6-b835-b6ac0bd8e677 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:16.238903 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-19f35ce1-b436-43c6-b835-b6ac0bd8e677 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:16.247311 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-19f35ce1-b436-43c6-b835-b6ac0bd8e677 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:16.248841 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-19f35ce1-b436-43c6-b835-b6ac0bd8e677 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:16.249988 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-19f35ce1-b436-43c6-b835-b6ac0bd8e677 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.153981 Mar 03 02:36:16.250540 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 502/1011] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:16 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:36:16.772332 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a2fe9d10-3e2a-4048-a72f-caba9c58ab2f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:16.773250 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a2fe9d10-3e2a-4048-a72f-caba9c58ab2f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:16.779505 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a2fe9d10-3e2a-4048-a72f-caba9c58ab2f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:16.779993 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a2fe9d10-3e2a-4048-a72f-caba9c58ab2f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:16.780785 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a2fe9d10-3e2a-4048-a72f-caba9c58ab2f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:16.781229 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a2fe9d10-3e2a-4048-a72f-caba9c58ab2f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:16.809013 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a2fe9d10-3e2a-4048-a72f-caba9c58ab2f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040716 Mar 03 02:36:16.809564 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 510/1012] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:16 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:16.840567 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-665569b5-873c-4bd7-a307-0aa6096a36e4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:16.841509 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-665569b5-873c-4bd7-a307-0aa6096a36e4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:16.848054 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-665569b5-873c-4bd7-a307-0aa6096a36e4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:16.848510 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-665569b5-873c-4bd7-a307-0aa6096a36e4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:16.849289 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-665569b5-873c-4bd7-a307-0aa6096a36e4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:16.849730 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-665569b5-873c-4bd7-a307-0aa6096a36e4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:16.878163 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-665569b5-873c-4bd7-a307-0aa6096a36e4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041450 Mar 03 02:36:16.878718 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 503/1013] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:16 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:17.061435 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d215e712-7d0c-4751-bde1-145ffc2b91df tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:17.062339 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d215e712-7d0c-4751-bde1-145ffc2b91df tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:17.068919 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d215e712-7d0c-4751-bde1-145ffc2b91df tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:17.069366 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d215e712-7d0c-4751-bde1-145ffc2b91df tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:17.070140 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d215e712-7d0c-4751-bde1-145ffc2b91df tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:17.070572 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d215e712-7d0c-4751-bde1-145ffc2b91df tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:17.097470 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d215e712-7d0c-4751-bde1-145ffc2b91df tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039996 Mar 03 02:36:17.098006 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 511/1014] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:17 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:17.268091 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-cc5d3b0a-1ba7-4cee-94a8-47c1743aec44 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:17.268703 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-cc5d3b0a-1ba7-4cee-94a8-47c1743aec44 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:17.274442 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cc5d3b0a-1ba7-4cee-94a8-47c1743aec44 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:17.274902 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cc5d3b0a-1ba7-4cee-94a8-47c1743aec44 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:17.275724 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cc5d3b0a-1ba7-4cee-94a8-47c1743aec44 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:17.276170 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cc5d3b0a-1ba7-4cee-94a8-47c1743aec44 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:17.409042 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-cc5d3b0a-1ba7-4cee-94a8-47c1743aec44 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:17.417149 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-cc5d3b0a-1ba7-4cee-94a8-47c1743aec44 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:17.418642 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-cc5d3b0a-1ba7-4cee-94a8-47c1743aec44 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:17.419841 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-cc5d3b0a-1ba7-4cee-94a8-47c1743aec44 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.155542 Mar 03 02:36:17.420405 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 504/1015] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:17 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:36:17.820678 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-268a9344-a75b-4c3a-8498-bcf01bcf5c68 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:17.821512 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-268a9344-a75b-4c3a-8498-bcf01bcf5c68 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:17.827825 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-268a9344-a75b-4c3a-8498-bcf01bcf5c68 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:17.828282 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-268a9344-a75b-4c3a-8498-bcf01bcf5c68 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:17.829066 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-268a9344-a75b-4c3a-8498-bcf01bcf5c68 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:17.830118 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-268a9344-a75b-4c3a-8498-bcf01bcf5c68 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:17.857895 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-268a9344-a75b-4c3a-8498-bcf01bcf5c68 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041246 Mar 03 02:36:17.858436 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 512/1016] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:17 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:17.889110 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9222d02e-6fd8-4537-9531-2a0edb7b5c84 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:17.890038 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9222d02e-6fd8-4537-9531-2a0edb7b5c84 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:17.896820 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9222d02e-6fd8-4537-9531-2a0edb7b5c84 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:17.897269 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9222d02e-6fd8-4537-9531-2a0edb7b5c84 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:17.898034 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9222d02e-6fd8-4537-9531-2a0edb7b5c84 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:17.898464 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9222d02e-6fd8-4537-9531-2a0edb7b5c84 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:17.925851 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9222d02e-6fd8-4537-9531-2a0edb7b5c84 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040623 Mar 03 02:36:17.926386 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 505/1017] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:17 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:18.108902 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-52dc4a2f-3089-4a9d-be50-8369d5495f10 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:18.109817 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-52dc4a2f-3089-4a9d-be50-8369d5495f10 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:18.115744 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-52dc4a2f-3089-4a9d-be50-8369d5495f10 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:18.116191 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-52dc4a2f-3089-4a9d-be50-8369d5495f10 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:18.116967 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-52dc4a2f-3089-4a9d-be50-8369d5495f10 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:18.117407 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-52dc4a2f-3089-4a9d-be50-8369d5495f10 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:18.145473 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-52dc4a2f-3089-4a9d-be50-8369d5495f10 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040515 Mar 03 02:36:18.146039 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 513/1018] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:18 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:18.438278 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e8057905-e166-4584-915a-a88b117a814b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:18.439494 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e8057905-e166-4584-915a-a88b117a814b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:18.445368 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e8057905-e166-4584-915a-a88b117a814b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:18.445820 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e8057905-e166-4584-915a-a88b117a814b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:18.446600 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e8057905-e166-4584-915a-a88b117a814b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:18.447037 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e8057905-e166-4584-915a-a88b117a814b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:18.574407 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e8057905-e166-4584-915a-a88b117a814b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:18.582635 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e8057905-e166-4584-915a-a88b117a814b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:18.584275 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e8057905-e166-4584-915a-a88b117a814b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:18.585415 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e8057905-e166-4584-915a-a88b117a814b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.151058 Mar 03 02:36:18.585961 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 506/1019] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:18 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:36:18.869607 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ad8d4031-d474-4e1f-8366-2c9b83432394 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:18.870558 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ad8d4031-d474-4e1f-8366-2c9b83432394 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:18.876798 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ad8d4031-d474-4e1f-8366-2c9b83432394 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:18.877246 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ad8d4031-d474-4e1f-8366-2c9b83432394 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:18.878020 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ad8d4031-d474-4e1f-8366-2c9b83432394 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:18.878453 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ad8d4031-d474-4e1f-8366-2c9b83432394 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:18.906236 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ad8d4031-d474-4e1f-8366-2c9b83432394 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040819 Mar 03 02:36:18.906778 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 514/1020] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:18 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:18.937134 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2de88ec4-f21f-464b-bdbb-a147f5baf94e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:18.938061 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2de88ec4-f21f-464b-bdbb-a147f5baf94e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:18.944412 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2de88ec4-f21f-464b-bdbb-a147f5baf94e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:18.944859 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2de88ec4-f21f-464b-bdbb-a147f5baf94e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:18.945629 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2de88ec4-f21f-464b-bdbb-a147f5baf94e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:18.946062 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2de88ec4-f21f-464b-bdbb-a147f5baf94e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:18.973182 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2de88ec4-f21f-464b-bdbb-a147f5baf94e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040277 Mar 03 02:36:18.973720 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 507/1021] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:18 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:19.157250 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6dc07228-6391-4ac0-a706-7e7558dea337 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:19.158757 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6dc07228-6391-4ac0-a706-7e7558dea337 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:19.164661 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6dc07228-6391-4ac0-a706-7e7558dea337 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:19.165118 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6dc07228-6391-4ac0-a706-7e7558dea337 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:19.165904 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6dc07228-6391-4ac0-a706-7e7558dea337 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:19.166347 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6dc07228-6391-4ac0-a706-7e7558dea337 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:19.193193 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6dc07228-6391-4ac0-a706-7e7558dea337 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040059 Mar 03 02:36:19.193732 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 515/1022] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:19 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:19.603361 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-42fa9db9-2f5f-4197-abbf-502adfbb95e7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:19.604005 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-42fa9db9-2f5f-4197-abbf-502adfbb95e7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:19.609844 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-42fa9db9-2f5f-4197-abbf-502adfbb95e7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:19.610295 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-42fa9db9-2f5f-4197-abbf-502adfbb95e7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:19.611205 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-42fa9db9-2f5f-4197-abbf-502adfbb95e7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:19.611670 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-42fa9db9-2f5f-4197-abbf-502adfbb95e7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:19.748402 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-42fa9db9-2f5f-4197-abbf-502adfbb95e7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:19.756988 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-42fa9db9-2f5f-4197-abbf-502adfbb95e7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:19.758470 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-42fa9db9-2f5f-4197-abbf-502adfbb95e7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:19.759620 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-42fa9db9-2f5f-4197-abbf-502adfbb95e7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.160147 Mar 03 02:36:19.760178 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 508/1023] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:19 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:36:19.918871 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5daac566-915a-4568-9a32-af48b4e89648 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:19.919791 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5daac566-915a-4568-9a32-af48b4e89648 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:19.926733 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5daac566-915a-4568-9a32-af48b4e89648 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:19.927183 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5daac566-915a-4568-9a32-af48b4e89648 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:19.928001 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5daac566-915a-4568-9a32-af48b4e89648 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:19.928439 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5daac566-915a-4568-9a32-af48b4e89648 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:19.957040 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5daac566-915a-4568-9a32-af48b4e89648 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042370 Mar 03 02:36:19.957587 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 516/1024] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:19 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:36:19.984617 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a7aad999-1b29-49aa-b409-4bc858999173 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:19.986092 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a7aad999-1b29-49aa-b409-4bc858999173 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:19.992294 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a7aad999-1b29-49aa-b409-4bc858999173 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:19.992728 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a7aad999-1b29-49aa-b409-4bc858999173 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:19.993499 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a7aad999-1b29-49aa-b409-4bc858999173 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:19.993926 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a7aad999-1b29-49aa-b409-4bc858999173 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:20.021928 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a7aad999-1b29-49aa-b409-4bc858999173 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041448 Mar 03 02:36:20.022470 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 509/1025] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:19 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:20.204893 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-52dff7e9-6de8-4cbb-956d-84de792cf64b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:20.205731 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-52dff7e9-6de8-4cbb-956d-84de792cf64b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:20.211618 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-52dff7e9-6de8-4cbb-956d-84de792cf64b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:20.212076 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-52dff7e9-6de8-4cbb-956d-84de792cf64b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:20.212854 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-52dff7e9-6de8-4cbb-956d-84de792cf64b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:20.213289 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-52dff7e9-6de8-4cbb-956d-84de792cf64b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:20.241354 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-52dff7e9-6de8-4cbb-956d-84de792cf64b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040651 Mar 03 02:36:20.241926 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 517/1026] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:20 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:20.778214 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-92f792ba-6eb9-422e-920e-1e598ba372da tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:20.778822 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-92f792ba-6eb9-422e-920e-1e598ba372da tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:20.785352 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-92f792ba-6eb9-422e-920e-1e598ba372da tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:20.785815 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-92f792ba-6eb9-422e-920e-1e598ba372da tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:20.786595 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-92f792ba-6eb9-422e-920e-1e598ba372da tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:20.787036 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-92f792ba-6eb9-422e-920e-1e598ba372da tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:20.916685 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-92f792ba-6eb9-422e-920e-1e598ba372da tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:20.924703 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-92f792ba-6eb9-422e-920e-1e598ba372da tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:20.926195 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-92f792ba-6eb9-422e-920e-1e598ba372da tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:20.927333 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-92f792ba-6eb9-422e-920e-1e598ba372da tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.153013 Mar 03 02:36:20.927943 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 510/1027] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:20 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:36:20.968301 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8a0edbef-43af-4f03-8522-c646847cb3c0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:20.969207 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8a0edbef-43af-4f03-8522-c646847cb3c0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:20.975407 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8a0edbef-43af-4f03-8522-c646847cb3c0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:20.975882 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8a0edbef-43af-4f03-8522-c646847cb3c0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:20.976659 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8a0edbef-43af-4f03-8522-c646847cb3c0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:20.977092 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8a0edbef-43af-4f03-8522-c646847cb3c0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:21.005796 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8a0edbef-43af-4f03-8522-c646847cb3c0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041313 Mar 03 02:36:21.006356 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 518/1028] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:20 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:21.033170 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5cbff841-83b8-4965-a39c-40fa8694620d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:21.034007 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5cbff841-83b8-4965-a39c-40fa8694620d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:21.040214 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5cbff841-83b8-4965-a39c-40fa8694620d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:21.040663 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5cbff841-83b8-4965-a39c-40fa8694620d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:21.041440 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5cbff841-83b8-4965-a39c-40fa8694620d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:21.041916 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5cbff841-83b8-4965-a39c-40fa8694620d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:21.069918 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5cbff841-83b8-4965-a39c-40fa8694620d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040633 Mar 03 02:36:21.070463 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 511/1029] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:21 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:21.253799 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c4a7efc4-132b-41b4-8a3f-1b567eac3ab6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:21.254695 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c4a7efc4-132b-41b4-8a3f-1b567eac3ab6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:21.260759 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c4a7efc4-132b-41b4-8a3f-1b567eac3ab6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:21.261205 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c4a7efc4-132b-41b4-8a3f-1b567eac3ab6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:21.261974 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c4a7efc4-132b-41b4-8a3f-1b567eac3ab6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:21.262409 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c4a7efc4-132b-41b4-8a3f-1b567eac3ab6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:21.289930 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c4a7efc4-132b-41b4-8a3f-1b567eac3ab6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040600 Mar 03 02:36:21.290394 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 519/1030] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:21 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:21.945573 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f035cc01-6b28-4236-8844-094fe5c433eb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:21.946180 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f035cc01-6b28-4236-8844-094fe5c433eb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:21.952006 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f035cc01-6b28-4236-8844-094fe5c433eb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:21.952457 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f035cc01-6b28-4236-8844-094fe5c433eb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:21.953234 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f035cc01-6b28-4236-8844-094fe5c433eb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:21.953668 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f035cc01-6b28-4236-8844-094fe5c433eb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:22.017543 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4b21dd39-5b1c-465b-9565-b08caef7d1cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:22.018502 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4b21dd39-5b1c-465b-9565-b08caef7d1cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:22.024830 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4b21dd39-5b1c-465b-9565-b08caef7d1cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:22.025298 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4b21dd39-5b1c-465b-9565-b08caef7d1cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:22.026092 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4b21dd39-5b1c-465b-9565-b08caef7d1cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:22.026534 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4b21dd39-5b1c-465b-9565-b08caef7d1cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:22.056556 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4b21dd39-5b1c-465b-9565-b08caef7d1cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043194 Mar 03 02:36:22.057349 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 520/1031] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:22 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:36:22.081901 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-38b9cfeb-e62d-41d9-a526-e7f944e3a058 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:22.082851 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-38b9cfeb-e62d-41d9-a526-e7f944e3a058 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:22.084996 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f035cc01-6b28-4236-8844-094fe5c433eb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:22.088674 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-38b9cfeb-e62d-41d9-a526-e7f944e3a058 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:22.089203 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-38b9cfeb-e62d-41d9-a526-e7f944e3a058 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:22.090063 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-38b9cfeb-e62d-41d9-a526-e7f944e3a058 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:22.090515 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-38b9cfeb-e62d-41d9-a526-e7f944e3a058 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:22.092963 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f035cc01-6b28-4236-8844-094fe5c433eb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:22.094453 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f035cc01-6b28-4236-8844-094fe5c433eb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:22.096371 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f035cc01-6b28-4236-8844-094fe5c433eb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.154719 Mar 03 02:36:22.096932 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 512/1032] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:21 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:36:22.118897 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-38b9cfeb-e62d-41d9-a526-e7f944e3a058 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041571 Mar 03 02:36:22.119709 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 521/1033] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:22 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:36:22.301364 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-10a58bad-0a9e-4f5f-ae2b-f8f5101c0820 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:22.302208 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-10a58bad-0a9e-4f5f-ae2b-f8f5101c0820 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:22.308030 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-10a58bad-0a9e-4f5f-ae2b-f8f5101c0820 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:22.308480 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-10a58bad-0a9e-4f5f-ae2b-f8f5101c0820 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:22.309260 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-10a58bad-0a9e-4f5f-ae2b-f8f5101c0820 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:22.309693 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-10a58bad-0a9e-4f5f-ae2b-f8f5101c0820 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:22.337037 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-10a58bad-0a9e-4f5f-ae2b-f8f5101c0820 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039696 Mar 03 02:36:22.337573 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 513/1034] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:22 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:23.068816 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a38ed56c-d432-48ae-8057-8d5727c0ab91 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:23.069736 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a38ed56c-d432-48ae-8057-8d5727c0ab91 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:23.076053 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a38ed56c-d432-48ae-8057-8d5727c0ab91 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:23.076509 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a38ed56c-d432-48ae-8057-8d5727c0ab91 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:23.077296 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a38ed56c-d432-48ae-8057-8d5727c0ab91 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:23.077736 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a38ed56c-d432-48ae-8057-8d5727c0ab91 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:23.105196 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a38ed56c-d432-48ae-8057-8d5727c0ab91 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040398 Mar 03 02:36:23.105729 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 522/1035] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:23 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:23.114648 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-00fc397c-7059-4ed2-8bff-2c860705a294 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:23.115250 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-00fc397c-7059-4ed2-8bff-2c860705a294 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:23.121652 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-00fc397c-7059-4ed2-8bff-2c860705a294 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:23.122100 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-00fc397c-7059-4ed2-8bff-2c860705a294 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:23.122875 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-00fc397c-7059-4ed2-8bff-2c860705a294 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:23.123312 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-00fc397c-7059-4ed2-8bff-2c860705a294 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:23.130747 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6a423c91-31ec-43a8-b6da-ddd3e8c1c3e9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:23.131715 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6a423c91-31ec-43a8-b6da-ddd3e8c1c3e9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:23.137445 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6a423c91-31ec-43a8-b6da-ddd3e8c1c3e9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:23.137881 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6a423c91-31ec-43a8-b6da-ddd3e8c1c3e9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:23.138665 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6a423c91-31ec-43a8-b6da-ddd3e8c1c3e9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:23.139103 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6a423c91-31ec-43a8-b6da-ddd3e8c1c3e9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:23.167576 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6a423c91-31ec-43a8-b6da-ddd3e8c1c3e9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041220 Mar 03 02:36:23.168173 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 523/1036] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:23 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:36:23.255177 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-00fc397c-7059-4ed2-8bff-2c860705a294 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:23.263280 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-00fc397c-7059-4ed2-8bff-2c860705a294 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:23.264800 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-00fc397c-7059-4ed2-8bff-2c860705a294 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:23.265936 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-00fc397c-7059-4ed2-8bff-2c860705a294 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.155745 Mar 03 02:36:23.266495 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 514/1037] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:23 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:36:23.349076 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-37e51916-ef51-44e2-9213-7a67a8f1b7d8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:23.350121 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-37e51916-ef51-44e2-9213-7a67a8f1b7d8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:23.355877 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-37e51916-ef51-44e2-9213-7a67a8f1b7d8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:23.356332 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-37e51916-ef51-44e2-9213-7a67a8f1b7d8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:23.357119 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-37e51916-ef51-44e2-9213-7a67a8f1b7d8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:23.357562 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-37e51916-ef51-44e2-9213-7a67a8f1b7d8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:23.385955 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-37e51916-ef51-44e2-9213-7a67a8f1b7d8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041455 Mar 03 02:36:23.386496 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 524/1038] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:23 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:24.115674 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-473b0727-cf01-47b1-9642-b56c22ff2055 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:24.116575 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-473b0727-cf01-47b1-9642-b56c22ff2055 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:24.122946 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-473b0727-cf01-47b1-9642-b56c22ff2055 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:24.123391 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-473b0727-cf01-47b1-9642-b56c22ff2055 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:24.124213 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-473b0727-cf01-47b1-9642-b56c22ff2055 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:24.124642 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-473b0727-cf01-47b1-9642-b56c22ff2055 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:24.153253 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-473b0727-cf01-47b1-9642-b56c22ff2055 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041242 Mar 03 02:36:24.153799 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 515/1039] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:24 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:24.178581 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f611b8c1-dec0-4bc7-8651-88681cca0701 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:24.179491 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f611b8c1-dec0-4bc7-8651-88681cca0701 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:24.185779 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f611b8c1-dec0-4bc7-8651-88681cca0701 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:24.186233 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f611b8c1-dec0-4bc7-8651-88681cca0701 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:24.187007 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f611b8c1-dec0-4bc7-8651-88681cca0701 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:24.187446 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f611b8c1-dec0-4bc7-8651-88681cca0701 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:24.216516 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f611b8c1-dec0-4bc7-8651-88681cca0701 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041892 Mar 03 02:36:24.217056 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 525/1040] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:24 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:24.284477 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c42b51b5-75e8-4cbd-97f1-bfebbba073e5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:24.285082 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c42b51b5-75e8-4cbd-97f1-bfebbba073e5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:24.291114 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c42b51b5-75e8-4cbd-97f1-bfebbba073e5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:24.291566 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c42b51b5-75e8-4cbd-97f1-bfebbba073e5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:24.292368 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c42b51b5-75e8-4cbd-97f1-bfebbba073e5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:24.292807 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c42b51b5-75e8-4cbd-97f1-bfebbba073e5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:24.398388 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e2541680-6b3f-484c-855b-e057e83e02b3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:24.399301 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e2541680-6b3f-484c-855b-e057e83e02b3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:24.405056 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e2541680-6b3f-484c-855b-e057e83e02b3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:24.405540 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e2541680-6b3f-484c-855b-e057e83e02b3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:24.406323 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e2541680-6b3f-484c-855b-e057e83e02b3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:24.406761 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e2541680-6b3f-484c-855b-e057e83e02b3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:24.421737 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c42b51b5-75e8-4cbd-97f1-bfebbba073e5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:24.430272 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c42b51b5-75e8-4cbd-97f1-bfebbba073e5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:24.431795 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c42b51b5-75e8-4cbd-97f1-bfebbba073e5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:24.432940 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c42b51b5-75e8-4cbd-97f1-bfebbba073e5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.153085 Mar 03 02:36:24.433712 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 516/1041] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:24 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:36:24.436047 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e2541680-6b3f-484c-855b-e057e83e02b3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041545 Mar 03 02:36:24.436592 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 526/1042] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:24 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:36:25.164717 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-00c6773b-1541-49de-954f-26d478b55561 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:25.165625 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-00c6773b-1541-49de-954f-26d478b55561 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:25.171826 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-00c6773b-1541-49de-954f-26d478b55561 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:25.172279 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-00c6773b-1541-49de-954f-26d478b55561 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:25.173557 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-00c6773b-1541-49de-954f-26d478b55561 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:25.173991 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-00c6773b-1541-49de-954f-26d478b55561 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:25.201888 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-00c6773b-1541-49de-954f-26d478b55561 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041112 Mar 03 02:36:25.202439 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 517/1043] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:25 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:25.228471 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e496d0bf-88d8-4fcb-8bc1-667e2bd53141 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:25.229382 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e496d0bf-88d8-4fcb-8bc1-667e2bd53141 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:25.236121 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e496d0bf-88d8-4fcb-8bc1-667e2bd53141 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:25.236629 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e496d0bf-88d8-4fcb-8bc1-667e2bd53141 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:25.237408 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e496d0bf-88d8-4fcb-8bc1-667e2bd53141 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:25.237847 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e496d0bf-88d8-4fcb-8bc1-667e2bd53141 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:25.265842 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e496d0bf-88d8-4fcb-8bc1-667e2bd53141 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041362 Mar 03 02:36:25.266381 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 527/1044] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:25 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:25.446330 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f4f43255-3697-4a11-8d84-fd0264964f38 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:25.447233 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f4f43255-3697-4a11-8d84-fd0264964f38 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:25.451150 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-51582ec2-9e96-46c1-ac1d-4637afac7022 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:25.451789 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-51582ec2-9e96-46c1-ac1d-4637afac7022 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:25.453096 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f4f43255-3697-4a11-8d84-fd0264964f38 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:25.453574 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f4f43255-3697-4a11-8d84-fd0264964f38 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:25.454403 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f4f43255-3697-4a11-8d84-fd0264964f38 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:25.454843 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f4f43255-3697-4a11-8d84-fd0264964f38 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:25.457646 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-51582ec2-9e96-46c1-ac1d-4637afac7022 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:25.458127 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-51582ec2-9e96-46c1-ac1d-4637afac7022 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:25.458920 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-51582ec2-9e96-46c1-ac1d-4637afac7022 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:25.459360 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-51582ec2-9e96-46c1-ac1d-4637afac7022 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:25.482252 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f4f43255-3697-4a11-8d84-fd0264964f38 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039818 Mar 03 02:36:25.482814 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 518/1045] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:25 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:25.587755 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-51582ec2-9e96-46c1-ac1d-4637afac7022 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:25.596592 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-51582ec2-9e96-46c1-ac1d-4637afac7022 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:25.598146 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-51582ec2-9e96-46c1-ac1d-4637afac7022 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:25.599242 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-51582ec2-9e96-46c1-ac1d-4637afac7022 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.151891 Mar 03 02:36:25.599825 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 528/1046] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:25 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:36:26.212704 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c92c0847-f75c-45ad-ac4c-87a57af46f1d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:26.213607 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c92c0847-f75c-45ad-ac4c-87a57af46f1d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:26.219779 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c92c0847-f75c-45ad-ac4c-87a57af46f1d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:26.220657 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c92c0847-f75c-45ad-ac4c-87a57af46f1d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:26.221436 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c92c0847-f75c-45ad-ac4c-87a57af46f1d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:26.221873 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c92c0847-f75c-45ad-ac4c-87a57af46f1d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:26.250009 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c92c0847-f75c-45ad-ac4c-87a57af46f1d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041250 Mar 03 02:36:26.250555 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 519/1047] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:26 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:26.277524 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5ff974c0-9e3c-42f5-abd3-e68087dadd74 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:26.278437 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5ff974c0-9e3c-42f5-abd3-e68087dadd74 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:26.284639 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5ff974c0-9e3c-42f5-abd3-e68087dadd74 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:26.285082 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5ff974c0-9e3c-42f5-abd3-e68087dadd74 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:26.285853 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5ff974c0-9e3c-42f5-abd3-e68087dadd74 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:26.286284 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5ff974c0-9e3c-42f5-abd3-e68087dadd74 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:26.313340 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5ff974c0-9e3c-42f5-abd3-e68087dadd74 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039660 Mar 03 02:36:26.314319 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 529/1048] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:26 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:26.494661 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-42be8515-6ad8-477d-b7a2-5ce05a95ed7d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:26.495553 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-42be8515-6ad8-477d-b7a2-5ce05a95ed7d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:26.501970 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-42be8515-6ad8-477d-b7a2-5ce05a95ed7d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:26.502411 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-42be8515-6ad8-477d-b7a2-5ce05a95ed7d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:26.503179 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-42be8515-6ad8-477d-b7a2-5ce05a95ed7d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:26.503624 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-42be8515-6ad8-477d-b7a2-5ce05a95ed7d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:26.530567 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-42be8515-6ad8-477d-b7a2-5ce05a95ed7d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040143 Mar 03 02:36:26.531113 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 520/1049] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:26 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:26.617687 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8b9ffda6-b5f9-451a-a456-4ca8c9be665c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:26.618290 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8b9ffda6-b5f9-451a-a456-4ca8c9be665c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:26.624405 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8b9ffda6-b5f9-451a-a456-4ca8c9be665c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:26.624858 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8b9ffda6-b5f9-451a-a456-4ca8c9be665c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:26.625640 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8b9ffda6-b5f9-451a-a456-4ca8c9be665c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:26.626728 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8b9ffda6-b5f9-451a-a456-4ca8c9be665c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:26.760320 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8b9ffda6-b5f9-451a-a456-4ca8c9be665c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:26.768458 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8b9ffda6-b5f9-451a-a456-4ca8c9be665c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:26.770016 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8b9ffda6-b5f9-451a-a456-4ca8c9be665c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:26.771156 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8b9ffda6-b5f9-451a-a456-4ca8c9be665c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.157433 Mar 03 02:36:26.771718 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 530/1050] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:26 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:36:27.262087 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a65e761c-09e4-42b2-841f-bf792aa9d5b0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:27.263007 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a65e761c-09e4-42b2-841f-bf792aa9d5b0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:27.269357 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a65e761c-09e4-42b2-841f-bf792aa9d5b0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:27.269796 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a65e761c-09e4-42b2-841f-bf792aa9d5b0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:27.270561 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a65e761c-09e4-42b2-841f-bf792aa9d5b0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:27.270992 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a65e761c-09e4-42b2-841f-bf792aa9d5b0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:27.299003 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a65e761c-09e4-42b2-841f-bf792aa9d5b0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040086 Mar 03 02:36:27.299540 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 521/1051] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:27 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:27.325063 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-460a12f2-ae36-4e3e-b8ed-d915ec27238e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:27.325969 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-460a12f2-ae36-4e3e-b8ed-d915ec27238e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:27.332871 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-460a12f2-ae36-4e3e-b8ed-d915ec27238e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:27.333316 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-460a12f2-ae36-4e3e-b8ed-d915ec27238e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:27.334094 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-460a12f2-ae36-4e3e-b8ed-d915ec27238e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:27.334529 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-460a12f2-ae36-4e3e-b8ed-d915ec27238e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:27.362385 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-460a12f2-ae36-4e3e-b8ed-d915ec27238e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041191 Mar 03 02:36:27.362934 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 531/1052] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:27 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:27.542016 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-bd4638c1-cbb4-45b1-9bdb-4a121dbcb2cf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:27.542916 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-bd4638c1-cbb4-45b1-9bdb-4a121dbcb2cf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:27.549130 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bd4638c1-cbb4-45b1-9bdb-4a121dbcb2cf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:27.549582 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bd4638c1-cbb4-45b1-9bdb-4a121dbcb2cf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:27.550357 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bd4638c1-cbb4-45b1-9bdb-4a121dbcb2cf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:27.550793 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bd4638c1-cbb4-45b1-9bdb-4a121dbcb2cf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:27.577662 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-bd4638c1-cbb4-45b1-9bdb-4a121dbcb2cf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039553 Mar 03 02:36:27.578139 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 522/1053] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:27 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:27.788433 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-262979e2-3926-42ad-8834-da595becdb3e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:27.789035 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-262979e2-3926-42ad-8834-da595becdb3e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:27.794912 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-262979e2-3926-42ad-8834-da595becdb3e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:27.795361 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-262979e2-3926-42ad-8834-da595becdb3e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:27.796174 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-262979e2-3926-42ad-8834-da595becdb3e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:27.796613 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-262979e2-3926-42ad-8834-da595becdb3e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:27.927582 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-262979e2-3926-42ad-8834-da595becdb3e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:27.935672 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-262979e2-3926-42ad-8834-da595becdb3e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:27.937180 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-262979e2-3926-42ad-8834-da595becdb3e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:27.938332 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-262979e2-3926-42ad-8834-da595becdb3e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.153787 Mar 03 02:36:27.939455 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 532/1054] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:27 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:36:28.310484 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5b103d9b-3846-4b4c-ab5a-a969c75d547c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:28.311312 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5b103d9b-3846-4b4c-ab5a-a969c75d547c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:28.318607 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5b103d9b-3846-4b4c-ab5a-a969c75d547c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:28.319057 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5b103d9b-3846-4b4c-ab5a-a969c75d547c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:28.319882 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5b103d9b-3846-4b4c-ab5a-a969c75d547c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:28.320321 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5b103d9b-3846-4b4c-ab5a-a969c75d547c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:28.348212 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5b103d9b-3846-4b4c-ab5a-a969c75d547c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041759 Mar 03 02:36:28.348773 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 523/1055] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:28 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:28.373915 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d4c4a22f-96a9-462f-a60d-4c5fa69cb399 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:28.374835 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d4c4a22f-96a9-462f-a60d-4c5fa69cb399 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:28.382532 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d4c4a22f-96a9-462f-a60d-4c5fa69cb399 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:28.382981 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d4c4a22f-96a9-462f-a60d-4c5fa69cb399 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:28.383799 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d4c4a22f-96a9-462f-a60d-4c5fa69cb399 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:28.384237 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d4c4a22f-96a9-462f-a60d-4c5fa69cb399 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:28.412221 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d4c4a22f-96a9-462f-a60d-4c5fa69cb399 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042493 Mar 03 02:36:28.412768 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 533/1056] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:28 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:28.453508 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f9c14eec-7a5e-4492-8888-d45a4951438c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:36:28.454886 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f9c14eec-7a5e-4492-8888-d45a4951438c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:28.460702 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f9c14eec-7a5e-4492-8888-d45a4951438c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:28.461155 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f9c14eec-7a5e-4492-8888-d45a4951438c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:28.461937 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f9c14eec-7a5e-4492-8888-d45a4951438c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:28.462373 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f9c14eec-7a5e-4492-8888-d45a4951438c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:28.527434 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f9c14eec-7a5e-4492-8888-d45a4951438c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "POST /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3/action" status: 200 len: 14 microversion: 2.1 time: 0.077670 Mar 03 02:36:28.528065 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 524/1057] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Mar 3 02:36:28 2022] POST /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 03 02:36:28.589893 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c8cc1720-a360-4fa4-8c52-5de2a2179c40 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:28.590797 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c8cc1720-a360-4fa4-8c52-5de2a2179c40 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:28.597020 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c8cc1720-a360-4fa4-8c52-5de2a2179c40 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:28.597471 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c8cc1720-a360-4fa4-8c52-5de2a2179c40 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:28.598249 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c8cc1720-a360-4fa4-8c52-5de2a2179c40 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:28.598682 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c8cc1720-a360-4fa4-8c52-5de2a2179c40 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:28.627574 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c8cc1720-a360-4fa4-8c52-5de2a2179c40 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041523 Mar 03 02:36:28.628157 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 534/1058] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:28 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:28.958236 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-66765b21-f895-4ce3-b73b-83b0d03f2ca7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:28.958952 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-66765b21-f895-4ce3-b73b-83b0d03f2ca7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:28.966317 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-66765b21-f895-4ce3-b73b-83b0d03f2ca7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:28.966788 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-66765b21-f895-4ce3-b73b-83b0d03f2ca7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:28.967593 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-66765b21-f895-4ce3-b73b-83b0d03f2ca7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:28.968052 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-66765b21-f895-4ce3-b73b-83b0d03f2ca7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:29.108875 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-66765b21-f895-4ce3-b73b-83b0d03f2ca7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:29.118594 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-66765b21-f895-4ce3-b73b-83b0d03f2ca7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:29.120401 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-66765b21-f895-4ce3-b73b-83b0d03f2ca7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:29.121566 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-66765b21-f895-4ce3-b73b-83b0d03f2ca7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.168229 Mar 03 02:36:29.122121 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 525/1059] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:28 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:36:29.359893 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3952a056-14b9-43b7-9a01-6608fd064a53 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:29.361429 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3952a056-14b9-43b7-9a01-6608fd064a53 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:29.367414 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3952a056-14b9-43b7-9a01-6608fd064a53 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:29.367892 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3952a056-14b9-43b7-9a01-6608fd064a53 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:29.368675 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3952a056-14b9-43b7-9a01-6608fd064a53 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:29.369109 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3952a056-14b9-43b7-9a01-6608fd064a53 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:29.396719 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3952a056-14b9-43b7-9a01-6608fd064a53 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040903 Mar 03 02:36:29.397352 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 535/1060] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:29 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:29.424497 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-14e5f3a9-fa22-4b3e-a230-4e7019e7f7a8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:29.425400 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-14e5f3a9-fa22-4b3e-a230-4e7019e7f7a8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:29.431471 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-14e5f3a9-fa22-4b3e-a230-4e7019e7f7a8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:29.431949 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-14e5f3a9-fa22-4b3e-a230-4e7019e7f7a8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:29.432725 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-14e5f3a9-fa22-4b3e-a230-4e7019e7f7a8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:29.433156 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-14e5f3a9-fa22-4b3e-a230-4e7019e7f7a8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:29.461783 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-14e5f3a9-fa22-4b3e-a230-4e7019e7f7a8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042096 Mar 03 02:36:29.462420 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 526/1061] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:29 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:29.564921 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-97b49927-8051-4823-a949-dc7397222f64 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:29.565419 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-97b49927-8051-4823-a949-dc7397222f64 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:29.571592 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-97b49927-8051-4823-a949-dc7397222f64 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:29.572249 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-97b49927-8051-4823-a949-dc7397222f64 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:29.573051 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-97b49927-8051-4823-a949-dc7397222f64 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:29.573498 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-97b49927-8051-4823-a949-dc7397222f64 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:29.600193 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-97b49927-8051-4823-a949-dc7397222f64 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Going to try to terminate instance {{(pid=116859) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 03 02:36:29.626267 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [req-aa09a0eb-d222-41c8-bfe2-3ab0619e969c req-0e093051-c50c-48fd-8a1f-ba34ecd63d2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4ca9b17-c039-4bdc-9a51-c1351edaf4d3", "tag": "3a27027e-071e-47ba-b741-f3a6273ab83f"}]} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:36:29.635895 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-aa09a0eb-d222-41c8-bfe2-3ab0619e969c req-0e093051-c50c-48fd-8a1f-ba34ecd63d2a service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:29.636336 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-aa09a0eb-d222-41c8-bfe2-3ab0619e969c req-0e093051-c50c-48fd-8a1f-ba34ecd63d2a service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:29.649287 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.compute.server_external_events [req-aa09a0eb-d222-41c8-bfe2-3ab0619e969c req-0e093051-c50c-48fd-8a1f-ba34ecd63d2a service nova] Creating event network-changed:3a27027e-071e-47ba-b741-f3a6273ab83f for instance b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 on hv-cinder-81977 Mar 03 02:36:29.654191 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [req-aa09a0eb-d222-41c8-bfe2-3ab0619e969c req-0e093051-c50c-48fd-8a1f-ba34ecd63d2a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090681 Mar 03 02:36:29.654779 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 527/1062] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:29.660828 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c92b1c93-31f7-4a33-beeb-7957c90cc322 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:29.661928 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c92b1c93-31f7-4a33-beeb-7957c90cc322 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:29.668097 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c92b1c93-31f7-4a33-beeb-7957c90cc322 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:29.668566 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c92b1c93-31f7-4a33-beeb-7957c90cc322 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:29.669373 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c92b1c93-31f7-4a33-beeb-7957c90cc322 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:29.669814 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c92b1c93-31f7-4a33-beeb-7957c90cc322 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:29.706705 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c92b1c93-31f7-4a33-beeb-7957c90cc322 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050699 Mar 03 02:36:29.707805 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 528/1063] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:29 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:29.711777 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-97b49927-8051-4823-a949-dc7397222f64 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 204 len: 0 microversion: 2.1 time: 0.149282 Mar 03 02:36:29.714123 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 536/1064] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Mar 3 02:36:29 2022] DELETE /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 03 02:36:29.722793 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-dfe47743-2a59-48e4-a36f-38823d265046 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:29.723412 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-dfe47743-2a59-48e4-a36f-38823d265046 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:29.729427 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dfe47743-2a59-48e4-a36f-38823d265046 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:29.729887 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dfe47743-2a59-48e4-a36f-38823d265046 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:29.730674 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dfe47743-2a59-48e4-a36f-38823d265046 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:29.731116 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dfe47743-2a59-48e4-a36f-38823d265046 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:29.964212 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-dfe47743-2a59-48e4-a36f-38823d265046 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:29.972118 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-dfe47743-2a59-48e4-a36f-38823d265046 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1578 microversion: 2.1 time: 0.253859 Mar 03 02:36:29.972817 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 529/1065] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:36:29 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1578 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:36:30.140629 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-974dfb77-31a2-42da-994b-c884647fa9f8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:30.141405 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-974dfb77-31a2-42da-994b-c884647fa9f8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:30.148415 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-974dfb77-31a2-42da-994b-c884647fa9f8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:30.149030 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-974dfb77-31a2-42da-994b-c884647fa9f8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:30.149931 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-974dfb77-31a2-42da-994b-c884647fa9f8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:30.150481 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-974dfb77-31a2-42da-994b-c884647fa9f8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:30.300500 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-974dfb77-31a2-42da-994b-c884647fa9f8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:30.308988 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-974dfb77-31a2-42da-994b-c884647fa9f8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:30.310491 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-974dfb77-31a2-42da-994b-c884647fa9f8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:30.315247 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-974dfb77-31a2-42da-994b-c884647fa9f8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.178703 Mar 03 02:36:30.315843 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 537/1066] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:30 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:36:30.408610 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7c3bc328-9381-4d26-888c-aaba56076912 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:30.409616 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7c3bc328-9381-4d26-888c-aaba56076912 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:30.416220 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c3bc328-9381-4d26-888c-aaba56076912 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:30.416744 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c3bc328-9381-4d26-888c-aaba56076912 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:30.417598 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c3bc328-9381-4d26-888c-aaba56076912 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:30.418099 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c3bc328-9381-4d26-888c-aaba56076912 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:30.450237 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7c3bc328-9381-4d26-888c-aaba56076912 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045782 Mar 03 02:36:30.450845 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 530/1067] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:30 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:30.473629 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e4f4114c-9c15-43dc-8acb-3708ffe3f6ac tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:30.474715 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e4f4114c-9c15-43dc-8acb-3708ffe3f6ac tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:30.481067 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e4f4114c-9c15-43dc-8acb-3708ffe3f6ac tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:30.481591 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e4f4114c-9c15-43dc-8acb-3708ffe3f6ac tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:30.482443 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e4f4114c-9c15-43dc-8acb-3708ffe3f6ac tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:30.482949 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e4f4114c-9c15-43dc-8acb-3708ffe3f6ac tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:30.512246 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e4f4114c-9c15-43dc-8acb-3708ffe3f6ac tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042628 Mar 03 02:36:30.512811 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 538/1068] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:30 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:30.718421 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a04cfbba-95e9-4fee-81f6-d7dc99eedf03 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:30.719238 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a04cfbba-95e9-4fee-81f6-d7dc99eedf03 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:30.725488 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a04cfbba-95e9-4fee-81f6-d7dc99eedf03 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:30.725933 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a04cfbba-95e9-4fee-81f6-d7dc99eedf03 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:30.726697 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a04cfbba-95e9-4fee-81f6-d7dc99eedf03 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:30.727126 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a04cfbba-95e9-4fee-81f6-d7dc99eedf03 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:30.755128 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a04cfbba-95e9-4fee-81f6-d7dc99eedf03 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040685 Mar 03 02:36:30.755699 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 531/1069] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:30 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:30.990092 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-916f6fbd-be5d-4374-9ef9-d0df1bc5cab5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:30.990639 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-916f6fbd-be5d-4374-9ef9-d0df1bc5cab5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:30.996733 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-916f6fbd-be5d-4374-9ef9-d0df1bc5cab5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:30.997188 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-916f6fbd-be5d-4374-9ef9-d0df1bc5cab5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:30.997969 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-916f6fbd-be5d-4374-9ef9-d0df1bc5cab5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:30.998403 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-916f6fbd-be5d-4374-9ef9-d0df1bc5cab5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:31.135837 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-916f6fbd-be5d-4374-9ef9-d0df1bc5cab5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:31.143281 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-916f6fbd-be5d-4374-9ef9-d0df1bc5cab5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1459 microversion: 2.1 time: 0.157749 Mar 03 02:36:31.143875 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 539/1070] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:36:30 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1459 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:36:31.333674 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e24e65a3-bfa1-450e-8789-88ddec933463 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:31.334455 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e24e65a3-bfa1-450e-8789-88ddec933463 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:31.340547 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e24e65a3-bfa1-450e-8789-88ddec933463 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:31.341000 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e24e65a3-bfa1-450e-8789-88ddec933463 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:31.341877 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e24e65a3-bfa1-450e-8789-88ddec933463 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:31.342324 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e24e65a3-bfa1-450e-8789-88ddec933463 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:31.463773 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-bfb2bb2b-a66b-4ea5-a2fb-259d3ff20273 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:31.464874 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-bfb2bb2b-a66b-4ea5-a2fb-259d3ff20273 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:31.471259 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bfb2bb2b-a66b-4ea5-a2fb-259d3ff20273 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:31.471795 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bfb2bb2b-a66b-4ea5-a2fb-259d3ff20273 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:31.472569 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bfb2bb2b-a66b-4ea5-a2fb-259d3ff20273 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:31.473033 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bfb2bb2b-a66b-4ea5-a2fb-259d3ff20273 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:31.502343 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-bfb2bb2b-a66b-4ea5-a2fb-259d3ff20273 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042617 Mar 03 02:36:31.503229 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 540/1071] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:31 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:36:31.523541 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6703520f-b3a0-4f13-a4aa-2563fefe1f39 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:31.524463 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6703520f-b3a0-4f13-a4aa-2563fefe1f39 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:31.530061 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6703520f-b3a0-4f13-a4aa-2563fefe1f39 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:31.530505 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6703520f-b3a0-4f13-a4aa-2563fefe1f39 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:31.531283 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6703520f-b3a0-4f13-a4aa-2563fefe1f39 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:31.531753 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6703520f-b3a0-4f13-a4aa-2563fefe1f39 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:31.560660 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6703520f-b3a0-4f13-a4aa-2563fefe1f39 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040924 Mar 03 02:36:31.561144 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 541/1072] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:31 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:36:31.601923 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e24e65a3-bfa1-450e-8789-88ddec933463 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:31.610838 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e24e65a3-bfa1-450e-8789-88ddec933463 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:31.612583 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e24e65a3-bfa1-450e-8789-88ddec933463 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:31.613744 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e24e65a3-bfa1-450e-8789-88ddec933463 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.283980 Mar 03 02:36:31.614297 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 532/1073] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:31 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:36:31.766706 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-75b3baf2-6293-44ea-a5d4-ae88d3581bdb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:31.767748 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-75b3baf2-6293-44ea-a5d4-ae88d3581bdb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:31.774005 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-75b3baf2-6293-44ea-a5d4-ae88d3581bdb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:31.774455 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-75b3baf2-6293-44ea-a5d4-ae88d3581bdb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:31.775272 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-75b3baf2-6293-44ea-a5d4-ae88d3581bdb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:31.775743 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-75b3baf2-6293-44ea-a5d4-ae88d3581bdb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:31.806504 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-75b3baf2-6293-44ea-a5d4-ae88d3581bdb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043794 Mar 03 02:36:31.807070 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 542/1074] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:31 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:31.933197 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [req-de5c04da-18a7-4f02-8e68-e4b304cf2a06 req-022d16a9-f2ae-4c77-8043-d9e57e32324d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4ca9b17-c039-4bdc-9a51-c1351edaf4d3", "name": "network-vif-deleted", "tag": "3a27027e-071e-47ba-b741-f3a6273ab83f"}]} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:36:31.941926 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-de5c04da-18a7-4f02-8e68-e4b304cf2a06 req-022d16a9-f2ae-4c77-8043-d9e57e32324d service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:31.942378 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-de5c04da-18a7-4f02-8e68-e4b304cf2a06 req-022d16a9-f2ae-4c77-8043-d9e57e32324d service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:31.954753 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.compute.server_external_events [req-de5c04da-18a7-4f02-8e68-e4b304cf2a06 req-022d16a9-f2ae-4c77-8043-d9e57e32324d service nova] Creating event network-vif-deleted:3a27027e-071e-47ba-b741-f3a6273ab83f for instance b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 on hv-cinder-81977 Mar 03 02:36:31.959884 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [req-de5c04da-18a7-4f02-8e68-e4b304cf2a06 req-022d16a9-f2ae-4c77-8043-d9e57e32324d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090100 Mar 03 02:36:31.960488 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 533/1075] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:32.161155 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1e4fd1bd-6d71-4cc8-aada-128c18b7cc77 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:32.161698 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1e4fd1bd-6d71-4cc8-aada-128c18b7cc77 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:32.167915 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1e4fd1bd-6d71-4cc8-aada-128c18b7cc77 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:32.168362 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1e4fd1bd-6d71-4cc8-aada-128c18b7cc77 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:32.169138 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1e4fd1bd-6d71-4cc8-aada-128c18b7cc77 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:32.169568 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1e4fd1bd-6d71-4cc8-aada-128c18b7cc77 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:32.227881 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1e4fd1bd-6d71-4cc8-aada-128c18b7cc77 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:32.234988 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1e4fd1bd-6d71-4cc8-aada-128c18b7cc77 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078592 Mar 03 02:36:32.236022 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 543/1076] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:36:32 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:36:32.514598 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-34522eca-ac8d-4c4d-9b16-099e76156c2a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:32.515492 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-34522eca-ac8d-4c4d-9b16-099e76156c2a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:32.521459 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-34522eca-ac8d-4c4d-9b16-099e76156c2a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:32.521905 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-34522eca-ac8d-4c4d-9b16-099e76156c2a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:32.522669 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-34522eca-ac8d-4c4d-9b16-099e76156c2a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:32.523100 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-34522eca-ac8d-4c4d-9b16-099e76156c2a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:32.551928 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-34522eca-ac8d-4c4d-9b16-099e76156c2a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042120 Mar 03 02:36:32.552484 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 534/1077] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:32 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:32.571832 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-89f2a49b-6c1e-435b-88c4-28c45e9702cb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:32.572880 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-89f2a49b-6c1e-435b-88c4-28c45e9702cb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:32.578690 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-89f2a49b-6c1e-435b-88c4-28c45e9702cb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:32.579767 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-89f2a49b-6c1e-435b-88c4-28c45e9702cb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:32.580457 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-89f2a49b-6c1e-435b-88c4-28c45e9702cb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:32.580888 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-89f2a49b-6c1e-435b-88c4-28c45e9702cb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:32.608430 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-89f2a49b-6c1e-435b-88c4-28c45e9702cb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040572 Mar 03 02:36:32.608968 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 544/1078] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:32 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:32.631783 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6d622ceb-8efd-4872-a404-e35ee2980f3e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:32.632394 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6d622ceb-8efd-4872-a404-e35ee2980f3e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:32.638174 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6d622ceb-8efd-4872-a404-e35ee2980f3e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:32.638629 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6d622ceb-8efd-4872-a404-e35ee2980f3e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:32.639409 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6d622ceb-8efd-4872-a404-e35ee2980f3e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:32.639872 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6d622ceb-8efd-4872-a404-e35ee2980f3e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:32.772729 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6d622ceb-8efd-4872-a404-e35ee2980f3e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:32.780765 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6d622ceb-8efd-4872-a404-e35ee2980f3e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:32.782883 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6d622ceb-8efd-4872-a404-e35ee2980f3e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:32.784058 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6d622ceb-8efd-4872-a404-e35ee2980f3e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.156192 Mar 03 02:36:32.784621 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 535/1079] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:32 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:36:32.818314 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f0dbd568-c124-41ab-81d3-9908dfaa485d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:32.819216 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f0dbd568-c124-41ab-81d3-9908dfaa485d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:32.825007 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f0dbd568-c124-41ab-81d3-9908dfaa485d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:32.825449 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f0dbd568-c124-41ab-81d3-9908dfaa485d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:32.826227 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f0dbd568-c124-41ab-81d3-9908dfaa485d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:32.826648 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f0dbd568-c124-41ab-81d3-9908dfaa485d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:32.854219 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f0dbd568-c124-41ab-81d3-9908dfaa485d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039968 Mar 03 02:36:32.854758 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 545/1080] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:32 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:33.252813 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-be41e517-ae55-429e-b988-490704d40532 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:33.253418 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-be41e517-ae55-429e-b988-490704d40532 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:33.259277 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-be41e517-ae55-429e-b988-490704d40532 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:33.259763 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-be41e517-ae55-429e-b988-490704d40532 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:33.260540 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-be41e517-ae55-429e-b988-490704d40532 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:33.260977 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-be41e517-ae55-429e-b988-490704d40532 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:33.319175 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-be41e517-ae55-429e-b988-490704d40532 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:33.326361 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-be41e517-ae55-429e-b988-490704d40532 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078036 Mar 03 02:36:33.326991 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 536/1081] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:36:33 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:36:33.563861 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-318d940f-fc80-4289-b59d-e8b149f137de tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:33.564775 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-318d940f-fc80-4289-b59d-e8b149f137de tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:33.571883 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-318d940f-fc80-4289-b59d-e8b149f137de tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:33.572457 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-318d940f-fc80-4289-b59d-e8b149f137de tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:33.573055 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-318d940f-fc80-4289-b59d-e8b149f137de tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:33.573495 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-318d940f-fc80-4289-b59d-e8b149f137de tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:33.601929 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-318d940f-fc80-4289-b59d-e8b149f137de tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042104 Mar 03 02:36:33.602479 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 546/1082] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:33 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:33.618886 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5485a8c8-86b7-4cab-93bb-35c8a229cf72 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:33.620160 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5485a8c8-86b7-4cab-93bb-35c8a229cf72 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:33.626324 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5485a8c8-86b7-4cab-93bb-35c8a229cf72 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:33.626774 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5485a8c8-86b7-4cab-93bb-35c8a229cf72 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:33.628766 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5485a8c8-86b7-4cab-93bb-35c8a229cf72 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:33.629305 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5485a8c8-86b7-4cab-93bb-35c8a229cf72 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:33.656495 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5485a8c8-86b7-4cab-93bb-35c8a229cf72 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041568 Mar 03 02:36:33.657096 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 537/1083] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:33 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:33.801889 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ad3eafe6-fff1-4e94-9075-1765814e908b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:33.802486 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ad3eafe6-fff1-4e94-9075-1765814e908b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:33.808262 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ad3eafe6-fff1-4e94-9075-1765814e908b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:33.808712 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ad3eafe6-fff1-4e94-9075-1765814e908b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:33.809476 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ad3eafe6-fff1-4e94-9075-1765814e908b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:33.809906 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ad3eafe6-fff1-4e94-9075-1765814e908b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:33.865354 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1b1c0ddd-ac10-4039-bf39-f86253ade8a7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:33.866286 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1b1c0ddd-ac10-4039-bf39-f86253ade8a7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:33.872294 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1b1c0ddd-ac10-4039-bf39-f86253ade8a7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:33.872744 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1b1c0ddd-ac10-4039-bf39-f86253ade8a7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:33.873526 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1b1c0ddd-ac10-4039-bf39-f86253ade8a7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:33.873960 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1b1c0ddd-ac10-4039-bf39-f86253ade8a7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:33.902013 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1b1c0ddd-ac10-4039-bf39-f86253ade8a7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041175 Mar 03 02:36:33.902633 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 538/1084] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:33 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:36:33.941012 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ad3eafe6-fff1-4e94-9075-1765814e908b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:33.949635 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ad3eafe6-fff1-4e94-9075-1765814e908b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:33.951184 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ad3eafe6-fff1-4e94-9075-1765814e908b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:33.952400 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ad3eafe6-fff1-4e94-9075-1765814e908b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.155000 Mar 03 02:36:33.952966 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 547/1085] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:33 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:36:34.343208 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-68dd3c12-1700-415e-bf31-515c936167d0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:34.343871 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-68dd3c12-1700-415e-bf31-515c936167d0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:34.350808 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-68dd3c12-1700-415e-bf31-515c936167d0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:34.351258 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-68dd3c12-1700-415e-bf31-515c936167d0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:34.352060 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-68dd3c12-1700-415e-bf31-515c936167d0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:34.352501 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-68dd3c12-1700-415e-bf31-515c936167d0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:34.411744 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-68dd3c12-1700-415e-bf31-515c936167d0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:34.418819 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-68dd3c12-1700-415e-bf31-515c936167d0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.079546 Mar 03 02:36:34.419376 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 539/1086] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:36:34 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:36:34.613827 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-478af6c9-2e29-4237-9a0a-d80492d3dd04 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:34.614653 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-478af6c9-2e29-4237-9a0a-d80492d3dd04 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:34.621172 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-478af6c9-2e29-4237-9a0a-d80492d3dd04 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:34.621616 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-478af6c9-2e29-4237-9a0a-d80492d3dd04 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:34.622389 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-478af6c9-2e29-4237-9a0a-d80492d3dd04 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:34.622823 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-478af6c9-2e29-4237-9a0a-d80492d3dd04 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:34.651704 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-478af6c9-2e29-4237-9a0a-d80492d3dd04 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041955 Mar 03 02:36:34.652261 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 548/1087] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:34 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:34.668319 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-fc658c6d-985e-41d8-bcc5-20344c3ce028 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:34.669220 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-fc658c6d-985e-41d8-bcc5-20344c3ce028 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:34.675447 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fc658c6d-985e-41d8-bcc5-20344c3ce028 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:34.675919 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fc658c6d-985e-41d8-bcc5-20344c3ce028 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:34.676695 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fc658c6d-985e-41d8-bcc5-20344c3ce028 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:34.677128 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fc658c6d-985e-41d8-bcc5-20344c3ce028 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:34.704492 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-fc658c6d-985e-41d8-bcc5-20344c3ce028 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040071 Mar 03 02:36:34.705041 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 540/1088] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:34 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:34.913961 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0e24bddd-f249-474d-928d-24612966dd68 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:34.914792 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0e24bddd-f249-474d-928d-24612966dd68 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:34.920703 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0e24bddd-f249-474d-928d-24612966dd68 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:34.921132 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0e24bddd-f249-474d-928d-24612966dd68 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:34.921928 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0e24bddd-f249-474d-928d-24612966dd68 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:34.922360 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0e24bddd-f249-474d-928d-24612966dd68 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:34.950857 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0e24bddd-f249-474d-928d-24612966dd68 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040933 Mar 03 02:36:34.951404 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 549/1089] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:34 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:34.971151 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ec70fd18-55d3-4bc6-9955-e19b7ce3c06b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:34.972148 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ec70fd18-55d3-4bc6-9955-e19b7ce3c06b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:34.977803 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ec70fd18-55d3-4bc6-9955-e19b7ce3c06b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:34.978249 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ec70fd18-55d3-4bc6-9955-e19b7ce3c06b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:34.979015 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ec70fd18-55d3-4bc6-9955-e19b7ce3c06b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:34.979446 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ec70fd18-55d3-4bc6-9955-e19b7ce3c06b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:35.112767 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ec70fd18-55d3-4bc6-9955-e19b7ce3c06b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:35.121067 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ec70fd18-55d3-4bc6-9955-e19b7ce3c06b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:35.122564 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ec70fd18-55d3-4bc6-9955-e19b7ce3c06b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:35.123743 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ec70fd18-55d3-4bc6-9955-e19b7ce3c06b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.156447 Mar 03 02:36:35.124530 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 541/1090] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:34 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:36:35.435685 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2a4bdcbd-cdf3-4ad0-8daa-86d5ea3ca216 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:35.436287 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2a4bdcbd-cdf3-4ad0-8daa-86d5ea3ca216 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:35.442104 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2a4bdcbd-cdf3-4ad0-8daa-86d5ea3ca216 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:35.442553 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2a4bdcbd-cdf3-4ad0-8daa-86d5ea3ca216 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:35.443317 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2a4bdcbd-cdf3-4ad0-8daa-86d5ea3ca216 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:35.443784 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2a4bdcbd-cdf3-4ad0-8daa-86d5ea3ca216 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:35.505255 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2a4bdcbd-cdf3-4ad0-8daa-86d5ea3ca216 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:35.512441 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2a4bdcbd-cdf3-4ad0-8daa-86d5ea3ca216 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.080673 Mar 03 02:36:35.513004 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 550/1091] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:36:35 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:36:35.663959 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d0f81b3e-8fe1-4555-a9a1-caa46304760c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:35.664795 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d0f81b3e-8fe1-4555-a9a1-caa46304760c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:35.670611 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d0f81b3e-8fe1-4555-a9a1-caa46304760c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:35.671169 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d0f81b3e-8fe1-4555-a9a1-caa46304760c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:35.671911 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d0f81b3e-8fe1-4555-a9a1-caa46304760c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:35.672344 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d0f81b3e-8fe1-4555-a9a1-caa46304760c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:35.700935 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d0f81b3e-8fe1-4555-a9a1-caa46304760c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040978 Mar 03 02:36:35.701491 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 542/1092] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:35 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:35.716491 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2473b790-a150-455b-9ef9-4c90d3e2d745 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:35.717436 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2473b790-a150-455b-9ef9-4c90d3e2d745 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:35.724584 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2473b790-a150-455b-9ef9-4c90d3e2d745 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:35.725038 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2473b790-a150-455b-9ef9-4c90d3e2d745 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:35.725820 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2473b790-a150-455b-9ef9-4c90d3e2d745 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:35.726265 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2473b790-a150-455b-9ef9-4c90d3e2d745 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:35.753997 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2473b790-a150-455b-9ef9-4c90d3e2d745 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041427 Mar 03 02:36:35.754559 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 551/1093] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:35 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:35.962988 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7f88887b-980b-47dd-ab29-452dd44f75a4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:35.963854 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7f88887b-980b-47dd-ab29-452dd44f75a4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:35.969689 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7f88887b-980b-47dd-ab29-452dd44f75a4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:35.970136 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7f88887b-980b-47dd-ab29-452dd44f75a4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:35.970909 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7f88887b-980b-47dd-ab29-452dd44f75a4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:35.971975 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7f88887b-980b-47dd-ab29-452dd44f75a4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:35.998782 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7f88887b-980b-47dd-ab29-452dd44f75a4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039798 Mar 03 02:36:35.999346 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 543/1094] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:35 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:36.142212 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-74a27a39-60fb-476f-9b93-a84df96ec22a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:36.142869 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-74a27a39-60fb-476f-9b93-a84df96ec22a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:36.149336 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-74a27a39-60fb-476f-9b93-a84df96ec22a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:36.149791 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-74a27a39-60fb-476f-9b93-a84df96ec22a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:36.150575 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-74a27a39-60fb-476f-9b93-a84df96ec22a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:36.151012 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-74a27a39-60fb-476f-9b93-a84df96ec22a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:36.285496 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-74a27a39-60fb-476f-9b93-a84df96ec22a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:36.293663 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-74a27a39-60fb-476f-9b93-a84df96ec22a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:36.295067 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-74a27a39-60fb-476f-9b93-a84df96ec22a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:36.296240 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-74a27a39-60fb-476f-9b93-a84df96ec22a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.157956 Mar 03 02:36:36.296800 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 552/1095] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:36 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:36:36.529547 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8a1c1fe5-aef8-4cc7-9392-83f2059cc6a4 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:36.530067 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8a1c1fe5-aef8-4cc7-9392-83f2059cc6a4 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:36.536866 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8a1c1fe5-aef8-4cc7-9392-83f2059cc6a4 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:36.537311 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8a1c1fe5-aef8-4cc7-9392-83f2059cc6a4 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:36.538088 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8a1c1fe5-aef8-4cc7-9392-83f2059cc6a4 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:36.538517 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8a1c1fe5-aef8-4cc7-9392-83f2059cc6a4 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:36.595671 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8a1c1fe5-aef8-4cc7-9392-83f2059cc6a4 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:36.603397 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8a1c1fe5-aef8-4cc7-9392-83f2059cc6a4 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.077780 Mar 03 02:36:36.603984 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 544/1096] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:36:36 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:36:36.713011 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-53c506d5-dd57-42e2-b5d6-6fbf08140775 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:36.713941 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-53c506d5-dd57-42e2-b5d6-6fbf08140775 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:36.719785 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-53c506d5-dd57-42e2-b5d6-6fbf08140775 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:36.720363 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-53c506d5-dd57-42e2-b5d6-6fbf08140775 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:36.720995 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-53c506d5-dd57-42e2-b5d6-6fbf08140775 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:36.721638 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-53c506d5-dd57-42e2-b5d6-6fbf08140775 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:36.749342 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-53c506d5-dd57-42e2-b5d6-6fbf08140775 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040512 Mar 03 02:36:36.749893 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 553/1097] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:36 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:36.765336 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-47d54e13-7f6d-4908-913d-f618b21cacad tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:36.766345 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-47d54e13-7f6d-4908-913d-f618b21cacad tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:36.773188 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-47d54e13-7f6d-4908-913d-f618b21cacad tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:36.773633 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-47d54e13-7f6d-4908-913d-f618b21cacad tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:36.774404 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-47d54e13-7f6d-4908-913d-f618b21cacad tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:36.774838 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-47d54e13-7f6d-4908-913d-f618b21cacad tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:36.801892 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-47d54e13-7f6d-4908-913d-f618b21cacad tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040355 Mar 03 02:36:36.802374 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 545/1098] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:36 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:37.011441 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9c5d0d8f-7b99-43e4-81a1-058add7349c2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:37.012376 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9c5d0d8f-7b99-43e4-81a1-058add7349c2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:37.018937 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9c5d0d8f-7b99-43e4-81a1-058add7349c2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:37.019386 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9c5d0d8f-7b99-43e4-81a1-058add7349c2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:37.020185 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9c5d0d8f-7b99-43e4-81a1-058add7349c2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:37.020614 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9c5d0d8f-7b99-43e4-81a1-058add7349c2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:37.047118 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9c5d0d8f-7b99-43e4-81a1-058add7349c2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039666 Mar 03 02:36:37.047687 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 554/1099] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:37 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:37.314829 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-662cb849-371f-42af-adfc-ba6257297d1a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:37.316011 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-662cb849-371f-42af-adfc-ba6257297d1a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:37.321819 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-662cb849-371f-42af-adfc-ba6257297d1a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:37.322269 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-662cb849-371f-42af-adfc-ba6257297d1a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:37.323045 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-662cb849-371f-42af-adfc-ba6257297d1a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:37.323478 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-662cb849-371f-42af-adfc-ba6257297d1a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:37.451754 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-662cb849-371f-42af-adfc-ba6257297d1a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:37.460099 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-662cb849-371f-42af-adfc-ba6257297d1a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:37.461602 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-662cb849-371f-42af-adfc-ba6257297d1a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:37.462804 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-662cb849-371f-42af-adfc-ba6257297d1a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.152062 Mar 03 02:36:37.463391 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 546/1100] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:37 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:36:37.620307 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-de60feb9-e5d5-4993-8f89-9fb206c5425f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:37.620915 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-de60feb9-e5d5-4993-8f89-9fb206c5425f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:37.626654 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-de60feb9-e5d5-4993-8f89-9fb206c5425f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:37.627107 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-de60feb9-e5d5-4993-8f89-9fb206c5425f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:37.628691 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-de60feb9-e5d5-4993-8f89-9fb206c5425f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:37.628691 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-de60feb9-e5d5-4993-8f89-9fb206c5425f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:37.687129 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-de60feb9-e5d5-4993-8f89-9fb206c5425f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:37.694555 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-de60feb9-e5d5-4993-8f89-9fb206c5425f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078424 Mar 03 02:36:37.695288 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 555/1101] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:36:37 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:36:37.761945 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3577068b-72cb-4d8c-8a34-9da8c93db70e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:37.762858 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3577068b-72cb-4d8c-8a34-9da8c93db70e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:37.769280 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3577068b-72cb-4d8c-8a34-9da8c93db70e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:37.769848 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3577068b-72cb-4d8c-8a34-9da8c93db70e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:37.770487 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3577068b-72cb-4d8c-8a34-9da8c93db70e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:37.770924 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3577068b-72cb-4d8c-8a34-9da8c93db70e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:37.799254 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3577068b-72cb-4d8c-8a34-9da8c93db70e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041246 Mar 03 02:36:37.799904 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 547/1102] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:37 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:37.812982 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-87e254d7-4fa1-4409-be62-9ffde0aa11d5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:37.814051 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-87e254d7-4fa1-4409-be62-9ffde0aa11d5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:37.820956 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-87e254d7-4fa1-4409-be62-9ffde0aa11d5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:37.821404 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-87e254d7-4fa1-4409-be62-9ffde0aa11d5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:37.822179 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-87e254d7-4fa1-4409-be62-9ffde0aa11d5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:37.822611 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-87e254d7-4fa1-4409-be62-9ffde0aa11d5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:37.851258 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-87e254d7-4fa1-4409-be62-9ffde0aa11d5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042269 Mar 03 02:36:37.851828 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 556/1103] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:37 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:38.058376 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-386ddba7-401f-4854-b919-1327ea2feb1b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:38.059281 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-386ddba7-401f-4854-b919-1327ea2feb1b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:38.065420 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-386ddba7-401f-4854-b919-1327ea2feb1b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:38.065986 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-386ddba7-401f-4854-b919-1327ea2feb1b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:38.066798 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-386ddba7-401f-4854-b919-1327ea2feb1b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:38.067234 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-386ddba7-401f-4854-b919-1327ea2feb1b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:38.094347 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-386ddba7-401f-4854-b919-1327ea2feb1b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039937 Mar 03 02:36:38.094892 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 548/1104] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:38 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:38.481352 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-373bddf0-3219-4ce8-94b8-d3bf286fd844 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:38.481959 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-373bddf0-3219-4ce8-94b8-d3bf286fd844 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:38.488352 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-373bddf0-3219-4ce8-94b8-d3bf286fd844 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:38.488806 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-373bddf0-3219-4ce8-94b8-d3bf286fd844 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:38.489617 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-373bddf0-3219-4ce8-94b8-d3bf286fd844 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:38.490052 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-373bddf0-3219-4ce8-94b8-d3bf286fd844 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:38.622268 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-373bddf0-3219-4ce8-94b8-d3bf286fd844 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:38.631382 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-373bddf0-3219-4ce8-94b8-d3bf286fd844 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:38.632922 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-373bddf0-3219-4ce8-94b8-d3bf286fd844 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:38.634075 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-373bddf0-3219-4ce8-94b8-d3bf286fd844 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.156739 Mar 03 02:36:38.634629 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 557/1105] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:38 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:36:38.711979 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f08059cf-4f6c-4303-b3fe-e327105b2dff tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:38.712583 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f08059cf-4f6c-4303-b3fe-e327105b2dff tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:38.718320 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f08059cf-4f6c-4303-b3fe-e327105b2dff tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:38.718767 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f08059cf-4f6c-4303-b3fe-e327105b2dff tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:38.719542 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f08059cf-4f6c-4303-b3fe-e327105b2dff tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:38.720002 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f08059cf-4f6c-4303-b3fe-e327105b2dff tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:38.781767 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f08059cf-4f6c-4303-b3fe-e327105b2dff tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:38.789611 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f08059cf-4f6c-4303-b3fe-e327105b2dff tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.081482 Mar 03 02:36:38.790168 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 549/1106] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:36:38 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:36:38.810219 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9de19b22-d162-41ca-afe5-6ce021a4798f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:38.811114 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9de19b22-d162-41ca-afe5-6ce021a4798f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:38.818064 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9de19b22-d162-41ca-afe5-6ce021a4798f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:38.818641 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9de19b22-d162-41ca-afe5-6ce021a4798f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:38.819268 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9de19b22-d162-41ca-afe5-6ce021a4798f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:38.819731 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9de19b22-d162-41ca-afe5-6ce021a4798f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:38.848549 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9de19b22-d162-41ca-afe5-6ce021a4798f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042207 Mar 03 02:36:38.849111 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 558/1107] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:38 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:38.862867 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1a51b91d-aa49-4a47-9ac2-1969b5639ee7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:38.863920 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1a51b91d-aa49-4a47-9ac2-1969b5639ee7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:38.869873 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1a51b91d-aa49-4a47-9ac2-1969b5639ee7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:38.870321 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1a51b91d-aa49-4a47-9ac2-1969b5639ee7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:38.871095 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1a51b91d-aa49-4a47-9ac2-1969b5639ee7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:38.871524 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1a51b91d-aa49-4a47-9ac2-1969b5639ee7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:38.899024 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1a51b91d-aa49-4a47-9ac2-1969b5639ee7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040730 Mar 03 02:36:38.899565 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 550/1108] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:38 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:39.106418 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ad79d421-956b-450c-8c8f-140ac6177704 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:39.107354 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ad79d421-956b-450c-8c8f-140ac6177704 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:39.114013 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ad79d421-956b-450c-8c8f-140ac6177704 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:39.114452 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ad79d421-956b-450c-8c8f-140ac6177704 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:39.115223 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ad79d421-956b-450c-8c8f-140ac6177704 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:39.115693 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ad79d421-956b-450c-8c8f-140ac6177704 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:39.143507 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ad79d421-956b-450c-8c8f-140ac6177704 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040855 Mar 03 02:36:39.144070 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 559/1109] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:39 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:39.652593 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-37d6f60e-99b3-4d15-be5b-5d090f595ad8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:39.653117 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-37d6f60e-99b3-4d15-be5b-5d090f595ad8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:39.658963 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-37d6f60e-99b3-4d15-be5b-5d090f595ad8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:39.659558 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-37d6f60e-99b3-4d15-be5b-5d090f595ad8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:39.660347 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-37d6f60e-99b3-4d15-be5b-5d090f595ad8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:39.660781 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-37d6f60e-99b3-4d15-be5b-5d090f595ad8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:39.789620 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-37d6f60e-99b3-4d15-be5b-5d090f595ad8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:39.797700 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-37d6f60e-99b3-4d15-be5b-5d090f595ad8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:39.799206 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-37d6f60e-99b3-4d15-be5b-5d090f595ad8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:39.800567 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-37d6f60e-99b3-4d15-be5b-5d090f595ad8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.151949 Mar 03 02:36:39.801305 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 551/1110] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:39 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:36:39.806353 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9b5c4a51-af0c-443d-9900-9074040211c5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:39.806966 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9b5c4a51-af0c-443d-9900-9074040211c5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:39.812862 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9b5c4a51-af0c-443d-9900-9074040211c5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:39.813394 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9b5c4a51-af0c-443d-9900-9074040211c5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:39.814300 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9b5c4a51-af0c-443d-9900-9074040211c5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:39.815310 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9b5c4a51-af0c-443d-9900-9074040211c5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:39.859911 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-eccb20a7-fe53-4afa-aa48-0aae70d1507c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:39.860829 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-eccb20a7-fe53-4afa-aa48-0aae70d1507c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:39.866645 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-eccb20a7-fe53-4afa-aa48-0aae70d1507c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:39.867103 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-eccb20a7-fe53-4afa-aa48-0aae70d1507c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:39.867931 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-eccb20a7-fe53-4afa-aa48-0aae70d1507c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:39.868373 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-eccb20a7-fe53-4afa-aa48-0aae70d1507c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:39.875250 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9b5c4a51-af0c-443d-9900-9074040211c5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:39.883058 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9b5c4a51-af0c-443d-9900-9074040211c5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.080568 Mar 03 02:36:39.883654 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 560/1111] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:36:39 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:36:39.897863 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-eccb20a7-fe53-4afa-aa48-0aae70d1507c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041860 Mar 03 02:36:39.898423 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 552/1112] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:39 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:36:39.910179 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-73106235-02df-4b5d-8ea0-ced61bf20ac4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:39.911032 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-73106235-02df-4b5d-8ea0-ced61bf20ac4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:39.916734 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-73106235-02df-4b5d-8ea0-ced61bf20ac4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:39.917216 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-73106235-02df-4b5d-8ea0-ced61bf20ac4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:39.918001 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-73106235-02df-4b5d-8ea0-ced61bf20ac4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:39.918440 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-73106235-02df-4b5d-8ea0-ced61bf20ac4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:39.946212 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-73106235-02df-4b5d-8ea0-ced61bf20ac4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039981 Mar 03 02:36:39.946912 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 561/1113] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:39 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:40.154817 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c24232b6-13c3-40f3-958a-ce9778545afc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:40.155746 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c24232b6-13c3-40f3-958a-ce9778545afc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:40.162259 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c24232b6-13c3-40f3-958a-ce9778545afc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:40.162649 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c24232b6-13c3-40f3-958a-ce9778545afc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:40.163424 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c24232b6-13c3-40f3-958a-ce9778545afc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:40.163883 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c24232b6-13c3-40f3-958a-ce9778545afc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:40.192349 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c24232b6-13c3-40f3-958a-ce9778545afc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041491 Mar 03 02:36:40.192890 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 553/1114] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:40 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:40.818592 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4b6c02cf-0b4f-45a4-9524-5dc38ac252ac tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:40.819202 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4b6c02cf-0b4f-45a4-9524-5dc38ac252ac tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:40.825442 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4b6c02cf-0b4f-45a4-9524-5dc38ac252ac tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:40.825887 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4b6c02cf-0b4f-45a4-9524-5dc38ac252ac tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:40.826655 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4b6c02cf-0b4f-45a4-9524-5dc38ac252ac tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:40.827086 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4b6c02cf-0b4f-45a4-9524-5dc38ac252ac tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:40.900076 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-bb5c80ef-d65d-4316-8622-bc2cad732e72 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:40.900683 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-bb5c80ef-d65d-4316-8622-bc2cad732e72 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:40.908010 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bb5c80ef-d65d-4316-8622-bc2cad732e72 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:40.908455 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bb5c80ef-d65d-4316-8622-bc2cad732e72 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:40.910454 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bb5c80ef-d65d-4316-8622-bc2cad732e72 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:40.911272 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bb5c80ef-d65d-4316-8622-bc2cad732e72 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:40.957604 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4b6c02cf-0b4f-45a4-9524-5dc38ac252ac tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:40.965705 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4b6c02cf-0b4f-45a4-9524-5dc38ac252ac tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:40.967196 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4b6c02cf-0b4f-45a4-9524-5dc38ac252ac tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:40.968379 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4b6c02cf-0b4f-45a4-9524-5dc38ac252ac tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.153915 Mar 03 02:36:40.972251 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 562/1115] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:40 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:36:40.972352 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-bb5c80ef-d65d-4316-8622-bc2cad732e72 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:40.974099 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-11566fc9-f790-4710-9571-c6a323d33c6a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:40.974999 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-11566fc9-f790-4710-9571-c6a323d33c6a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:40.978235 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-bb5c80ef-d65d-4316-8622-bc2cad732e72 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.081978 Mar 03 02:36:40.979891 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 554/1116] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:36:40 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:36:40.980694 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-11566fc9-f790-4710-9571-c6a323d33c6a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:40.981143 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-11566fc9-f790-4710-9571-c6a323d33c6a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:40.981923 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-11566fc9-f790-4710-9571-c6a323d33c6a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:40.982356 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-11566fc9-f790-4710-9571-c6a323d33c6a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:40.983737 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-db2fa140-27cf-4b87-9324-fdf9d9fb43c9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:40.984622 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-db2fa140-27cf-4b87-9324-fdf9d9fb43c9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:40.990526 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-db2fa140-27cf-4b87-9324-fdf9d9fb43c9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:40.990985 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-db2fa140-27cf-4b87-9324-fdf9d9fb43c9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:40.991823 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-db2fa140-27cf-4b87-9324-fdf9d9fb43c9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:40.992266 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-db2fa140-27cf-4b87-9324-fdf9d9fb43c9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:41.011922 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-11566fc9-f790-4710-9571-c6a323d33c6a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041960 Mar 03 02:36:41.012478 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 563/1117] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:40 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:41.021925 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-db2fa140-27cf-4b87-9324-fdf9d9fb43c9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041678 Mar 03 02:36:41.022484 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 555/1118] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:40 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:41.204229 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b45a5552-d237-483f-bad4-831754196d26 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:41.205130 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b45a5552-d237-483f-bad4-831754196d26 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:41.211930 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b45a5552-d237-483f-bad4-831754196d26 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:41.212376 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b45a5552-d237-483f-bad4-831754196d26 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:41.213147 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b45a5552-d237-483f-bad4-831754196d26 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:41.213575 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b45a5552-d237-483f-bad4-831754196d26 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:41.240770 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b45a5552-d237-483f-bad4-831754196d26 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040777 Mar 03 02:36:41.241320 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 564/1119] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:41 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:41.987501 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2316c1d3-cb5d-418d-b204-627595cb9249 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:41.988280 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2316c1d3-cb5d-418d-b204-627595cb9249 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:41.994148 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2316c1d3-cb5d-418d-b204-627595cb9249 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:41.994828 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-46d42ba1-c3ec-4149-bd8d-fe6df0708137 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:41.995228 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2316c1d3-cb5d-418d-b204-627595cb9249 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:41.995445 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-46d42ba1-c3ec-4149-bd8d-fe6df0708137 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:41.995632 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2316c1d3-cb5d-418d-b204-627595cb9249 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:41.996122 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2316c1d3-cb5d-418d-b204-627595cb9249 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:42.001942 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-46d42ba1-c3ec-4149-bd8d-fe6df0708137 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:42.002951 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-46d42ba1-c3ec-4149-bd8d-fe6df0708137 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:42.003867 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-46d42ba1-c3ec-4149-bd8d-fe6df0708137 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:42.004315 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-46d42ba1-c3ec-4149-bd8d-fe6df0708137 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:42.066925 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-46d42ba1-c3ec-4149-bd8d-fe6df0708137 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:42.074147 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-46d42ba1-c3ec-4149-bd8d-fe6df0708137 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.083354 Mar 03 02:36:42.075058 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 565/1120] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:36:41 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:36:42.079635 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-292d1be2-7eac-49e6-9dfe-be05ddca6be0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:42.081165 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-292d1be2-7eac-49e6-9dfe-be05ddca6be0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:42.086820 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-292d1be2-7eac-49e6-9dfe-be05ddca6be0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:42.087268 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-292d1be2-7eac-49e6-9dfe-be05ddca6be0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:42.088072 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-292d1be2-7eac-49e6-9dfe-be05ddca6be0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:42.088508 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-292d1be2-7eac-49e6-9dfe-be05ddca6be0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:42.116279 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-292d1be2-7eac-49e6-9dfe-be05ddca6be0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040176 Mar 03 02:36:42.116832 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 566/1121] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:42 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:42.121993 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0c874deb-cb6f-4baf-93d3-b3235d23c16d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:42.122914 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0c874deb-cb6f-4baf-93d3-b3235d23c16d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:42.129822 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0c874deb-cb6f-4baf-93d3-b3235d23c16d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:42.130274 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0c874deb-cb6f-4baf-93d3-b3235d23c16d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:42.131066 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0c874deb-cb6f-4baf-93d3-b3235d23c16d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:42.131500 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0c874deb-cb6f-4baf-93d3-b3235d23c16d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:42.133217 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2316c1d3-cb5d-418d-b204-627595cb9249 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:42.141656 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2316c1d3-cb5d-418d-b204-627595cb9249 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:42.143815 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2316c1d3-cb5d-418d-b204-627595cb9249 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:42.144963 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2316c1d3-cb5d-418d-b204-627595cb9249 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.162047 Mar 03 02:36:42.145518 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 556/1122] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:41 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:36:42.160927 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0c874deb-cb6f-4baf-93d3-b3235d23c16d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043096 Mar 03 02:36:42.161471 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 567/1123] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:42 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:42.253073 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-bbfc7762-ef7e-41fd-b550-4f3859395c38 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:42.254065 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-bbfc7762-ef7e-41fd-b550-4f3859395c38 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:42.259781 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bbfc7762-ef7e-41fd-b550-4f3859395c38 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:42.260231 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bbfc7762-ef7e-41fd-b550-4f3859395c38 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:42.261006 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bbfc7762-ef7e-41fd-b550-4f3859395c38 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:42.261441 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bbfc7762-ef7e-41fd-b550-4f3859395c38 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:42.289593 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-bbfc7762-ef7e-41fd-b550-4f3859395c38 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040920 Mar 03 02:36:42.290149 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 557/1124] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:42 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:43.091720 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-cb508caa-b606-43b2-99b1-9b962751a069 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:43.092259 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-cb508caa-b606-43b2-99b1-9b962751a069 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:43.098658 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cb508caa-b606-43b2-99b1-9b962751a069 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:43.099106 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cb508caa-b606-43b2-99b1-9b962751a069 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:43.099902 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cb508caa-b606-43b2-99b1-9b962751a069 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:43.100333 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cb508caa-b606-43b2-99b1-9b962751a069 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:43.128610 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-20dad7bd-336e-4c50-8d06-28da0ff70504 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:43.129515 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-20dad7bd-336e-4c50-8d06-28da0ff70504 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:43.135911 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-20dad7bd-336e-4c50-8d06-28da0ff70504 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:43.136368 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-20dad7bd-336e-4c50-8d06-28da0ff70504 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:43.137158 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-20dad7bd-336e-4c50-8d06-28da0ff70504 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:43.137597 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-20dad7bd-336e-4c50-8d06-28da0ff70504 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:43.159857 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-cb508caa-b606-43b2-99b1-9b962751a069 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:43.167058 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-20dad7bd-336e-4c50-8d06-28da0ff70504 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042857 Mar 03 02:36:43.167317 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-cb508caa-b606-43b2-99b1-9b962751a069 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.079293 Mar 03 02:36:43.167647 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 558/1125] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:43 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:36:43.175701 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 568/1126] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:36:43 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:36:43.175865 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6b7676db-2557-43ea-9ef8-d8bd9f65b2e1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:43.175865 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6b7676db-2557-43ea-9ef8-d8bd9f65b2e1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:43.176052 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-083b1793-8684-447a-a6a8-15e2fb73f869 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:43.176052 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-083b1793-8684-447a-a6a8-15e2fb73f869 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:43.179361 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6b7676db-2557-43ea-9ef8-d8bd9f65b2e1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:43.179745 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-083b1793-8684-447a-a6a8-15e2fb73f869 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:43.179875 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6b7676db-2557-43ea-9ef8-d8bd9f65b2e1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:43.180202 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-083b1793-8684-447a-a6a8-15e2fb73f869 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:43.180612 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6b7676db-2557-43ea-9ef8-d8bd9f65b2e1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:43.180988 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-083b1793-8684-447a-a6a8-15e2fb73f869 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:43.181101 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6b7676db-2557-43ea-9ef8-d8bd9f65b2e1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:43.181429 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-083b1793-8684-447a-a6a8-15e2fb73f869 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:43.209511 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-083b1793-8684-447a-a6a8-15e2fb73f869 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040331 Mar 03 02:36:43.211024 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 569/1127] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:43 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:43.302060 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c23b4c16-7bfe-41ae-a4ed-b2fae3177c00 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:43.302966 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c23b4c16-7bfe-41ae-a4ed-b2fae3177c00 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:43.308971 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c23b4c16-7bfe-41ae-a4ed-b2fae3177c00 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:43.309421 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c23b4c16-7bfe-41ae-a4ed-b2fae3177c00 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:43.310137 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6b7676db-2557-43ea-9ef8-d8bd9f65b2e1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:43.310275 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c23b4c16-7bfe-41ae-a4ed-b2fae3177c00 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:43.310614 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c23b4c16-7bfe-41ae-a4ed-b2fae3177c00 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:43.318902 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6b7676db-2557-43ea-9ef8-d8bd9f65b2e1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:43.320455 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6b7676db-2557-43ea-9ef8-d8bd9f65b2e1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:43.321596 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6b7676db-2557-43ea-9ef8-d8bd9f65b2e1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.153054 Mar 03 02:36:43.322154 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 559/1128] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:43 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:36:43.338994 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c23b4c16-7bfe-41ae-a4ed-b2fae3177c00 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041556 Mar 03 02:36:43.339518 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 570/1129] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:43 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:36:44.178947 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f7d17cda-28a5-4290-9721-d696c20fca43 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:44.179908 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f7d17cda-28a5-4290-9721-d696c20fca43 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:44.185272 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6246c863-3363-4f1b-8ff7-08652432de4c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:44.185872 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6246c863-3363-4f1b-8ff7-08652432de4c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:44.186144 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f7d17cda-28a5-4290-9721-d696c20fca43 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:44.186593 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f7d17cda-28a5-4290-9721-d696c20fca43 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:44.187379 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f7d17cda-28a5-4290-9721-d696c20fca43 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:44.187839 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f7d17cda-28a5-4290-9721-d696c20fca43 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:44.192306 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6246c863-3363-4f1b-8ff7-08652432de4c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:44.192760 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6246c863-3363-4f1b-8ff7-08652432de4c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:44.193534 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6246c863-3363-4f1b-8ff7-08652432de4c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:44.193963 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6246c863-3363-4f1b-8ff7-08652432de4c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:44.216268 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f7d17cda-28a5-4290-9721-d696c20fca43 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042340 Mar 03 02:36:44.217027 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 560/1130] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:44 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:36:44.221996 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-250a4b75-4344-4983-b773-42e5a77ade5f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:44.222885 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-250a4b75-4344-4983-b773-42e5a77ade5f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:44.228604 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-250a4b75-4344-4983-b773-42e5a77ade5f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:44.229058 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-250a4b75-4344-4983-b773-42e5a77ade5f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:44.229870 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-250a4b75-4344-4983-b773-42e5a77ade5f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:44.230307 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-250a4b75-4344-4983-b773-42e5a77ade5f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:44.254232 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-6246c863-3363-4f1b-8ff7-08652432de4c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:44.258867 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-250a4b75-4344-4983-b773-42e5a77ade5f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040860 Mar 03 02:36:44.259433 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 561/1131] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:44 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:36:44.261732 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6246c863-3363-4f1b-8ff7-08652432de4c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.080203 Mar 03 02:36:44.262360 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 571/1132] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:36:44 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:36:44.340117 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-84b2ae12-663f-4c59-9683-f2baa1acaa91 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:44.340763 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-84b2ae12-663f-4c59-9683-f2baa1acaa91 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:44.347137 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-84b2ae12-663f-4c59-9683-f2baa1acaa91 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:44.347588 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-84b2ae12-663f-4c59-9683-f2baa1acaa91 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:44.348395 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-84b2ae12-663f-4c59-9683-f2baa1acaa91 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:44.348838 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-84b2ae12-663f-4c59-9683-f2baa1acaa91 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:44.351295 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e300253b-5156-403c-a7fa-11efeaaf0d74 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:44.352247 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e300253b-5156-403c-a7fa-11efeaaf0d74 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:44.358059 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e300253b-5156-403c-a7fa-11efeaaf0d74 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:44.358506 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e300253b-5156-403c-a7fa-11efeaaf0d74 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:44.359293 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e300253b-5156-403c-a7fa-11efeaaf0d74 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:44.359759 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e300253b-5156-403c-a7fa-11efeaaf0d74 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:44.388624 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e300253b-5156-403c-a7fa-11efeaaf0d74 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041296 Mar 03 02:36:44.389197 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 572/1133] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:44 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:36:44.477679 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-84b2ae12-663f-4c59-9683-f2baa1acaa91 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:44.485719 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-84b2ae12-663f-4c59-9683-f2baa1acaa91 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:44.488441 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-84b2ae12-663f-4c59-9683-f2baa1acaa91 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:44.489592 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-84b2ae12-663f-4c59-9683-f2baa1acaa91 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.153354 Mar 03 02:36:44.490151 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 562/1134] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:44 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:36:45.228427 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1df73827-95d0-42ba-bf12-b6eba284a53e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:45.229330 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1df73827-95d0-42ba-bf12-b6eba284a53e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:45.235453 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1df73827-95d0-42ba-bf12-b6eba284a53e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:45.235925 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1df73827-95d0-42ba-bf12-b6eba284a53e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:45.237442 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1df73827-95d0-42ba-bf12-b6eba284a53e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:45.238053 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1df73827-95d0-42ba-bf12-b6eba284a53e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:45.265383 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1df73827-95d0-42ba-bf12-b6eba284a53e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040933 Mar 03 02:36:45.265932 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 573/1135] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:45 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:45.271121 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-32460dbb-9ba4-42e3-9d22-35a27f154ca4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:45.272087 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-32460dbb-9ba4-42e3-9d22-35a27f154ca4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:45.277718 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-57c23411-7efa-430e-8a3d-051e7664e114 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:45.278270 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-32460dbb-9ba4-42e3-9d22-35a27f154ca4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:45.278405 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-57c23411-7efa-430e-8a3d-051e7664e114 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:45.278722 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-32460dbb-9ba4-42e3-9d22-35a27f154ca4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:45.279506 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-32460dbb-9ba4-42e3-9d22-35a27f154ca4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:45.279969 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-32460dbb-9ba4-42e3-9d22-35a27f154ca4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:45.284441 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-57c23411-7efa-430e-8a3d-051e7664e114 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:45.284888 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-57c23411-7efa-430e-8a3d-051e7664e114 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:45.285664 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-57c23411-7efa-430e-8a3d-051e7664e114 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:45.286096 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-57c23411-7efa-430e-8a3d-051e7664e114 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:45.310444 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-32460dbb-9ba4-42e3-9d22-35a27f154ca4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043988 Mar 03 02:36:45.310923 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 563/1136] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:45 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:36:45.345144 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-57c23411-7efa-430e-8a3d-051e7664e114 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:45.353103 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-57c23411-7efa-430e-8a3d-051e7664e114 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.079039 Mar 03 02:36:45.353672 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 574/1137] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:36:45 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:36:45.399995 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3d48d5c4-f49a-4143-bee7-0d64f8bb3824 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:45.400891 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3d48d5c4-f49a-4143-bee7-0d64f8bb3824 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:45.406895 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3d48d5c4-f49a-4143-bee7-0d64f8bb3824 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:45.407344 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3d48d5c4-f49a-4143-bee7-0d64f8bb3824 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:45.408161 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3d48d5c4-f49a-4143-bee7-0d64f8bb3824 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:45.409251 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3d48d5c4-f49a-4143-bee7-0d64f8bb3824 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:45.436786 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3d48d5c4-f49a-4143-bee7-0d64f8bb3824 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040664 Mar 03 02:36:45.437341 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 564/1138] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:45 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:45.507980 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8b9e823c-de2f-4904-a386-9d10b4043b43 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:45.508590 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8b9e823c-de2f-4904-a386-9d10b4043b43 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:45.514396 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8b9e823c-de2f-4904-a386-9d10b4043b43 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:45.514850 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8b9e823c-de2f-4904-a386-9d10b4043b43 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:45.515647 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8b9e823c-de2f-4904-a386-9d10b4043b43 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:45.516086 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8b9e823c-de2f-4904-a386-9d10b4043b43 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:45.645225 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8b9e823c-de2f-4904-a386-9d10b4043b43 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:45.653314 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8b9e823c-de2f-4904-a386-9d10b4043b43 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:45.654811 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8b9e823c-de2f-4904-a386-9d10b4043b43 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:45.655994 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8b9e823c-de2f-4904-a386-9d10b4043b43 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.151839 Mar 03 02:36:45.656553 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 575/1139] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:45 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:36:46.276934 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-09e445a1-ee5a-4cd3-b947-ca8fd1ed588f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:46.277826 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-09e445a1-ee5a-4cd3-b947-ca8fd1ed588f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:46.284057 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-09e445a1-ee5a-4cd3-b947-ca8fd1ed588f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:46.284461 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-09e445a1-ee5a-4cd3-b947-ca8fd1ed588f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:46.285231 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-09e445a1-ee5a-4cd3-b947-ca8fd1ed588f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:46.285664 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-09e445a1-ee5a-4cd3-b947-ca8fd1ed588f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:46.313163 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-09e445a1-ee5a-4cd3-b947-ca8fd1ed588f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040109 Mar 03 02:36:46.313669 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 565/1140] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:46 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:46.322771 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1a15020e-b1f1-4382-9f05-ec4dd4dae086 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:46.323719 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1a15020e-b1f1-4382-9f05-ec4dd4dae086 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:46.330125 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1a15020e-b1f1-4382-9f05-ec4dd4dae086 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:46.330738 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1a15020e-b1f1-4382-9f05-ec4dd4dae086 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:46.331521 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1a15020e-b1f1-4382-9f05-ec4dd4dae086 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:46.331987 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1a15020e-b1f1-4382-9f05-ec4dd4dae086 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:46.358891 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1a15020e-b1f1-4382-9f05-ec4dd4dae086 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040438 Mar 03 02:36:46.359435 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 576/1141] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:46 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:46.369816 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5c8940bc-c759-4f52-ad22-d26226b72f88 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:46.370416 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5c8940bc-c759-4f52-ad22-d26226b72f88 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:46.376099 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5c8940bc-c759-4f52-ad22-d26226b72f88 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:46.376553 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5c8940bc-c759-4f52-ad22-d26226b72f88 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:46.378088 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5c8940bc-c759-4f52-ad22-d26226b72f88 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:46.378522 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5c8940bc-c759-4f52-ad22-d26226b72f88 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:46.438197 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5c8940bc-c759-4f52-ad22-d26226b72f88 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:46.445452 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5c8940bc-c759-4f52-ad22-d26226b72f88 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.079616 Mar 03 02:36:46.446015 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 566/1142] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:36:46 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:36:46.448525 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ed944d31-1875-4006-ba88-82d893cc1875 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:46.449438 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ed944d31-1875-4006-ba88-82d893cc1875 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:46.455283 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ed944d31-1875-4006-ba88-82d893cc1875 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:46.456314 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ed944d31-1875-4006-ba88-82d893cc1875 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:46.457097 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ed944d31-1875-4006-ba88-82d893cc1875 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:46.457540 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ed944d31-1875-4006-ba88-82d893cc1875 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:46.485746 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ed944d31-1875-4006-ba88-82d893cc1875 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041117 Mar 03 02:36:46.486291 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 577/1143] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:46 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:36:46.674813 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-90526dc3-1b4e-476b-b432-b745d4a9f92f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:46.675422 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-90526dc3-1b4e-476b-b432-b745d4a9f92f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:46.681144 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-90526dc3-1b4e-476b-b432-b745d4a9f92f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:46.681590 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-90526dc3-1b4e-476b-b432-b745d4a9f92f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:46.682352 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-90526dc3-1b4e-476b-b432-b745d4a9f92f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:46.682783 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-90526dc3-1b4e-476b-b432-b745d4a9f92f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:46.810406 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-90526dc3-1b4e-476b-b432-b745d4a9f92f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:46.818453 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-90526dc3-1b4e-476b-b432-b745d4a9f92f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:46.819967 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-90526dc3-1b4e-476b-b432-b745d4a9f92f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:46.821098 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-90526dc3-1b4e-476b-b432-b745d4a9f92f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.150866 Mar 03 02:36:46.821657 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 567/1144] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:46 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:36:47.325743 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-77a2ce90-230f-4d38-8e8f-9a4900146054 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:47.326653 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-77a2ce90-230f-4d38-8e8f-9a4900146054 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:47.333779 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-77a2ce90-230f-4d38-8e8f-9a4900146054 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:47.334228 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-77a2ce90-230f-4d38-8e8f-9a4900146054 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:47.335000 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-77a2ce90-230f-4d38-8e8f-9a4900146054 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:47.335433 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-77a2ce90-230f-4d38-8e8f-9a4900146054 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:47.362277 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-77a2ce90-230f-4d38-8e8f-9a4900146054 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040718 Mar 03 02:36:47.362832 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 578/1145] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:47 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:47.371139 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d7a7bd65-27fd-4a5d-b877-f11b981ab284 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:47.372069 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d7a7bd65-27fd-4a5d-b877-f11b981ab284 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:47.378884 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d7a7bd65-27fd-4a5d-b877-f11b981ab284 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:47.379364 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d7a7bd65-27fd-4a5d-b877-f11b981ab284 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:47.380172 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d7a7bd65-27fd-4a5d-b877-f11b981ab284 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:47.380610 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d7a7bd65-27fd-4a5d-b877-f11b981ab284 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:47.408236 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d7a7bd65-27fd-4a5d-b877-f11b981ab284 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041312 Mar 03 02:36:47.408929 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 568/1146] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:47 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:36:47.462276 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-91ba87d1-c31a-498c-8436-121361007b06 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:47.462892 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-91ba87d1-c31a-498c-8436-121361007b06 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:47.468760 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-91ba87d1-c31a-498c-8436-121361007b06 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:47.469216 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-91ba87d1-c31a-498c-8436-121361007b06 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:47.470000 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-91ba87d1-c31a-498c-8436-121361007b06 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:47.470447 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-91ba87d1-c31a-498c-8436-121361007b06 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:47.498481 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f3352280-c784-45dd-9099-9495e758909a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:47.499390 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f3352280-c784-45dd-9099-9495e758909a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:47.505946 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f3352280-c784-45dd-9099-9495e758909a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:47.506419 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f3352280-c784-45dd-9099-9495e758909a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:47.507228 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f3352280-c784-45dd-9099-9495e758909a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:47.507679 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f3352280-c784-45dd-9099-9495e758909a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:47.531488 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-91ba87d1-c31a-498c-8436-121361007b06 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:47.536855 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f3352280-c784-45dd-9099-9495e758909a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042438 Mar 03 02:36:47.537414 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 569/1147] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:47 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:36:47.538754 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-91ba87d1-c31a-498c-8436-121361007b06 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.080303 Mar 03 02:36:47.539304 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 579/1148] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:36:47 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:36:47.839347 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-98bc1b27-d426-4d6a-a73c-c283cae254bb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:47.839967 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-98bc1b27-d426-4d6a-a73c-c283cae254bb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:47.845675 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-98bc1b27-d426-4d6a-a73c-c283cae254bb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:47.846772 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-98bc1b27-d426-4d6a-a73c-c283cae254bb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:47.847592 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-98bc1b27-d426-4d6a-a73c-c283cae254bb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:47.848043 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-98bc1b27-d426-4d6a-a73c-c283cae254bb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:47.975308 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-98bc1b27-d426-4d6a-a73c-c283cae254bb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:47.983544 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-98bc1b27-d426-4d6a-a73c-c283cae254bb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:47.985059 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-98bc1b27-d426-4d6a-a73c-c283cae254bb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:47.986214 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-98bc1b27-d426-4d6a-a73c-c283cae254bb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.150752 Mar 03 02:36:47.986796 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 570/1149] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:47 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:36:48.373952 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-58c3e6b0-b63c-4a4f-b074-ec1bdbba419a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:48.374854 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-58c3e6b0-b63c-4a4f-b074-ec1bdbba419a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:48.381768 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-58c3e6b0-b63c-4a4f-b074-ec1bdbba419a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:48.382210 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-58c3e6b0-b63c-4a4f-b074-ec1bdbba419a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:48.382985 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-58c3e6b0-b63c-4a4f-b074-ec1bdbba419a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:48.383422 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-58c3e6b0-b63c-4a4f-b074-ec1bdbba419a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:48.411394 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-58c3e6b0-b63c-4a4f-b074-ec1bdbba419a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041329 Mar 03 02:36:48.411971 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 580/1150] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:48 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:48.422936 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-cdaf8350-9222-4405-a94f-4d78b3fef4e4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:48.422936 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-cdaf8350-9222-4405-a94f-4d78b3fef4e4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:48.429273 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cdaf8350-9222-4405-a94f-4d78b3fef4e4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:48.429752 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cdaf8350-9222-4405-a94f-4d78b3fef4e4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:48.430532 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cdaf8350-9222-4405-a94f-4d78b3fef4e4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:48.431000 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cdaf8350-9222-4405-a94f-4d78b3fef4e4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:48.459585 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-cdaf8350-9222-4405-a94f-4d78b3fef4e4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043332 Mar 03 02:36:48.463422 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 571/1151] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:48 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:48.548220 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-753382df-7736-4bbc-a79c-f9520ea6a941 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:48.549193 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-753382df-7736-4bbc-a79c-f9520ea6a941 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:48.553968 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4894dc0e-504b-490e-8a1e-768b43e09e5e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:48.554572 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4894dc0e-504b-490e-8a1e-768b43e09e5e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:48.555008 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-753382df-7736-4bbc-a79c-f9520ea6a941 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:48.555457 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-753382df-7736-4bbc-a79c-f9520ea6a941 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:48.556274 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-753382df-7736-4bbc-a79c-f9520ea6a941 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:48.556704 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-753382df-7736-4bbc-a79c-f9520ea6a941 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:48.560236 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4894dc0e-504b-490e-8a1e-768b43e09e5e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:48.560691 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4894dc0e-504b-490e-8a1e-768b43e09e5e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:48.561468 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4894dc0e-504b-490e-8a1e-768b43e09e5e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:48.561955 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4894dc0e-504b-490e-8a1e-768b43e09e5e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:48.584431 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-753382df-7736-4bbc-a79c-f9520ea6a941 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040104 Mar 03 02:36:48.584988 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 581/1152] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:48 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:48.624274 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4894dc0e-504b-490e-8a1e-768b43e09e5e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:48.632086 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4894dc0e-504b-490e-8a1e-768b43e09e5e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.081848 Mar 03 02:36:48.632653 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 572/1153] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:36:48 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:36:49.005332 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c0eb1f87-f0b3-4405-8e72-d274e88e4272 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:49.005848 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c0eb1f87-f0b3-4405-8e72-d274e88e4272 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:49.011666 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c0eb1f87-f0b3-4405-8e72-d274e88e4272 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:49.012115 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c0eb1f87-f0b3-4405-8e72-d274e88e4272 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:49.012891 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c0eb1f87-f0b3-4405-8e72-d274e88e4272 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:49.013323 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c0eb1f87-f0b3-4405-8e72-d274e88e4272 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:49.143424 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c0eb1f87-f0b3-4405-8e72-d274e88e4272 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:49.151533 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c0eb1f87-f0b3-4405-8e72-d274e88e4272 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:49.153066 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c0eb1f87-f0b3-4405-8e72-d274e88e4272 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:49.154222 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c0eb1f87-f0b3-4405-8e72-d274e88e4272 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.153472 Mar 03 02:36:49.154785 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 582/1154] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:48 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:36:49.422287 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3c826cb4-ad75-48dc-9727-175e31ec7189 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:49.423187 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3c826cb4-ad75-48dc-9727-175e31ec7189 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:49.430087 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3c826cb4-ad75-48dc-9727-175e31ec7189 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:49.430533 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3c826cb4-ad75-48dc-9727-175e31ec7189 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:49.431310 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3c826cb4-ad75-48dc-9727-175e31ec7189 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:49.431773 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3c826cb4-ad75-48dc-9727-175e31ec7189 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:49.460034 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3c826cb4-ad75-48dc-9727-175e31ec7189 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041617 Mar 03 02:36:49.460580 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 573/1155] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:49 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:49.470336 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1d24a519-4ac8-441e-b113-53a39db14865 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:49.471433 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1d24a519-4ac8-441e-b113-53a39db14865 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:49.477680 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1d24a519-4ac8-441e-b113-53a39db14865 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:49.478166 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1d24a519-4ac8-441e-b113-53a39db14865 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:49.478949 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1d24a519-4ac8-441e-b113-53a39db14865 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:49.479389 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1d24a519-4ac8-441e-b113-53a39db14865 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:49.507883 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1d24a519-4ac8-441e-b113-53a39db14865 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041422 Mar 03 02:36:49.508433 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 583/1156] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:49 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:49.595835 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-36e2fc7d-aef4-4356-8250-61e0fdba4b7c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:49.596940 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-36e2fc7d-aef4-4356-8250-61e0fdba4b7c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:49.602723 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-36e2fc7d-aef4-4356-8250-61e0fdba4b7c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:49.603165 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-36e2fc7d-aef4-4356-8250-61e0fdba4b7c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:49.603966 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-36e2fc7d-aef4-4356-8250-61e0fdba4b7c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:49.604399 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-36e2fc7d-aef4-4356-8250-61e0fdba4b7c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:49.632359 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-36e2fc7d-aef4-4356-8250-61e0fdba4b7c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040467 Mar 03 02:36:49.632837 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 574/1157] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:49 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:49.648612 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2df95a6d-ffb7-4dc7-baff-3c52c3bd60b4 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:49.649252 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2df95a6d-ffb7-4dc7-baff-3c52c3bd60b4 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:49.654962 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2df95a6d-ffb7-4dc7-baff-3c52c3bd60b4 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:49.655414 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2df95a6d-ffb7-4dc7-baff-3c52c3bd60b4 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:49.656223 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2df95a6d-ffb7-4dc7-baff-3c52c3bd60b4 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:49.656663 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2df95a6d-ffb7-4dc7-baff-3c52c3bd60b4 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:49.715283 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2df95a6d-ffb7-4dc7-baff-3c52c3bd60b4 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:49.723214 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2df95a6d-ffb7-4dc7-baff-3c52c3bd60b4 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078074 Mar 03 02:36:49.723939 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 584/1158] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:36:49 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:36:50.172329 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c8415e81-8f99-4753-bcac-94d77fc1e908 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:50.172940 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c8415e81-8f99-4753-bcac-94d77fc1e908 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:50.180305 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c8415e81-8f99-4753-bcac-94d77fc1e908 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:50.180758 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c8415e81-8f99-4753-bcac-94d77fc1e908 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:50.181538 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c8415e81-8f99-4753-bcac-94d77fc1e908 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:50.182064 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c8415e81-8f99-4753-bcac-94d77fc1e908 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:50.312192 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c8415e81-8f99-4753-bcac-94d77fc1e908 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:50.320511 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c8415e81-8f99-4753-bcac-94d77fc1e908 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:50.322107 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c8415e81-8f99-4753-bcac-94d77fc1e908 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:50.323261 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c8415e81-8f99-4753-bcac-94d77fc1e908 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.154884 Mar 03 02:36:50.323854 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 575/1159] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:50 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:36:50.472001 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0a275745-35be-48c3-a7ec-f14d8745cd1d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:50.472913 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0a275745-35be-48c3-a7ec-f14d8745cd1d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:50.479093 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0a275745-35be-48c3-a7ec-f14d8745cd1d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:50.479544 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0a275745-35be-48c3-a7ec-f14d8745cd1d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:50.480353 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0a275745-35be-48c3-a7ec-f14d8745cd1d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:50.480800 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0a275745-35be-48c3-a7ec-f14d8745cd1d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:50.508913 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0a275745-35be-48c3-a7ec-f14d8745cd1d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041458 Mar 03 02:36:50.509459 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 585/1160] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:50 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:50.518812 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c047e5a9-81d3-49fd-9eee-a5c108adcedb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:50.519814 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c047e5a9-81d3-49fd-9eee-a5c108adcedb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:50.526066 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c047e5a9-81d3-49fd-9eee-a5c108adcedb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:50.526514 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c047e5a9-81d3-49fd-9eee-a5c108adcedb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:50.527289 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c047e5a9-81d3-49fd-9eee-a5c108adcedb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:50.527754 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c047e5a9-81d3-49fd-9eee-a5c108adcedb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:50.555805 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c047e5a9-81d3-49fd-9eee-a5c108adcedb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041495 Mar 03 02:36:50.556353 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 576/1161] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:50 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:50.644418 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-011a0be7-9032-4331-8c97-d1deeb9fb905 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:50.645333 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-011a0be7-9032-4331-8c97-d1deeb9fb905 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:50.651190 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-011a0be7-9032-4331-8c97-d1deeb9fb905 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:50.651662 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-011a0be7-9032-4331-8c97-d1deeb9fb905 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:50.652449 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-011a0be7-9032-4331-8c97-d1deeb9fb905 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:50.652882 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-011a0be7-9032-4331-8c97-d1deeb9fb905 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:50.680494 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-011a0be7-9032-4331-8c97-d1deeb9fb905 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040817 Mar 03 02:36:50.681046 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 586/1162] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:50 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:50.740185 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-704edaf8-91c1-4acd-8c48-8fa000728790 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:50.740781 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-704edaf8-91c1-4acd-8c48-8fa000728790 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:50.746821 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-704edaf8-91c1-4acd-8c48-8fa000728790 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:50.747267 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-704edaf8-91c1-4acd-8c48-8fa000728790 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:50.748058 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-704edaf8-91c1-4acd-8c48-8fa000728790 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:50.748489 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-704edaf8-91c1-4acd-8c48-8fa000728790 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:50.805678 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-704edaf8-91c1-4acd-8c48-8fa000728790 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:50.812902 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-704edaf8-91c1-4acd-8c48-8fa000728790 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.076937 Mar 03 02:36:50.813459 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 577/1163] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:36:50 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:36:51.341789 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e3f18beb-ef26-4a70-a3a8-d20ce3b7430f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:51.342408 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e3f18beb-ef26-4a70-a3a8-d20ce3b7430f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:51.349045 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e3f18beb-ef26-4a70-a3a8-d20ce3b7430f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:51.349502 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e3f18beb-ef26-4a70-a3a8-d20ce3b7430f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:51.350286 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e3f18beb-ef26-4a70-a3a8-d20ce3b7430f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:51.350727 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e3f18beb-ef26-4a70-a3a8-d20ce3b7430f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:51.481539 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e3f18beb-ef26-4a70-a3a8-d20ce3b7430f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:51.490569 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e3f18beb-ef26-4a70-a3a8-d20ce3b7430f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:51.492086 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e3f18beb-ef26-4a70-a3a8-d20ce3b7430f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:51.493241 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e3f18beb-ef26-4a70-a3a8-d20ce3b7430f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.155405 Mar 03 02:36:51.493805 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 587/1164] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:51 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:36:51.521616 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a2ecad5f-a68a-4beb-b0ce-00800accd2b4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:51.522549 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a2ecad5f-a68a-4beb-b0ce-00800accd2b4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:51.529101 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a2ecad5f-a68a-4beb-b0ce-00800accd2b4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:51.529544 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a2ecad5f-a68a-4beb-b0ce-00800accd2b4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:51.530321 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a2ecad5f-a68a-4beb-b0ce-00800accd2b4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:51.530751 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a2ecad5f-a68a-4beb-b0ce-00800accd2b4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:51.559166 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a2ecad5f-a68a-4beb-b0ce-00800accd2b4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042728 Mar 03 02:36:51.559734 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 578/1165] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:51 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:51.567518 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-911f0962-6d2a-48c8-af60-4516cd433239 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:51.568454 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-911f0962-6d2a-48c8-af60-4516cd433239 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:51.574434 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-911f0962-6d2a-48c8-af60-4516cd433239 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:51.575215 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-911f0962-6d2a-48c8-af60-4516cd433239 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:51.576050 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-911f0962-6d2a-48c8-af60-4516cd433239 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:51.576485 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-911f0962-6d2a-48c8-af60-4516cd433239 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:51.605662 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-911f0962-6d2a-48c8-af60-4516cd433239 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042634 Mar 03 02:36:51.606146 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 588/1166] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:51 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:51.692257 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e2173118-71bd-46bf-b179-4fbb35b7530e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:51.693153 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e2173118-71bd-46bf-b179-4fbb35b7530e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:51.698914 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e2173118-71bd-46bf-b179-4fbb35b7530e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:51.699352 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e2173118-71bd-46bf-b179-4fbb35b7530e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:51.700153 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e2173118-71bd-46bf-b179-4fbb35b7530e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:51.700586 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e2173118-71bd-46bf-b179-4fbb35b7530e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:51.728037 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e2173118-71bd-46bf-b179-4fbb35b7530e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040373 Mar 03 02:36:51.728596 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 579/1167] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:51 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:51.925193 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ac24e0e8-63c7-4ec0-9241-899341e1fb95 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:51.925877 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ac24e0e8-63c7-4ec0-9241-899341e1fb95 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:51.931631 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ac24e0e8-63c7-4ec0-9241-899341e1fb95 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:51.932072 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ac24e0e8-63c7-4ec0-9241-899341e1fb95 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:51.932841 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ac24e0e8-63c7-4ec0-9241-899341e1fb95 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:51.933271 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ac24e0e8-63c7-4ec0-9241-899341e1fb95 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:51.991560 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ac24e0e8-63c7-4ec0-9241-899341e1fb95 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:51.999254 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ac24e0e8-63c7-4ec0-9241-899341e1fb95 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.173610 Mar 03 02:36:51.999986 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 589/1168] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:36:51 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:36:52.511170 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-aca675ca-81ea-4ab6-8d8f-939d623360b5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:52.511798 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-aca675ca-81ea-4ab6-8d8f-939d623360b5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:52.517589 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aca675ca-81ea-4ab6-8d8f-939d623360b5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:52.518077 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aca675ca-81ea-4ab6-8d8f-939d623360b5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:52.518840 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aca675ca-81ea-4ab6-8d8f-939d623360b5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:52.519271 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aca675ca-81ea-4ab6-8d8f-939d623360b5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:52.569818 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d2045ac4-2e1c-4adf-aad9-60e459f5d734 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:52.570825 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d2045ac4-2e1c-4adf-aad9-60e459f5d734 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:52.577211 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d2045ac4-2e1c-4adf-aad9-60e459f5d734 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:52.577646 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d2045ac4-2e1c-4adf-aad9-60e459f5d734 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:52.578446 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d2045ac4-2e1c-4adf-aad9-60e459f5d734 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:52.578888 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d2045ac4-2e1c-4adf-aad9-60e459f5d734 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:52.608084 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d2045ac4-2e1c-4adf-aad9-60e459f5d734 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042165 Mar 03 02:36:52.608651 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 590/1169] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:52 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:36:52.617411 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9e997acc-b569-4b83-9820-115defa15ad5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:52.618352 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9e997acc-b569-4b83-9820-115defa15ad5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:52.624314 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9e997acc-b569-4b83-9820-115defa15ad5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:52.624768 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9e997acc-b569-4b83-9820-115defa15ad5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:52.625554 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9e997acc-b569-4b83-9820-115defa15ad5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:52.626013 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9e997acc-b569-4b83-9820-115defa15ad5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:52.652574 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-aca675ca-81ea-4ab6-8d8f-939d623360b5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:52.655236 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9e997acc-b569-4b83-9820-115defa15ad5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041526 Mar 03 02:36:52.655857 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 591/1170] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:52 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:36:52.661100 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-aca675ca-81ea-4ab6-8d8f-939d623360b5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:52.662606 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-aca675ca-81ea-4ab6-8d8f-939d623360b5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:52.663795 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-aca675ca-81ea-4ab6-8d8f-939d623360b5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.156530 Mar 03 02:36:52.664342 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 580/1171] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:52 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:36:52.739586 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9f789323-69b8-405c-bf94-6ee0fb5117c6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:52.740528 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9f789323-69b8-405c-bf94-6ee0fb5117c6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:52.746561 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9f789323-69b8-405c-bf94-6ee0fb5117c6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:52.747018 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9f789323-69b8-405c-bf94-6ee0fb5117c6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:52.747835 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9f789323-69b8-405c-bf94-6ee0fb5117c6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:52.748275 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9f789323-69b8-405c-bf94-6ee0fb5117c6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:52.776245 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9f789323-69b8-405c-bf94-6ee0fb5117c6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040458 Mar 03 02:36:52.776732 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 592/1172] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:52 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:53.016225 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-80f5f19d-02cc-42bf-b3cd-3b013c081973 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:53.016832 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-80f5f19d-02cc-42bf-b3cd-3b013c081973 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:53.022946 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-80f5f19d-02cc-42bf-b3cd-3b013c081973 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:53.023403 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-80f5f19d-02cc-42bf-b3cd-3b013c081973 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:53.024219 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-80f5f19d-02cc-42bf-b3cd-3b013c081973 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:53.024662 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-80f5f19d-02cc-42bf-b3cd-3b013c081973 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:53.231155 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-80f5f19d-02cc-42bf-b3cd-3b013c081973 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:53.238984 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-80f5f19d-02cc-42bf-b3cd-3b013c081973 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.226586 Mar 03 02:36:53.239544 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 581/1173] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:36:53 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:36:53.620464 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7036930e-9756-46c7-988d-338a8ec5071c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:53.621293 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7036930e-9756-46c7-988d-338a8ec5071c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:53.627888 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7036930e-9756-46c7-988d-338a8ec5071c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:53.628353 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7036930e-9756-46c7-988d-338a8ec5071c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:53.629134 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7036930e-9756-46c7-988d-338a8ec5071c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:53.629595 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7036930e-9756-46c7-988d-338a8ec5071c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:53.658187 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7036930e-9756-46c7-988d-338a8ec5071c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041563 Mar 03 02:36:53.659305 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 593/1174] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:53 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:53.666112 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-164402db-f068-441f-8d8a-2ea462fd7c1f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:53.667010 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-164402db-f068-441f-8d8a-2ea462fd7c1f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:53.673059 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-164402db-f068-441f-8d8a-2ea462fd7c1f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:53.673504 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-164402db-f068-441f-8d8a-2ea462fd7c1f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:53.674680 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-164402db-f068-441f-8d8a-2ea462fd7c1f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:53.675113 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-164402db-f068-441f-8d8a-2ea462fd7c1f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:53.681496 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e2e731b7-ece7-4505-9a49-1849a7f106c2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:53.682104 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e2e731b7-ece7-4505-9a49-1849a7f106c2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:53.687897 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e2e731b7-ece7-4505-9a49-1849a7f106c2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:53.688354 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e2e731b7-ece7-4505-9a49-1849a7f106c2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:53.689136 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e2e731b7-ece7-4505-9a49-1849a7f106c2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:53.689576 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e2e731b7-ece7-4505-9a49-1849a7f106c2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:53.703315 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-164402db-f068-441f-8d8a-2ea462fd7c1f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040983 Mar 03 02:36:53.703907 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 582/1175] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:53 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:53.788452 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7ba2417a-38eb-491d-934e-d6b688c047f8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:53.789360 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7ba2417a-38eb-491d-934e-d6b688c047f8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:53.795137 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7ba2417a-38eb-491d-934e-d6b688c047f8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:53.795581 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7ba2417a-38eb-491d-934e-d6b688c047f8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:53.796395 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7ba2417a-38eb-491d-934e-d6b688c047f8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:53.796832 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7ba2417a-38eb-491d-934e-d6b688c047f8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:53.833272 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e2e731b7-ece7-4505-9a49-1849a7f106c2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:53.839362 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7ba2417a-38eb-491d-934e-d6b688c047f8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055687 Mar 03 02:36:53.839950 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 583/1176] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:53 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:36:53.841669 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e2e731b7-ece7-4505-9a49-1849a7f106c2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:53.843331 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e2e731b7-ece7-4505-9a49-1849a7f106c2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:53.844516 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e2e731b7-ece7-4505-9a49-1849a7f106c2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.166872 Mar 03 02:36:53.845053 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 594/1177] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:53 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:36:54.256210 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2230ef19-3a26-4206-bc27-50b8fa155184 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:54.256810 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2230ef19-3a26-4206-bc27-50b8fa155184 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:54.262528 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2230ef19-3a26-4206-bc27-50b8fa155184 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:54.262969 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2230ef19-3a26-4206-bc27-50b8fa155184 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:54.263767 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2230ef19-3a26-4206-bc27-50b8fa155184 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:54.264201 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2230ef19-3a26-4206-bc27-50b8fa155184 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:54.322161 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2230ef19-3a26-4206-bc27-50b8fa155184 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:54.329323 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2230ef19-3a26-4206-bc27-50b8fa155184 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.077552 Mar 03 02:36:54.329873 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 584/1178] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:36:54 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:36:54.670583 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-791f7d73-96c6-4b47-9463-750d8e8cd5fc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:54.671560 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-791f7d73-96c6-4b47-9463-750d8e8cd5fc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:54.678866 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-791f7d73-96c6-4b47-9463-750d8e8cd5fc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:54.679310 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-791f7d73-96c6-4b47-9463-750d8e8cd5fc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:54.680131 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-791f7d73-96c6-4b47-9463-750d8e8cd5fc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:54.680569 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-791f7d73-96c6-4b47-9463-750d8e8cd5fc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:54.707842 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-791f7d73-96c6-4b47-9463-750d8e8cd5fc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041192 Mar 03 02:36:54.708384 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 595/1179] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:54 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:54.715307 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-fb590b60-128b-4051-820c-d4407025733d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:54.716250 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-fb590b60-128b-4051-820c-d4407025733d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:54.722796 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fb590b60-128b-4051-820c-d4407025733d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:54.723247 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fb590b60-128b-4051-820c-d4407025733d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:54.724069 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fb590b60-128b-4051-820c-d4407025733d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:54.724513 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fb590b60-128b-4051-820c-d4407025733d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:54.752531 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-fb590b60-128b-4051-820c-d4407025733d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040954 Mar 03 02:36:54.753022 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 585/1180] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:54 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:54.850519 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7199efd7-3f19-4f04-b60a-da15abd12369 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:54.851421 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7199efd7-3f19-4f04-b60a-da15abd12369 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:54.857272 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7199efd7-3f19-4f04-b60a-da15abd12369 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:54.857720 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7199efd7-3f19-4f04-b60a-da15abd12369 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:54.858486 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7199efd7-3f19-4f04-b60a-da15abd12369 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:54.858987 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7199efd7-3f19-4f04-b60a-da15abd12369 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:54.863085 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ab584916-47c9-42d9-9aa2-9d21695542fa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:54.863762 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ab584916-47c9-42d9-9aa2-9d21695542fa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:54.869629 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ab584916-47c9-42d9-9aa2-9d21695542fa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:54.870073 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ab584916-47c9-42d9-9aa2-9d21695542fa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:54.870843 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ab584916-47c9-42d9-9aa2-9d21695542fa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:54.871275 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ab584916-47c9-42d9-9aa2-9d21695542fa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:54.887267 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7199efd7-3f19-4f04-b60a-da15abd12369 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041249 Mar 03 02:36:54.887852 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 596/1181] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:54 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:55.001183 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ab584916-47c9-42d9-9aa2-9d21695542fa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:55.009307 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ab584916-47c9-42d9-9aa2-9d21695542fa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:55.010786 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ab584916-47c9-42d9-9aa2-9d21695542fa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:55.011970 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ab584916-47c9-42d9-9aa2-9d21695542fa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.153229 Mar 03 02:36:55.012511 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 586/1182] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:54 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:36:55.351593 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-79a6044e-43df-4ed0-aed8-38912b77093b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:55.352217 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-79a6044e-43df-4ed0-aed8-38912b77093b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:55.358010 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-79a6044e-43df-4ed0-aed8-38912b77093b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:55.358456 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-79a6044e-43df-4ed0-aed8-38912b77093b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:55.359223 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-79a6044e-43df-4ed0-aed8-38912b77093b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:55.359686 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-79a6044e-43df-4ed0-aed8-38912b77093b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:55.420886 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-79a6044e-43df-4ed0-aed8-38912b77093b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:55.428331 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-79a6044e-43df-4ed0-aed8-38912b77093b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.080640 Mar 03 02:36:55.428884 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 597/1183] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:36:55 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:36:55.718778 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-651f42e6-e526-4c07-b7b3-f450d81e000d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:55.719617 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-651f42e6-e526-4c07-b7b3-f450d81e000d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:55.725778 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-651f42e6-e526-4c07-b7b3-f450d81e000d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:55.726223 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-651f42e6-e526-4c07-b7b3-f450d81e000d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:55.726993 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-651f42e6-e526-4c07-b7b3-f450d81e000d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:55.727425 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-651f42e6-e526-4c07-b7b3-f450d81e000d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:55.755745 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-651f42e6-e526-4c07-b7b3-f450d81e000d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040969 Mar 03 02:36:55.756281 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 587/1184] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:55 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:55.763863 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-830a1b08-2026-494d-9e24-177aca06446c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:55.764783 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-830a1b08-2026-494d-9e24-177aca06446c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:55.771656 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-830a1b08-2026-494d-9e24-177aca06446c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:55.772116 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-830a1b08-2026-494d-9e24-177aca06446c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:55.772901 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-830a1b08-2026-494d-9e24-177aca06446c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:55.773342 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-830a1b08-2026-494d-9e24-177aca06446c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:55.801516 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-830a1b08-2026-494d-9e24-177aca06446c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041664 Mar 03 02:36:55.802066 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 598/1185] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:55 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:55.898356 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-17855630-df47-44f6-863d-a4cb78b59705 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:55.899257 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-17855630-df47-44f6-863d-a4cb78b59705 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:55.905184 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-17855630-df47-44f6-863d-a4cb78b59705 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:55.905634 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-17855630-df47-44f6-863d-a4cb78b59705 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:55.906409 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-17855630-df47-44f6-863d-a4cb78b59705 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:55.906846 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-17855630-df47-44f6-863d-a4cb78b59705 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:55.934710 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-17855630-df47-44f6-863d-a4cb78b59705 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040322 Mar 03 02:36:55.935248 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 588/1186] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:55 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:56.030055 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-590ebedb-d6d7-4e23-a622-e78ab1a087ab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:56.030582 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-590ebedb-d6d7-4e23-a622-e78ab1a087ab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:56.036582 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-590ebedb-d6d7-4e23-a622-e78ab1a087ab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:56.037031 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-590ebedb-d6d7-4e23-a622-e78ab1a087ab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:56.037798 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-590ebedb-d6d7-4e23-a622-e78ab1a087ab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:56.038229 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-590ebedb-d6d7-4e23-a622-e78ab1a087ab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:56.166946 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-590ebedb-d6d7-4e23-a622-e78ab1a087ab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:56.175874 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-590ebedb-d6d7-4e23-a622-e78ab1a087ab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:56.177361 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-590ebedb-d6d7-4e23-a622-e78ab1a087ab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:56.178511 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-590ebedb-d6d7-4e23-a622-e78ab1a087ab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.152465 Mar 03 02:36:56.179056 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 599/1187] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:56 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:36:56.445015 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-61843c73-64cc-4ba7-b2ff-c8d53d789fcb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:56.445618 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-61843c73-64cc-4ba7-b2ff-c8d53d789fcb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:56.451439 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-61843c73-64cc-4ba7-b2ff-c8d53d789fcb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:56.451927 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-61843c73-64cc-4ba7-b2ff-c8d53d789fcb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:56.452702 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-61843c73-64cc-4ba7-b2ff-c8d53d789fcb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:56.453144 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-61843c73-64cc-4ba7-b2ff-c8d53d789fcb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:56.510739 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-61843c73-64cc-4ba7-b2ff-c8d53d789fcb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:56.518654 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-61843c73-64cc-4ba7-b2ff-c8d53d789fcb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.077404 Mar 03 02:36:56.519205 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 589/1188] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:36:56 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:36:56.766707 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-27fb7e2b-6086-49a6-b0f6-3bd3f6b4aa4b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:56.768082 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-27fb7e2b-6086-49a6-b0f6-3bd3f6b4aa4b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:56.774298 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-27fb7e2b-6086-49a6-b0f6-3bd3f6b4aa4b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:56.774740 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-27fb7e2b-6086-49a6-b0f6-3bd3f6b4aa4b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:56.775509 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-27fb7e2b-6086-49a6-b0f6-3bd3f6b4aa4b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:56.775967 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-27fb7e2b-6086-49a6-b0f6-3bd3f6b4aa4b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:56.804454 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-27fb7e2b-6086-49a6-b0f6-3bd3f6b4aa4b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041737 Mar 03 02:36:56.805010 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 600/1189] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:56 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:56.813052 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-62a313bc-e19f-4104-8931-b1371a2ab083 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:56.813991 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-62a313bc-e19f-4104-8931-b1371a2ab083 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:56.820731 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-62a313bc-e19f-4104-8931-b1371a2ab083 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:56.821181 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-62a313bc-e19f-4104-8931-b1371a2ab083 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:56.821959 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-62a313bc-e19f-4104-8931-b1371a2ab083 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:56.822392 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-62a313bc-e19f-4104-8931-b1371a2ab083 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:56.851640 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-62a313bc-e19f-4104-8931-b1371a2ab083 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042648 Mar 03 02:36:56.852175 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 590/1190] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:56 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:56.946542 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-be259e44-9830-4ee9-b60c-5f91c562806e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:56.947442 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-be259e44-9830-4ee9-b60c-5f91c562806e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:56.953199 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-be259e44-9830-4ee9-b60c-5f91c562806e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:56.953642 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-be259e44-9830-4ee9-b60c-5f91c562806e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:56.954407 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-be259e44-9830-4ee9-b60c-5f91c562806e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:56.954839 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-be259e44-9830-4ee9-b60c-5f91c562806e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:56.982316 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-be259e44-9830-4ee9-b60c-5f91c562806e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039724 Mar 03 02:36:56.982840 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 601/1191] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:56 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:57.196489 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d65d2ff5-ad0e-413b-a534-40ee7831c8be tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:57.197092 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d65d2ff5-ad0e-413b-a534-40ee7831c8be tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:57.202895 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d65d2ff5-ad0e-413b-a534-40ee7831c8be tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:57.203344 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d65d2ff5-ad0e-413b-a534-40ee7831c8be tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:57.204148 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d65d2ff5-ad0e-413b-a534-40ee7831c8be tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:57.204583 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d65d2ff5-ad0e-413b-a534-40ee7831c8be tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:57.333906 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d65d2ff5-ad0e-413b-a534-40ee7831c8be tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:57.342043 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d65d2ff5-ad0e-413b-a534-40ee7831c8be tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:57.343542 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d65d2ff5-ad0e-413b-a534-40ee7831c8be tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:57.344715 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d65d2ff5-ad0e-413b-a534-40ee7831c8be tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.152118 Mar 03 02:36:57.345262 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 591/1192] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:57 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:36:57.535287 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-fcc60d72-ec08-462e-967c-12f0c21e9407 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:57.535922 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-fcc60d72-ec08-462e-967c-12f0c21e9407 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:57.541729 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fcc60d72-ec08-462e-967c-12f0c21e9407 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:57.542174 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fcc60d72-ec08-462e-967c-12f0c21e9407 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:57.542943 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fcc60d72-ec08-462e-967c-12f0c21e9407 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:57.543376 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fcc60d72-ec08-462e-967c-12f0c21e9407 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:57.602250 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-fcc60d72-ec08-462e-967c-12f0c21e9407 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:57.609441 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-fcc60d72-ec08-462e-967c-12f0c21e9407 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078555 Mar 03 02:36:57.609994 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 602/1193] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:36:57 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:36:57.816325 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-eaf02ee4-7df5-41d5-bc93-b8c518a24901 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:57.817234 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-eaf02ee4-7df5-41d5-bc93-b8c518a24901 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:57.823446 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-eaf02ee4-7df5-41d5-bc93-b8c518a24901 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:57.823933 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-eaf02ee4-7df5-41d5-bc93-b8c518a24901 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:57.824709 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-eaf02ee4-7df5-41d5-bc93-b8c518a24901 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:57.825144 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-eaf02ee4-7df5-41d5-bc93-b8c518a24901 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:57.853824 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-eaf02ee4-7df5-41d5-bc93-b8c518a24901 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042336 Mar 03 02:36:57.854294 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 592/1194] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:57 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:57.862654 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8a75a20e-72a9-4fed-a1da-d94f8912e1ea tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:57.863597 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8a75a20e-72a9-4fed-a1da-d94f8912e1ea tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:57.870095 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8a75a20e-72a9-4fed-a1da-d94f8912e1ea tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:57.870545 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8a75a20e-72a9-4fed-a1da-d94f8912e1ea tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:57.871357 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8a75a20e-72a9-4fed-a1da-d94f8912e1ea tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:57.871827 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8a75a20e-72a9-4fed-a1da-d94f8912e1ea tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:57.900053 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8a75a20e-72a9-4fed-a1da-d94f8912e1ea tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041628 Mar 03 02:36:57.900599 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 603/1195] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:57 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:57.993888 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3c2d56cc-6054-499b-a98c-c3096cd28bb2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:57.995069 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3c2d56cc-6054-499b-a98c-c3096cd28bb2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:58.000936 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3c2d56cc-6054-499b-a98c-c3096cd28bb2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:58.001404 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3c2d56cc-6054-499b-a98c-c3096cd28bb2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:58.003001 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3c2d56cc-6054-499b-a98c-c3096cd28bb2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:58.003434 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3c2d56cc-6054-499b-a98c-c3096cd28bb2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:58.030428 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3c2d56cc-6054-499b-a98c-c3096cd28bb2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040519 Mar 03 02:36:58.030966 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 593/1196] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:57 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:58.364041 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e8f2a645-e759-4fff-8010-82d440b434e9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:58.364647 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e8f2a645-e759-4fff-8010-82d440b434e9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:58.370738 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e8f2a645-e759-4fff-8010-82d440b434e9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:58.371191 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e8f2a645-e759-4fff-8010-82d440b434e9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:58.371992 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e8f2a645-e759-4fff-8010-82d440b434e9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:58.372434 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e8f2a645-e759-4fff-8010-82d440b434e9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:58.504458 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e8f2a645-e759-4fff-8010-82d440b434e9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:58.512475 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e8f2a645-e759-4fff-8010-82d440b434e9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:58.513971 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e8f2a645-e759-4fff-8010-82d440b434e9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:58.515184 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e8f2a645-e759-4fff-8010-82d440b434e9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.155608 Mar 03 02:36:58.515769 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 604/1197] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:58 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:36:58.626262 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2b51e087-73a7-4e38-9e66-4eec465fde77 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:58.626793 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2b51e087-73a7-4e38-9e66-4eec465fde77 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:58.632586 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2b51e087-73a7-4e38-9e66-4eec465fde77 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:58.633031 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2b51e087-73a7-4e38-9e66-4eec465fde77 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:58.633798 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2b51e087-73a7-4e38-9e66-4eec465fde77 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:58.634228 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2b51e087-73a7-4e38-9e66-4eec465fde77 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:58.694882 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2b51e087-73a7-4e38-9e66-4eec465fde77 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:58.702083 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2b51e087-73a7-4e38-9e66-4eec465fde77 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.079856 Mar 03 02:36:58.702626 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 594/1198] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:36:58 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:36:58.865017 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-94b43c9c-692c-4f40-a806-08abc812b496 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:58.865984 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-94b43c9c-692c-4f40-a806-08abc812b496 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:58.872719 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-94b43c9c-692c-4f40-a806-08abc812b496 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:58.873161 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-94b43c9c-692c-4f40-a806-08abc812b496 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:58.873930 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-94b43c9c-692c-4f40-a806-08abc812b496 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:58.874352 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-94b43c9c-692c-4f40-a806-08abc812b496 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:58.904226 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-94b43c9c-692c-4f40-a806-08abc812b496 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043276 Mar 03 02:36:58.905336 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 605/1199] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:58 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:58.911406 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-33651bb0-d3ab-40a0-b72b-227cbde9d7ef tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:58.912338 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-33651bb0-d3ab-40a0-b72b-227cbde9d7ef tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:58.918748 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-33651bb0-d3ab-40a0-b72b-227cbde9d7ef tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:58.919269 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-33651bb0-d3ab-40a0-b72b-227cbde9d7ef tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:58.920075 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-33651bb0-d3ab-40a0-b72b-227cbde9d7ef tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:58.920510 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-33651bb0-d3ab-40a0-b72b-227cbde9d7ef tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:58.949461 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-33651bb0-d3ab-40a0-b72b-227cbde9d7ef tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042459 Mar 03 02:36:58.950251 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 595/1200] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:58 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:59.041904 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-acb64eb9-2cbb-4407-a304-13d88a12af53 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:59.042803 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-acb64eb9-2cbb-4407-a304-13d88a12af53 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:59.048796 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-acb64eb9-2cbb-4407-a304-13d88a12af53 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:59.049392 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-acb64eb9-2cbb-4407-a304-13d88a12af53 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:59.050181 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-acb64eb9-2cbb-4407-a304-13d88a12af53 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:59.050610 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-acb64eb9-2cbb-4407-a304-13d88a12af53 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:59.078004 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-acb64eb9-2cbb-4407-a304-13d88a12af53 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040026 Mar 03 02:36:59.078560 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 606/1201] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:59 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:59.533200 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8f33eb79-f095-4f8e-9a44-5473ee26527a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:59.533979 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8f33eb79-f095-4f8e-9a44-5473ee26527a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:59.539764 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8f33eb79-f095-4f8e-9a44-5473ee26527a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:59.540219 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8f33eb79-f095-4f8e-9a44-5473ee26527a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:59.541000 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8f33eb79-f095-4f8e-9a44-5473ee26527a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:59.541446 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8f33eb79-f095-4f8e-9a44-5473ee26527a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:59.669502 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8f33eb79-f095-4f8e-9a44-5473ee26527a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:59.678348 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8f33eb79-f095-4f8e-9a44-5473ee26527a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:59.679876 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8f33eb79-f095-4f8e-9a44-5473ee26527a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:59.681027 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8f33eb79-f095-4f8e-9a44-5473ee26527a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.151839 Mar 03 02:36:59.681577 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 596/1202] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:36:59 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:36:59.718618 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-22a82f00-7aa3-4a50-a1ca-5dd2e3ecadf9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:59.719227 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-22a82f00-7aa3-4a50-a1ca-5dd2e3ecadf9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:59.725314 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-22a82f00-7aa3-4a50-a1ca-5dd2e3ecadf9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:59.725761 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-22a82f00-7aa3-4a50-a1ca-5dd2e3ecadf9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:59.726575 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-22a82f00-7aa3-4a50-a1ca-5dd2e3ecadf9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:59.727009 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-22a82f00-7aa3-4a50-a1ca-5dd2e3ecadf9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:59.786188 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-22a82f00-7aa3-4a50-a1ca-5dd2e3ecadf9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:36:59.793475 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-22a82f00-7aa3-4a50-a1ca-5dd2e3ecadf9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078828 Mar 03 02:36:59.794044 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 607/1203] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:36:59 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:36:59.915661 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-93997e89-66b7-414c-8d17-5c570b66d6e5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:59.916580 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-93997e89-66b7-414c-8d17-5c570b66d6e5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:59.922706 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-93997e89-66b7-414c-8d17-5c570b66d6e5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:59.923168 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-93997e89-66b7-414c-8d17-5c570b66d6e5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:59.924619 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-93997e89-66b7-414c-8d17-5c570b66d6e5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:59.925057 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-93997e89-66b7-414c-8d17-5c570b66d6e5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:59.952117 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-93997e89-66b7-414c-8d17-5c570b66d6e5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040560 Mar 03 02:36:59.952651 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 597/1204] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:59 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:36:59.960137 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4de15ac4-7aef-40fa-b0c9-96fbd73e3a23 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:36:59.961041 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4de15ac4-7aef-40fa-b0c9-96fbd73e3a23 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:36:59.967233 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4de15ac4-7aef-40fa-b0c9-96fbd73e3a23 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:59.967714 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4de15ac4-7aef-40fa-b0c9-96fbd73e3a23 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:59.968485 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4de15ac4-7aef-40fa-b0c9-96fbd73e3a23 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:36:59.968944 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4de15ac4-7aef-40fa-b0c9-96fbd73e3a23 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:36:59.998492 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4de15ac4-7aef-40fa-b0c9-96fbd73e3a23 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042201 Mar 03 02:36:59.999047 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 608/1205] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:36:59 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:00.090117 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-04fcb6d8-7fb3-4708-9ccd-b358d8b2f1b4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:00.091012 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-04fcb6d8-7fb3-4708-9ccd-b358d8b2f1b4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:00.097490 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-04fcb6d8-7fb3-4708-9ccd-b358d8b2f1b4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:00.097926 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-04fcb6d8-7fb3-4708-9ccd-b358d8b2f1b4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:00.098694 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-04fcb6d8-7fb3-4708-9ccd-b358d8b2f1b4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:00.099125 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-04fcb6d8-7fb3-4708-9ccd-b358d8b2f1b4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:00.126393 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-04fcb6d8-7fb3-4708-9ccd-b358d8b2f1b4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040297 Mar 03 02:37:00.126979 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 598/1206] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:00 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:00.699797 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9c23643a-083d-411b-a180-9909015bfbf9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:00.700408 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9c23643a-083d-411b-a180-9909015bfbf9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:00.707028 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9c23643a-083d-411b-a180-9909015bfbf9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:00.707481 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9c23643a-083d-411b-a180-9909015bfbf9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:00.708289 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9c23643a-083d-411b-a180-9909015bfbf9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:00.708730 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9c23643a-083d-411b-a180-9909015bfbf9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:00.810130 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b4c83d2a-f472-4cff-99b0-38ee183622b2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:00.810834 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b4c83d2a-f472-4cff-99b0-38ee183622b2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:00.817163 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b4c83d2a-f472-4cff-99b0-38ee183622b2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:00.817683 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b4c83d2a-f472-4cff-99b0-38ee183622b2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:00.818538 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b4c83d2a-f472-4cff-99b0-38ee183622b2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:00.819034 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b4c83d2a-f472-4cff-99b0-38ee183622b2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:00.839437 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9c23643a-083d-411b-a180-9909015bfbf9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:00.847836 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9c23643a-083d-411b-a180-9909015bfbf9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:00.849335 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9c23643a-083d-411b-a180-9909015bfbf9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:00.850485 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9c23643a-083d-411b-a180-9909015bfbf9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.154773 Mar 03 02:37:00.851034 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 609/1207] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:00 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:37:00.878591 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b4c83d2a-f472-4cff-99b0-38ee183622b2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:00.887208 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b4c83d2a-f472-4cff-99b0-38ee183622b2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.080728 Mar 03 02:37:00.887881 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 599/1208] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:00 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:37:00.963792 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a978b578-6541-4c7e-bf73-c0c5537cf2fa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:00.964652 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a978b578-6541-4c7e-bf73-c0c5537cf2fa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:00.970925 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a978b578-6541-4c7e-bf73-c0c5537cf2fa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:00.971368 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a978b578-6541-4c7e-bf73-c0c5537cf2fa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:00.972171 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a978b578-6541-4c7e-bf73-c0c5537cf2fa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:00.972613 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a978b578-6541-4c7e-bf73-c0c5537cf2fa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:01.001465 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a978b578-6541-4c7e-bf73-c0c5537cf2fa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041634 Mar 03 02:37:01.002579 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 610/1209] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:00 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:01.009862 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5d5c4011-348b-4759-933f-345fdb3d43cf tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:01.010897 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5d5c4011-348b-4759-933f-345fdb3d43cf tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:01.018311 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5d5c4011-348b-4759-933f-345fdb3d43cf tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:01.019083 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5d5c4011-348b-4759-933f-345fdb3d43cf tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:01.019951 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5d5c4011-348b-4759-933f-345fdb3d43cf tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:01.020499 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5d5c4011-348b-4759-933f-345fdb3d43cf tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:01.052608 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5d5c4011-348b-4759-933f-345fdb3d43cf tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046541 Mar 03 02:37:01.053175 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 600/1210] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:01 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:01.138691 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d58f8e82-b73d-4f49-9c66-deda77f5f3a6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:01.139653 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d58f8e82-b73d-4f49-9c66-deda77f5f3a6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:01.146719 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d58f8e82-b73d-4f49-9c66-deda77f5f3a6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:01.147174 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d58f8e82-b73d-4f49-9c66-deda77f5f3a6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:01.148012 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d58f8e82-b73d-4f49-9c66-deda77f5f3a6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:01.148453 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d58f8e82-b73d-4f49-9c66-deda77f5f3a6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:01.177712 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d58f8e82-b73d-4f49-9c66-deda77f5f3a6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043523 Mar 03 02:37:01.178282 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 611/1211] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:01 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:01.868440 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4a802031-7a5e-4f8c-88df-0d9f7734c79e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:01.869033 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4a802031-7a5e-4f8c-88df-0d9f7734c79e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:01.875133 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4a802031-7a5e-4f8c-88df-0d9f7734c79e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:01.875581 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4a802031-7a5e-4f8c-88df-0d9f7734c79e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:01.876383 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4a802031-7a5e-4f8c-88df-0d9f7734c79e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:01.877441 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4a802031-7a5e-4f8c-88df-0d9f7734c79e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:01.904644 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-757ff28b-d493-4d07-b129-aced9164d6d3 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:01.905262 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-757ff28b-d493-4d07-b129-aced9164d6d3 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:01.911204 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-757ff28b-d493-4d07-b129-aced9164d6d3 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:01.911693 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-757ff28b-d493-4d07-b129-aced9164d6d3 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:01.912485 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-757ff28b-d493-4d07-b129-aced9164d6d3 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:01.912924 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-757ff28b-d493-4d07-b129-aced9164d6d3 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:01.971652 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-757ff28b-d493-4d07-b129-aced9164d6d3 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:01.979049 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-757ff28b-d493-4d07-b129-aced9164d6d3 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078224 Mar 03 02:37:01.979685 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 612/1212] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:01 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:37:02.009261 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4a802031-7a5e-4f8c-88df-0d9f7734c79e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:02.013846 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-04beff38-2b94-41a0-811e-6c335c0cce03 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:02.014769 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-04beff38-2b94-41a0-811e-6c335c0cce03 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:02.018537 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4a802031-7a5e-4f8c-88df-0d9f7734c79e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:02.020202 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4a802031-7a5e-4f8c-88df-0d9f7734c79e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:02.021232 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-04beff38-2b94-41a0-811e-6c335c0cce03 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:02.021345 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4a802031-7a5e-4f8c-88df-0d9f7734c79e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.156890 Mar 03 02:37:02.021681 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-04beff38-2b94-41a0-811e-6c335c0cce03 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:02.025053 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 601/1213] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:01 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:37:02.025240 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-04beff38-2b94-41a0-811e-6c335c0cce03 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:02.025240 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-04beff38-2b94-41a0-811e-6c335c0cce03 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:02.052766 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-04beff38-2b94-41a0-811e-6c335c0cce03 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042814 Mar 03 02:37:02.053372 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 613/1214] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:02 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:37:02.063910 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-50c64104-b76d-413e-bd81-4859295c3d33 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:02.065503 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-50c64104-b76d-413e-bd81-4859295c3d33 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:02.071379 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-50c64104-b76d-413e-bd81-4859295c3d33 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:02.071857 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-50c64104-b76d-413e-bd81-4859295c3d33 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:02.072629 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-50c64104-b76d-413e-bd81-4859295c3d33 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:02.073059 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-50c64104-b76d-413e-bd81-4859295c3d33 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:02.100372 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-50c64104-b76d-413e-bd81-4859295c3d33 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040416 Mar 03 02:37:02.100910 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 602/1215] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:02 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:02.189270 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-407e5621-65c0-4b68-823a-b89217c7fb05 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:02.190635 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-407e5621-65c0-4b68-823a-b89217c7fb05 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:02.196909 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-407e5621-65c0-4b68-823a-b89217c7fb05 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:02.197364 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-407e5621-65c0-4b68-823a-b89217c7fb05 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:02.198144 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-407e5621-65c0-4b68-823a-b89217c7fb05 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:02.198583 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-407e5621-65c0-4b68-823a-b89217c7fb05 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:02.226920 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-407e5621-65c0-4b68-823a-b89217c7fb05 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041657 Mar 03 02:37:02.227465 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 614/1216] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:02 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:02.997018 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e4b107d8-6ec1-4ff5-826b-5067595a882c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:02.997628 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e4b107d8-6ec1-4ff5-826b-5067595a882c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:03.004618 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e4b107d8-6ec1-4ff5-826b-5067595a882c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:03.005081 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e4b107d8-6ec1-4ff5-826b-5067595a882c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:03.005869 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e4b107d8-6ec1-4ff5-826b-5067595a882c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:03.006304 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e4b107d8-6ec1-4ff5-826b-5067595a882c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:03.042399 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-44c9b933-5383-45f8-9d63-61e1c8aa4481 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:03.043017 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-44c9b933-5383-45f8-9d63-61e1c8aa4481 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:03.049315 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-44c9b933-5383-45f8-9d63-61e1c8aa4481 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:03.049769 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-44c9b933-5383-45f8-9d63-61e1c8aa4481 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:03.050574 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-44c9b933-5383-45f8-9d63-61e1c8aa4481 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:03.051005 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-44c9b933-5383-45f8-9d63-61e1c8aa4481 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:03.069532 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e4b107d8-6ec1-4ff5-826b-5067595a882c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:03.076610 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e4b107d8-6ec1-4ff5-826b-5067595a882c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.083728 Mar 03 02:37:03.077162 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 603/1217] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:02 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:37:03.082346 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-72c7e3ea-952c-49a5-9b49-86f7b1e4f828 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:03.083233 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-72c7e3ea-952c-49a5-9b49-86f7b1e4f828 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:03.089388 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-72c7e3ea-952c-49a5-9b49-86f7b1e4f828 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:03.089831 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-72c7e3ea-952c-49a5-9b49-86f7b1e4f828 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:03.090611 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-72c7e3ea-952c-49a5-9b49-86f7b1e4f828 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:03.091050 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-72c7e3ea-952c-49a5-9b49-86f7b1e4f828 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:03.119818 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-72c7e3ea-952c-49a5-9b49-86f7b1e4f828 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041353 Mar 03 02:37:03.120375 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 604/1218] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:03 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:03.125196 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-59b73d8f-6172-489c-96dd-994a0b9cc02f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:03.126076 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-59b73d8f-6172-489c-96dd-994a0b9cc02f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:03.132673 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-59b73d8f-6172-489c-96dd-994a0b9cc02f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:03.133115 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-59b73d8f-6172-489c-96dd-994a0b9cc02f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:03.133890 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-59b73d8f-6172-489c-96dd-994a0b9cc02f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:03.134320 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-59b73d8f-6172-489c-96dd-994a0b9cc02f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:03.164268 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-59b73d8f-6172-489c-96dd-994a0b9cc02f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042879 Mar 03 02:37:03.164828 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 605/1219] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:03 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:03.194382 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-44c9b933-5383-45f8-9d63-61e1c8aa4481 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:03.202924 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-44c9b933-5383-45f8-9d63-61e1c8aa4481 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:03.204448 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-44c9b933-5383-45f8-9d63-61e1c8aa4481 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:03.206288 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-44c9b933-5383-45f8-9d63-61e1c8aa4481 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.168959 Mar 03 02:37:03.206843 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 615/1220] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:03 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:37:03.238653 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1102d90a-3679-4d0a-a1de-74494c5219f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:03.239548 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1102d90a-3679-4d0a-a1de-74494c5219f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:03.245567 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1102d90a-3679-4d0a-a1de-74494c5219f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:03.246008 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1102d90a-3679-4d0a-a1de-74494c5219f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:03.246770 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1102d90a-3679-4d0a-a1de-74494c5219f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:03.247201 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1102d90a-3679-4d0a-a1de-74494c5219f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:03.275046 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1102d90a-3679-4d0a-a1de-74494c5219f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040726 Mar 03 02:37:03.275576 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 606/1221] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:03 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:04.094456 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d5601925-0f28-47f7-ab22-6b3c4560a169 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:04.095072 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d5601925-0f28-47f7-ab22-6b3c4560a169 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:04.101655 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d5601925-0f28-47f7-ab22-6b3c4560a169 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:04.102112 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d5601925-0f28-47f7-ab22-6b3c4560a169 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:04.102899 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d5601925-0f28-47f7-ab22-6b3c4560a169 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:04.103342 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d5601925-0f28-47f7-ab22-6b3c4560a169 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:04.131699 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-795966ea-9935-4fd0-bc6c-e72377f9de96 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:04.132666 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-795966ea-9935-4fd0-bc6c-e72377f9de96 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:04.138892 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-795966ea-9935-4fd0-bc6c-e72377f9de96 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:04.139337 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-795966ea-9935-4fd0-bc6c-e72377f9de96 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:04.140145 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-795966ea-9935-4fd0-bc6c-e72377f9de96 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:04.140577 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-795966ea-9935-4fd0-bc6c-e72377f9de96 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:04.162375 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d5601925-0f28-47f7-ab22-6b3c4560a169 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:04.169518 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-795966ea-9935-4fd0-bc6c-e72377f9de96 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041911 Mar 03 02:37:04.169682 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d5601925-0f28-47f7-ab22-6b3c4560a169 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.079019 Mar 03 02:37:04.170376 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 607/1222] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:04 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:37:04.170759 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 616/1223] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:04 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:37:04.175023 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2891fd52-9a47-4239-b894-212b8d649070 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:04.175930 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2891fd52-9a47-4239-b894-212b8d649070 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:04.182847 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2891fd52-9a47-4239-b894-212b8d649070 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:04.183305 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2891fd52-9a47-4239-b894-212b8d649070 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:04.184139 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2891fd52-9a47-4239-b894-212b8d649070 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:04.184579 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2891fd52-9a47-4239-b894-212b8d649070 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:04.212112 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2891fd52-9a47-4239-b894-212b8d649070 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040622 Mar 03 02:37:04.212660 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 608/1224] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:04 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:04.223168 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-096db32b-bd6a-4ad1-93f5-c38cf2e76f3f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:04.224446 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-096db32b-bd6a-4ad1-93f5-c38cf2e76f3f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:04.230606 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-096db32b-bd6a-4ad1-93f5-c38cf2e76f3f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:04.231055 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-096db32b-bd6a-4ad1-93f5-c38cf2e76f3f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:04.231851 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-096db32b-bd6a-4ad1-93f5-c38cf2e76f3f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:04.232286 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-096db32b-bd6a-4ad1-93f5-c38cf2e76f3f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:04.287283 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-dd1f48fa-f2c4-4071-863c-9d31022325e4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:04.288232 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-dd1f48fa-f2c4-4071-863c-9d31022325e4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:04.294129 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dd1f48fa-f2c4-4071-863c-9d31022325e4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:04.294606 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dd1f48fa-f2c4-4071-863c-9d31022325e4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:04.295387 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dd1f48fa-f2c4-4071-863c-9d31022325e4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:04.295858 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dd1f48fa-f2c4-4071-863c-9d31022325e4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:04.324275 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-dd1f48fa-f2c4-4071-863c-9d31022325e4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041721 Mar 03 02:37:04.324844 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 609/1225] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:04 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:37:04.366255 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-096db32b-bd6a-4ad1-93f5-c38cf2e76f3f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:04.374984 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-096db32b-bd6a-4ad1-93f5-c38cf2e76f3f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:04.376519 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-096db32b-bd6a-4ad1-93f5-c38cf2e76f3f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:04.377676 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-096db32b-bd6a-4ad1-93f5-c38cf2e76f3f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.158384 Mar 03 02:37:04.378233 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 617/1226] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:04 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:37:05.181827 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8943a998-9289-4525-a663-7a8ddadd578b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:05.182735 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8943a998-9289-4525-a663-7a8ddadd578b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:05.189059 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8943a998-9289-4525-a663-7a8ddadd578b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:05.189511 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8943a998-9289-4525-a663-7a8ddadd578b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:05.190292 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8943a998-9289-4525-a663-7a8ddadd578b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:05.190410 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5cdf430d-e84a-4ec7-a293-7e953a939948 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:05.190813 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8943a998-9289-4525-a663-7a8ddadd578b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:05.190985 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5cdf430d-e84a-4ec7-a293-7e953a939948 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:05.197392 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5cdf430d-e84a-4ec7-a293-7e953a939948 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:05.197839 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5cdf430d-e84a-4ec7-a293-7e953a939948 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:05.198615 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5cdf430d-e84a-4ec7-a293-7e953a939948 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:05.199048 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5cdf430d-e84a-4ec7-a293-7e953a939948 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:05.218007 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8943a998-9289-4525-a663-7a8ddadd578b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040109 Mar 03 02:37:05.218575 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 610/1227] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:05 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:05.228440 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4896a3f8-e56b-42f3-8e17-1aea81e02b42 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:05.229337 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4896a3f8-e56b-42f3-8e17-1aea81e02b42 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:05.235172 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4896a3f8-e56b-42f3-8e17-1aea81e02b42 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:05.235635 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4896a3f8-e56b-42f3-8e17-1aea81e02b42 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:05.236421 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4896a3f8-e56b-42f3-8e17-1aea81e02b42 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:05.236857 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4896a3f8-e56b-42f3-8e17-1aea81e02b42 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:05.261320 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5cdf430d-e84a-4ec7-a293-7e953a939948 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:05.265518 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4896a3f8-e56b-42f3-8e17-1aea81e02b42 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041682 Mar 03 02:37:05.266262 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 611/1228] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:05 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:37:05.268771 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5cdf430d-e84a-4ec7-a293-7e953a939948 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.082265 Mar 03 02:37:05.269320 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 618/1229] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:05 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:37:05.335537 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-91c71fea-77e9-4c64-a9db-6de236f14d97 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:05.336452 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-91c71fea-77e9-4c64-a9db-6de236f14d97 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:05.342096 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-91c71fea-77e9-4c64-a9db-6de236f14d97 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:05.342539 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-91c71fea-77e9-4c64-a9db-6de236f14d97 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:05.343305 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-91c71fea-77e9-4c64-a9db-6de236f14d97 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:05.343769 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-91c71fea-77e9-4c64-a9db-6de236f14d97 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:05.371876 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-91c71fea-77e9-4c64-a9db-6de236f14d97 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040160 Mar 03 02:37:05.372416 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 612/1230] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:05 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:37:05.396272 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-28b71125-a064-4361-a737-85ed2d6880d7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:05.397202 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-28b71125-a064-4361-a737-85ed2d6880d7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:05.403345 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-28b71125-a064-4361-a737-85ed2d6880d7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:05.403838 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-28b71125-a064-4361-a737-85ed2d6880d7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:05.404621 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-28b71125-a064-4361-a737-85ed2d6880d7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:05.405089 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-28b71125-a064-4361-a737-85ed2d6880d7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:05.534643 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-28b71125-a064-4361-a737-85ed2d6880d7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:05.543565 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-28b71125-a064-4361-a737-85ed2d6880d7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:05.545099 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-28b71125-a064-4361-a737-85ed2d6880d7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:05.546252 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-28b71125-a064-4361-a737-85ed2d6880d7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.154035 Mar 03 02:37:05.546809 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 619/1231] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:05 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:37:06.229828 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0de617d9-4a90-4a1a-91e4-8e9a2059783b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:06.230768 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0de617d9-4a90-4a1a-91e4-8e9a2059783b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:06.237093 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0de617d9-4a90-4a1a-91e4-8e9a2059783b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:06.237545 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0de617d9-4a90-4a1a-91e4-8e9a2059783b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:06.238333 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0de617d9-4a90-4a1a-91e4-8e9a2059783b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:06.238771 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0de617d9-4a90-4a1a-91e4-8e9a2059783b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:06.268065 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0de617d9-4a90-4a1a-91e4-8e9a2059783b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042179 Mar 03 02:37:06.268615 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 613/1232] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:06 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:06.277466 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f9d54eca-73f7-48bf-a9a0-cbebac72267f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:06.278373 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f9d54eca-73f7-48bf-a9a0-cbebac72267f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:06.284614 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f9d54eca-73f7-48bf-a9a0-cbebac72267f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:06.285065 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f9d54eca-73f7-48bf-a9a0-cbebac72267f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:06.285444 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1b7af08f-645b-48f6-985d-b9ed23a806e9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:06.285846 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f9d54eca-73f7-48bf-a9a0-cbebac72267f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:06.286075 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1b7af08f-645b-48f6-985d-b9ed23a806e9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:06.286765 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f9d54eca-73f7-48bf-a9a0-cbebac72267f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:06.291733 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1b7af08f-645b-48f6-985d-b9ed23a806e9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:06.292182 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1b7af08f-645b-48f6-985d-b9ed23a806e9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:06.292954 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1b7af08f-645b-48f6-985d-b9ed23a806e9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:06.293386 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1b7af08f-645b-48f6-985d-b9ed23a806e9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:06.319041 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f9d54eca-73f7-48bf-a9a0-cbebac72267f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045343 Mar 03 02:37:06.319641 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 620/1233] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:06 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:06.352551 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1b7af08f-645b-48f6-985d-b9ed23a806e9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:06.359815 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1b7af08f-645b-48f6-985d-b9ed23a806e9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.077973 Mar 03 02:37:06.360371 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 614/1234] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:06 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:37:06.383239 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-729e39c7-1b6e-4282-b40c-2669efcf0628 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:06.384207 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-729e39c7-1b6e-4282-b40c-2669efcf0628 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:06.390081 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-729e39c7-1b6e-4282-b40c-2669efcf0628 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:06.390528 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-729e39c7-1b6e-4282-b40c-2669efcf0628 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:06.391306 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-729e39c7-1b6e-4282-b40c-2669efcf0628 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:06.391783 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-729e39c7-1b6e-4282-b40c-2669efcf0628 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:06.418314 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-729e39c7-1b6e-4282-b40c-2669efcf0628 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039841 Mar 03 02:37:06.418863 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 621/1235] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:06 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:06.564559 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-fe9f77e0-bd5a-428a-87d0-7e6f3c613ed4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:06.565156 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-fe9f77e0-bd5a-428a-87d0-7e6f3c613ed4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:06.571923 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fe9f77e0-bd5a-428a-87d0-7e6f3c613ed4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:06.572306 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fe9f77e0-bd5a-428a-87d0-7e6f3c613ed4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:06.573073 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fe9f77e0-bd5a-428a-87d0-7e6f3c613ed4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:06.573501 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fe9f77e0-bd5a-428a-87d0-7e6f3c613ed4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:06.701581 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-fe9f77e0-bd5a-428a-87d0-7e6f3c613ed4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:06.709938 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-fe9f77e0-bd5a-428a-87d0-7e6f3c613ed4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:06.711436 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-fe9f77e0-bd5a-428a-87d0-7e6f3c613ed4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:06.712627 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-fe9f77e0-bd5a-428a-87d0-7e6f3c613ed4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.151901 Mar 03 02:37:06.713183 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 615/1236] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:06 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:37:07.279985 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-dc7ff51c-886a-412b-a01b-af454fa0597f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:07.280895 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-dc7ff51c-886a-412b-a01b-af454fa0597f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:07.287229 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dc7ff51c-886a-412b-a01b-af454fa0597f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:07.287715 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dc7ff51c-886a-412b-a01b-af454fa0597f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:07.288497 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dc7ff51c-886a-412b-a01b-af454fa0597f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:07.288937 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dc7ff51c-886a-412b-a01b-af454fa0597f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:07.316327 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-dc7ff51c-886a-412b-a01b-af454fa0597f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040272 Mar 03 02:37:07.316813 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 622/1237] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:07 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:07.330121 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c89b7d4a-c8a1-4a62-b1da-5d53f69c0f57 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:07.331016 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c89b7d4a-c8a1-4a62-b1da-5d53f69c0f57 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:07.337219 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c89b7d4a-c8a1-4a62-b1da-5d53f69c0f57 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:07.337660 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c89b7d4a-c8a1-4a62-b1da-5d53f69c0f57 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:07.338423 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c89b7d4a-c8a1-4a62-b1da-5d53f69c0f57 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:07.338852 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c89b7d4a-c8a1-4a62-b1da-5d53f69c0f57 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:07.366427 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c89b7d4a-c8a1-4a62-b1da-5d53f69c0f57 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040144 Mar 03 02:37:07.367459 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 616/1238] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:07 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:07.377612 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-94201374-bc0c-4170-9615-64c056b96e7a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:07.378225 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-94201374-bc0c-4170-9615-64c056b96e7a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:07.384017 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-94201374-bc0c-4170-9615-64c056b96e7a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:07.384467 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-94201374-bc0c-4170-9615-64c056b96e7a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:07.385245 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-94201374-bc0c-4170-9615-64c056b96e7a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:07.385679 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-94201374-bc0c-4170-9615-64c056b96e7a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:07.430535 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-52380fbd-4615-4e1a-9e13-062c639b0118 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:07.431427 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-52380fbd-4615-4e1a-9e13-062c639b0118 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:07.437126 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-52380fbd-4615-4e1a-9e13-062c639b0118 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:07.437573 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-52380fbd-4615-4e1a-9e13-062c639b0118 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:07.438339 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-52380fbd-4615-4e1a-9e13-062c639b0118 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:07.438769 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-52380fbd-4615-4e1a-9e13-062c639b0118 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:07.445266 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-94201374-bc0c-4170-9615-64c056b96e7a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:07.452635 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-94201374-bc0c-4170-9615-64c056b96e7a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078897 Mar 03 02:37:07.453211 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 623/1239] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:07 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:37:07.465954 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-52380fbd-4615-4e1a-9e13-062c639b0118 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040086 Mar 03 02:37:07.466491 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 617/1240] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:07 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:37:07.731394 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8a559a99-074c-4d6b-a8e1-69461d1f1af2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:07.732032 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8a559a99-074c-4d6b-a8e1-69461d1f1af2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:07.738165 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8a559a99-074c-4d6b-a8e1-69461d1f1af2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:07.738617 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8a559a99-074c-4d6b-a8e1-69461d1f1af2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:07.739438 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8a559a99-074c-4d6b-a8e1-69461d1f1af2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:07.739847 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8a559a99-074c-4d6b-a8e1-69461d1f1af2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:07.872565 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8a559a99-074c-4d6b-a8e1-69461d1f1af2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:07.881011 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8a559a99-074c-4d6b-a8e1-69461d1f1af2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:07.882521 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8a559a99-074c-4d6b-a8e1-69461d1f1af2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:07.883750 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8a559a99-074c-4d6b-a8e1-69461d1f1af2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.156896 Mar 03 02:37:07.884315 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 624/1241] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:07 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:37:08.328101 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-59770d5c-f53b-4e11-9f29-123a80d5abf8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:08.329001 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-59770d5c-f53b-4e11-9f29-123a80d5abf8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:08.335883 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-59770d5c-f53b-4e11-9f29-123a80d5abf8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:08.336496 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-59770d5c-f53b-4e11-9f29-123a80d5abf8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:08.337119 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-59770d5c-f53b-4e11-9f29-123a80d5abf8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:08.337556 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-59770d5c-f53b-4e11-9f29-123a80d5abf8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:08.364798 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-59770d5c-f53b-4e11-9f29-123a80d5abf8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040715 Mar 03 02:37:08.365338 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 618/1242] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:08 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:37:08.378019 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b3daa5b2-a4bf-403b-bc23-f705cacaaca0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:08.378929 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b3daa5b2-a4bf-403b-bc23-f705cacaaca0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:08.386240 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b3daa5b2-a4bf-403b-bc23-f705cacaaca0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:08.386739 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b3daa5b2-a4bf-403b-bc23-f705cacaaca0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:08.387526 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b3daa5b2-a4bf-403b-bc23-f705cacaaca0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:08.387990 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b3daa5b2-a4bf-403b-bc23-f705cacaaca0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:08.417408 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b3daa5b2-a4bf-403b-bc23-f705cacaaca0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043316 Mar 03 02:37:08.417956 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 625/1243] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:08 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:08.469228 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c3ae2ee7-cbf6-40a2-9d24-d2648e9da90d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:08.469845 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c3ae2ee7-cbf6-40a2-9d24-d2648e9da90d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:08.475843 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c3ae2ee7-cbf6-40a2-9d24-d2648e9da90d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:08.476276 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c3ae2ee7-cbf6-40a2-9d24-d2648e9da90d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:08.477043 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c3ae2ee7-cbf6-40a2-9d24-d2648e9da90d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:08.477474 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c3ae2ee7-cbf6-40a2-9d24-d2648e9da90d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:08.478001 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1611a7b4-c90e-4292-8e41-107ea54dfb48 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:08.478902 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1611a7b4-c90e-4292-8e41-107ea54dfb48 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:08.484549 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1611a7b4-c90e-4292-8e41-107ea54dfb48 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:08.484998 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1611a7b4-c90e-4292-8e41-107ea54dfb48 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:08.485772 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1611a7b4-c90e-4292-8e41-107ea54dfb48 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:08.486236 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1611a7b4-c90e-4292-8e41-107ea54dfb48 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:08.514649 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1611a7b4-c90e-4292-8e41-107ea54dfb48 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040540 Mar 03 02:37:08.515193 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 626/1244] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:08 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:37:08.539908 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c3ae2ee7-cbf6-40a2-9d24-d2648e9da90d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:08.547038 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c3ae2ee7-cbf6-40a2-9d24-d2648e9da90d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.081715 Mar 03 02:37:08.547587 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 619/1245] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:08 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:37:08.901609 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4222e9b0-2dbf-4250-a54c-9790497ba37f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:08.902204 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4222e9b0-2dbf-4250-a54c-9790497ba37f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:08.907943 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4222e9b0-2dbf-4250-a54c-9790497ba37f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:08.908391 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4222e9b0-2dbf-4250-a54c-9790497ba37f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:08.909161 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4222e9b0-2dbf-4250-a54c-9790497ba37f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:08.909602 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4222e9b0-2dbf-4250-a54c-9790497ba37f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:09.040443 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4222e9b0-2dbf-4250-a54c-9790497ba37f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:09.048820 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4222e9b0-2dbf-4250-a54c-9790497ba37f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:09.050318 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4222e9b0-2dbf-4250-a54c-9790497ba37f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:09.051469 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4222e9b0-2dbf-4250-a54c-9790497ba37f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.153768 Mar 03 02:37:09.052605 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 627/1246] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:08 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:37:09.376201 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-fa7699bc-f306-45a2-9463-52e31e8cd793 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:09.377113 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-fa7699bc-f306-45a2-9463-52e31e8cd793 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:09.383471 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fa7699bc-f306-45a2-9463-52e31e8cd793 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:09.383934 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fa7699bc-f306-45a2-9463-52e31e8cd793 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:09.384722 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fa7699bc-f306-45a2-9463-52e31e8cd793 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:09.385168 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fa7699bc-f306-45a2-9463-52e31e8cd793 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:09.413350 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-fa7699bc-f306-45a2-9463-52e31e8cd793 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041141 Mar 03 02:37:09.413891 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 620/1247] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:09 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:09.428176 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-cfc27003-1d30-4f45-9491-570c568e94c3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:09.429103 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-cfc27003-1d30-4f45-9491-570c568e94c3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:09.435253 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cfc27003-1d30-4f45-9491-570c568e94c3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:09.435741 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cfc27003-1d30-4f45-9491-570c568e94c3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:09.436518 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cfc27003-1d30-4f45-9491-570c568e94c3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:09.436948 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cfc27003-1d30-4f45-9491-570c568e94c3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:09.464391 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-cfc27003-1d30-4f45-9491-570c568e94c3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040501 Mar 03 02:37:09.464941 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 628/1248] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:09 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:09.526510 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b4b894d4-f40c-4ea1-8915-3c4b6d3094a4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:09.527421 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b4b894d4-f40c-4ea1-8915-3c4b6d3094a4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:09.533196 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b4b894d4-f40c-4ea1-8915-3c4b6d3094a4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:09.533649 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b4b894d4-f40c-4ea1-8915-3c4b6d3094a4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:09.534430 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b4b894d4-f40c-4ea1-8915-3c4b6d3094a4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:09.534872 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b4b894d4-f40c-4ea1-8915-3c4b6d3094a4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:09.562581 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b4b894d4-f40c-4ea1-8915-3c4b6d3094a4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039933 Mar 03 02:37:09.563131 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 621/1249] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:09 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:09.563975 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-81d98f4f-9736-4395-bdbb-e8719bc32b3a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:09.564594 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-81d98f4f-9736-4395-bdbb-e8719bc32b3a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:09.571025 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-81d98f4f-9736-4395-bdbb-e8719bc32b3a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:09.571482 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-81d98f4f-9736-4395-bdbb-e8719bc32b3a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:09.572284 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-81d98f4f-9736-4395-bdbb-e8719bc32b3a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:09.572725 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-81d98f4f-9736-4395-bdbb-e8719bc32b3a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:09.631144 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-81d98f4f-9736-4395-bdbb-e8719bc32b3a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:09.638299 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-81d98f4f-9736-4395-bdbb-e8719bc32b3a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078172 Mar 03 02:37:09.638870 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 629/1250] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:09 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:37:10.070959 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-24ead596-2330-4588-b97b-5b67d1c5785c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:10.071565 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-24ead596-2330-4588-b97b-5b67d1c5785c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:10.077323 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-24ead596-2330-4588-b97b-5b67d1c5785c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:10.077770 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-24ead596-2330-4588-b97b-5b67d1c5785c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:10.078543 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-24ead596-2330-4588-b97b-5b67d1c5785c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:10.078981 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-24ead596-2330-4588-b97b-5b67d1c5785c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:10.206504 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-24ead596-2330-4588-b97b-5b67d1c5785c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:10.214869 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-24ead596-2330-4588-b97b-5b67d1c5785c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:10.216415 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-24ead596-2330-4588-b97b-5b67d1c5785c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:10.217577 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-24ead596-2330-4588-b97b-5b67d1c5785c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.151142 Mar 03 02:37:10.218171 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 622/1251] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:10 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:37:10.424773 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-984f3c04-9e37-45ef-8126-a9d814d068c9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:10.425680 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-984f3c04-9e37-45ef-8126-a9d814d068c9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:10.432632 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-984f3c04-9e37-45ef-8126-a9d814d068c9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:10.433205 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-984f3c04-9e37-45ef-8126-a9d814d068c9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:10.433835 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-984f3c04-9e37-45ef-8126-a9d814d068c9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:10.434268 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-984f3c04-9e37-45ef-8126-a9d814d068c9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:10.461142 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-984f3c04-9e37-45ef-8126-a9d814d068c9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040329 Mar 03 02:37:10.461676 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 630/1252] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:10 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:10.476760 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-48935bb0-aaca-40b7-a457-578e3b1f8a31 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:10.477671 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-48935bb0-aaca-40b7-a457-578e3b1f8a31 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:10.483862 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-48935bb0-aaca-40b7-a457-578e3b1f8a31 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:10.484310 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-48935bb0-aaca-40b7-a457-578e3b1f8a31 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:10.485087 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-48935bb0-aaca-40b7-a457-578e3b1f8a31 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:10.485521 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-48935bb0-aaca-40b7-a457-578e3b1f8a31 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:10.514431 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-48935bb0-aaca-40b7-a457-578e3b1f8a31 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042248 Mar 03 02:37:10.514988 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 623/1253] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:10 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:10.573667 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-18386515-7084-4f40-a3c0-ff84ebbf47b7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:10.574578 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-18386515-7084-4f40-a3c0-ff84ebbf47b7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:10.580433 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-18386515-7084-4f40-a3c0-ff84ebbf47b7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:10.580887 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-18386515-7084-4f40-a3c0-ff84ebbf47b7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:10.581675 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-18386515-7084-4f40-a3c0-ff84ebbf47b7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:10.582115 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-18386515-7084-4f40-a3c0-ff84ebbf47b7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:10.609613 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-18386515-7084-4f40-a3c0-ff84ebbf47b7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039913 Mar 03 02:37:10.610192 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 631/1254] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:10 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:10.655295 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9db1cd21-7d45-4b8f-aa99-4ad99ad8c61e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:10.655917 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9db1cd21-7d45-4b8f-aa99-4ad99ad8c61e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:10.662401 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9db1cd21-7d45-4b8f-aa99-4ad99ad8c61e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:10.662853 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9db1cd21-7d45-4b8f-aa99-4ad99ad8c61e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:10.663667 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9db1cd21-7d45-4b8f-aa99-4ad99ad8c61e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:10.664144 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9db1cd21-7d45-4b8f-aa99-4ad99ad8c61e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:10.722149 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9db1cd21-7d45-4b8f-aa99-4ad99ad8c61e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:10.729982 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9db1cd21-7d45-4b8f-aa99-4ad99ad8c61e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078439 Mar 03 02:37:10.730538 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 624/1255] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:10 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:37:11.235671 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ed4ae7f2-3222-440a-97c4-502f1d9dcf94 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:11.236320 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ed4ae7f2-3222-440a-97c4-502f1d9dcf94 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:11.242376 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ed4ae7f2-3222-440a-97c4-502f1d9dcf94 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:11.242822 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ed4ae7f2-3222-440a-97c4-502f1d9dcf94 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:11.243625 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ed4ae7f2-3222-440a-97c4-502f1d9dcf94 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:11.244059 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ed4ae7f2-3222-440a-97c4-502f1d9dcf94 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:11.376934 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ed4ae7f2-3222-440a-97c4-502f1d9dcf94 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:11.385515 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ed4ae7f2-3222-440a-97c4-502f1d9dcf94 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:11.387009 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ed4ae7f2-3222-440a-97c4-502f1d9dcf94 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:11.388181 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ed4ae7f2-3222-440a-97c4-502f1d9dcf94 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.156433 Mar 03 02:37:11.388731 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 632/1256] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:11 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:37:11.472439 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a8a94dd9-970a-4691-b7dd-693b462b3c57 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:11.473532 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a8a94dd9-970a-4691-b7dd-693b462b3c57 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:11.479290 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a8a94dd9-970a-4691-b7dd-693b462b3c57 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:11.479894 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a8a94dd9-970a-4691-b7dd-693b462b3c57 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:11.480521 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a8a94dd9-970a-4691-b7dd-693b462b3c57 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:11.480959 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a8a94dd9-970a-4691-b7dd-693b462b3c57 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:11.509668 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a8a94dd9-970a-4691-b7dd-693b462b3c57 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041158 Mar 03 02:37:11.510206 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 625/1257] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:11 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:11.525784 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-17e2ad19-470d-4429-9db8-4f032f88cb5c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:11.526691 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-17e2ad19-470d-4429-9db8-4f032f88cb5c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:11.533051 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-17e2ad19-470d-4429-9db8-4f032f88cb5c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:11.533495 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-17e2ad19-470d-4429-9db8-4f032f88cb5c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:11.534268 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-17e2ad19-470d-4429-9db8-4f032f88cb5c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:11.534701 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-17e2ad19-470d-4429-9db8-4f032f88cb5c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:11.562533 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-17e2ad19-470d-4429-9db8-4f032f88cb5c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040660 Mar 03 02:37:11.563082 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 633/1258] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:11 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:11.621537 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7291b59b-cea5-417c-845e-020cdccbd131 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:11.622404 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7291b59b-cea5-417c-845e-020cdccbd131 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:11.628241 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7291b59b-cea5-417c-845e-020cdccbd131 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:11.628690 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7291b59b-cea5-417c-845e-020cdccbd131 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:11.629463 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7291b59b-cea5-417c-845e-020cdccbd131 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:11.630647 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7291b59b-cea5-417c-845e-020cdccbd131 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:11.657337 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7291b59b-cea5-417c-845e-020cdccbd131 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040005 Mar 03 02:37:11.657867 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 626/1259] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:11 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:11.746479 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-022e205b-4736-41e0-aead-384874e9d963 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:11.747088 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-022e205b-4736-41e0-aead-384874e9d963 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:11.752935 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-022e205b-4736-41e0-aead-384874e9d963 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:11.753389 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-022e205b-4736-41e0-aead-384874e9d963 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:11.754167 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-022e205b-4736-41e0-aead-384874e9d963 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:11.755352 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-022e205b-4736-41e0-aead-384874e9d963 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:11.813183 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-022e205b-4736-41e0-aead-384874e9d963 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:11.821202 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-022e205b-4736-41e0-aead-384874e9d963 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078830 Mar 03 02:37:11.821765 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 634/1260] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:11 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:37:12.406732 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1768a709-28ec-4f54-99d3-1429adb431c2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:12.407333 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1768a709-28ec-4f54-99d3-1429adb431c2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:12.414010 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1768a709-28ec-4f54-99d3-1429adb431c2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:12.414447 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1768a709-28ec-4f54-99d3-1429adb431c2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:12.415224 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1768a709-28ec-4f54-99d3-1429adb431c2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:12.415703 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1768a709-28ec-4f54-99d3-1429adb431c2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:12.522330 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-432b0860-720b-4cec-ad8f-829e2838a9c5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:12.523249 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-432b0860-720b-4cec-ad8f-829e2838a9c5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:12.528975 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-432b0860-720b-4cec-ad8f-829e2838a9c5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:12.529603 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-432b0860-720b-4cec-ad8f-829e2838a9c5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:12.530191 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-432b0860-720b-4cec-ad8f-829e2838a9c5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:12.530627 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-432b0860-720b-4cec-ad8f-829e2838a9c5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:12.561881 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-432b0860-720b-4cec-ad8f-829e2838a9c5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044644 Mar 03 02:37:12.563021 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 635/1261] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:12 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:37:12.574355 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a9008887-5acd-4a7e-8d3b-06bb128681f6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:12.575273 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a9008887-5acd-4a7e-8d3b-06bb128681f6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:12.581440 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a9008887-5acd-4a7e-8d3b-06bb128681f6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:12.581889 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a9008887-5acd-4a7e-8d3b-06bb128681f6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:12.582709 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a9008887-5acd-4a7e-8d3b-06bb128681f6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:12.583748 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a9008887-5acd-4a7e-8d3b-06bb128681f6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:12.614469 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a9008887-5acd-4a7e-8d3b-06bb128681f6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043996 Mar 03 02:37:12.615062 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 636/1262] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:12 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:37:12.669089 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3181b068-c474-4b7a-b3b4-4fecce2ff6b6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:12.669955 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3181b068-c474-4b7a-b3b4-4fecce2ff6b6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:12.676045 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3181b068-c474-4b7a-b3b4-4fecce2ff6b6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:12.676536 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3181b068-c474-4b7a-b3b4-4fecce2ff6b6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:12.678065 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3181b068-c474-4b7a-b3b4-4fecce2ff6b6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:12.678502 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3181b068-c474-4b7a-b3b4-4fecce2ff6b6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:12.709086 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3181b068-c474-4b7a-b3b4-4fecce2ff6b6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043970 Mar 03 02:37:12.709672 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 637/1263] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:12 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:37:12.774009 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1768a709-28ec-4f54-99d3-1429adb431c2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:12.782234 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1768a709-28ec-4f54-99d3-1429adb431c2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:12.783742 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1768a709-28ec-4f54-99d3-1429adb431c2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:12.784876 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1768a709-28ec-4f54-99d3-1429adb431c2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.382066 Mar 03 02:37:12.785429 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 627/1264] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:12 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:37:12.839023 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0f041047-0563-427d-8f67-0e36d89e504f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:12.839648 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0f041047-0563-427d-8f67-0e36d89e504f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:12.845700 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0f041047-0563-427d-8f67-0e36d89e504f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:12.846156 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0f041047-0563-427d-8f67-0e36d89e504f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:12.846974 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0f041047-0563-427d-8f67-0e36d89e504f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:12.847415 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0f041047-0563-427d-8f67-0e36d89e504f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:12.906376 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0f041047-0563-427d-8f67-0e36d89e504f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:12.913572 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0f041047-0563-427d-8f67-0e36d89e504f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078425 Mar 03 02:37:12.914125 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 638/1265] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:12 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:37:13.572818 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-43791f46-558f-4652-b954-cb069d97fc0f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:13.573719 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-43791f46-558f-4652-b954-cb069d97fc0f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:13.579840 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-43791f46-558f-4652-b954-cb069d97fc0f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:13.580287 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-43791f46-558f-4652-b954-cb069d97fc0f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:13.581054 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-43791f46-558f-4652-b954-cb069d97fc0f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:13.581486 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-43791f46-558f-4652-b954-cb069d97fc0f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:13.608640 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-43791f46-558f-4652-b954-cb069d97fc0f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039840 Mar 03 02:37:13.609178 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 628/1266] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:13 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:37:13.625979 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-52ee3a4c-f8ff-4ec3-a775-6a63721551ae tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:13.626820 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-52ee3a4c-f8ff-4ec3-a775-6a63721551ae tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:13.633114 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-52ee3a4c-f8ff-4ec3-a775-6a63721551ae tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:13.633561 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-52ee3a4c-f8ff-4ec3-a775-6a63721551ae tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:13.634331 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-52ee3a4c-f8ff-4ec3-a775-6a63721551ae tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:13.634761 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-52ee3a4c-f8ff-4ec3-a775-6a63721551ae tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:13.662535 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-52ee3a4c-f8ff-4ec3-a775-6a63721551ae tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040509 Mar 03 02:37:13.663075 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 639/1267] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:13 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:13.720641 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-229c5140-2707-432e-9939-677c3155e4bd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:13.721567 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-229c5140-2707-432e-9939-677c3155e4bd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:13.728199 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-229c5140-2707-432e-9939-677c3155e4bd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:13.728645 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-229c5140-2707-432e-9939-677c3155e4bd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:13.729410 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-229c5140-2707-432e-9939-677c3155e4bd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:13.729839 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-229c5140-2707-432e-9939-677c3155e4bd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:13.756725 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-229c5140-2707-432e-9939-677c3155e4bd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039950 Mar 03 02:37:13.757269 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 629/1268] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:13 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:37:13.802582 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a732ddb7-2e42-4bdf-995e-525eb53bc063 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:13.803192 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a732ddb7-2e42-4bdf-995e-525eb53bc063 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:13.809047 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a732ddb7-2e42-4bdf-995e-525eb53bc063 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:13.809497 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a732ddb7-2e42-4bdf-995e-525eb53bc063 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:13.810273 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a732ddb7-2e42-4bdf-995e-525eb53bc063 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:13.810710 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a732ddb7-2e42-4bdf-995e-525eb53bc063 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:13.930408 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7aa1ac38-bdb9-4b24-9b25-a23313390528 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:13.931016 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7aa1ac38-bdb9-4b24-9b25-a23313390528 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:13.936619 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7aa1ac38-bdb9-4b24-9b25-a23313390528 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:13.937064 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7aa1ac38-bdb9-4b24-9b25-a23313390528 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:13.937835 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7aa1ac38-bdb9-4b24-9b25-a23313390528 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:13.938262 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7aa1ac38-bdb9-4b24-9b25-a23313390528 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:13.947052 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a732ddb7-2e42-4bdf-995e-525eb53bc063 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:13.955191 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a732ddb7-2e42-4bdf-995e-525eb53bc063 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:13.956749 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a732ddb7-2e42-4bdf-995e-525eb53bc063 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:13.958509 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a732ddb7-2e42-4bdf-995e-525eb53bc063 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.159718 Mar 03 02:37:13.959068 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 640/1269] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:13 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:37:13.995801 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-7aa1ac38-bdb9-4b24-9b25-a23313390528 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:14.003026 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7aa1ac38-bdb9-4b24-9b25-a23313390528 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.076648 Mar 03 02:37:14.003585 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 630/1270] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:13 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:37:14.621012 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0effa3a5-d6dc-4f27-b4c1-3fb432407637 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:14.621868 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0effa3a5-d6dc-4f27-b4c1-3fb432407637 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:14.627679 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0effa3a5-d6dc-4f27-b4c1-3fb432407637 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:14.628230 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0effa3a5-d6dc-4f27-b4c1-3fb432407637 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:14.628875 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0effa3a5-d6dc-4f27-b4c1-3fb432407637 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:14.629305 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0effa3a5-d6dc-4f27-b4c1-3fb432407637 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:14.657467 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0effa3a5-d6dc-4f27-b4c1-3fb432407637 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040890 Mar 03 02:37:14.658009 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 641/1271] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:14 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:14.673761 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-79505dfd-7f21-447d-b893-7852ac0125bd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:14.674656 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-79505dfd-7f21-447d-b893-7852ac0125bd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:14.681403 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-79505dfd-7f21-447d-b893-7852ac0125bd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:14.681852 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-79505dfd-7f21-447d-b893-7852ac0125bd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:14.682623 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-79505dfd-7f21-447d-b893-7852ac0125bd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:14.683053 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-79505dfd-7f21-447d-b893-7852ac0125bd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:14.710553 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-79505dfd-7f21-447d-b893-7852ac0125bd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040672 Mar 03 02:37:14.711089 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 631/1272] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:14 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:14.768044 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-bdee481f-724c-43c0-a5b8-8188d12db5ca tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:14.768949 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-bdee481f-724c-43c0-a5b8-8188d12db5ca tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:14.774771 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bdee481f-724c-43c0-a5b8-8188d12db5ca tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:14.775213 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bdee481f-724c-43c0-a5b8-8188d12db5ca tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:14.776086 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bdee481f-724c-43c0-a5b8-8188d12db5ca tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:14.776518 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bdee481f-724c-43c0-a5b8-8188d12db5ca tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:14.803496 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-bdee481f-724c-43c0-a5b8-8188d12db5ca tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039347 Mar 03 02:37:14.804060 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 642/1273] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:14 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:14.976947 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-edad4d6c-45ba-4b22-b9b7-8be10b3f5d42 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:14.977467 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-edad4d6c-45ba-4b22-b9b7-8be10b3f5d42 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:14.983289 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-edad4d6c-45ba-4b22-b9b7-8be10b3f5d42 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:14.983784 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-edad4d6c-45ba-4b22-b9b7-8be10b3f5d42 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:14.984563 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-edad4d6c-45ba-4b22-b9b7-8be10b3f5d42 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:14.985021 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-edad4d6c-45ba-4b22-b9b7-8be10b3f5d42 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:15.019539 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-13806e63-b712-4b8e-ac74-28a8fd318d63 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:15.020235 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-13806e63-b712-4b8e-ac74-28a8fd318d63 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:15.026442 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-13806e63-b712-4b8e-ac74-28a8fd318d63 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:15.026895 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-13806e63-b712-4b8e-ac74-28a8fd318d63 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:15.027701 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-13806e63-b712-4b8e-ac74-28a8fd318d63 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:15.028165 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-13806e63-b712-4b8e-ac74-28a8fd318d63 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:15.087621 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-13806e63-b712-4b8e-ac74-28a8fd318d63 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:15.094989 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-13806e63-b712-4b8e-ac74-28a8fd318d63 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.079240 Mar 03 02:37:15.095548 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 643/1274] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:15 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:37:15.114532 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-edad4d6c-45ba-4b22-b9b7-8be10b3f5d42 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:15.122800 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-edad4d6c-45ba-4b22-b9b7-8be10b3f5d42 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:15.124358 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-edad4d6c-45ba-4b22-b9b7-8be10b3f5d42 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:15.125514 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-edad4d6c-45ba-4b22-b9b7-8be10b3f5d42 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.153024 Mar 03 02:37:15.126243 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 632/1275] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:14 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:37:15.669123 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-17c1780b-7549-46c7-bd86-93a74eb4492b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:15.669985 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-17c1780b-7549-46c7-bd86-93a74eb4492b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:15.676254 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-17c1780b-7549-46c7-bd86-93a74eb4492b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:15.676878 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-17c1780b-7549-46c7-bd86-93a74eb4492b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:15.677784 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-17c1780b-7549-46c7-bd86-93a74eb4492b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:15.678220 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-17c1780b-7549-46c7-bd86-93a74eb4492b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:15.706346 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-17c1780b-7549-46c7-bd86-93a74eb4492b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041273 Mar 03 02:37:15.706888 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 644/1276] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:15 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:15.721804 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e24fe5bd-0104-4738-ad8c-6021a6f3f420 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:15.722703 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e24fe5bd-0104-4738-ad8c-6021a6f3f420 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:15.729004 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e24fe5bd-0104-4738-ad8c-6021a6f3f420 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:15.729450 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e24fe5bd-0104-4738-ad8c-6021a6f3f420 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:15.730218 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e24fe5bd-0104-4738-ad8c-6021a6f3f420 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:15.730650 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e24fe5bd-0104-4738-ad8c-6021a6f3f420 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:15.759268 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e24fe5bd-0104-4738-ad8c-6021a6f3f420 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041344 Mar 03 02:37:15.759864 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 633/1277] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:15 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:15.814394 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f0f55425-7e0d-44c2-9caf-5d845727ab0b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:15.815306 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f0f55425-7e0d-44c2-9caf-5d845727ab0b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:15.821898 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f0f55425-7e0d-44c2-9caf-5d845727ab0b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:15.822345 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f0f55425-7e0d-44c2-9caf-5d845727ab0b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:15.823145 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f0f55425-7e0d-44c2-9caf-5d845727ab0b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:15.823575 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f0f55425-7e0d-44c2-9caf-5d845727ab0b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:15.850782 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f0f55425-7e0d-44c2-9caf-5d845727ab0b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040409 Mar 03 02:37:15.851318 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 645/1278] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:15 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:16.111589 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0e294245-2c23-44e2-8eda-6ac8d18210b5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:16.112210 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0e294245-2c23-44e2-8eda-6ac8d18210b5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:16.118575 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0e294245-2c23-44e2-8eda-6ac8d18210b5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:16.119016 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0e294245-2c23-44e2-8eda-6ac8d18210b5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:16.120079 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0e294245-2c23-44e2-8eda-6ac8d18210b5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:16.120519 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0e294245-2c23-44e2-8eda-6ac8d18210b5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:16.144920 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-00de3324-ecc2-4e0e-93ec-a12896f57310 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:16.145786 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-00de3324-ecc2-4e0e-93ec-a12896f57310 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:16.152539 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-00de3324-ecc2-4e0e-93ec-a12896f57310 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:16.152997 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-00de3324-ecc2-4e0e-93ec-a12896f57310 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:16.153798 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-00de3324-ecc2-4e0e-93ec-a12896f57310 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:16.154239 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-00de3324-ecc2-4e0e-93ec-a12896f57310 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:16.182464 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0e294245-2c23-44e2-8eda-6ac8d18210b5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:16.189845 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0e294245-2c23-44e2-8eda-6ac8d18210b5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.082045 Mar 03 02:37:16.190406 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 634/1279] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:16 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:37:16.283712 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-00de3324-ecc2-4e0e-93ec-a12896f57310 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:16.291842 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-00de3324-ecc2-4e0e-93ec-a12896f57310 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:16.293348 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-00de3324-ecc2-4e0e-93ec-a12896f57310 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:16.294508 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-00de3324-ecc2-4e0e-93ec-a12896f57310 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.155278 Mar 03 02:37:16.295076 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 646/1280] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:16 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:37:16.718412 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-da911e53-788c-40e1-925c-8a7d0a688efa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:16.719316 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-da911e53-788c-40e1-925c-8a7d0a688efa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:16.726277 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-da911e53-788c-40e1-925c-8a7d0a688efa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:16.726721 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-da911e53-788c-40e1-925c-8a7d0a688efa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:16.727487 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-da911e53-788c-40e1-925c-8a7d0a688efa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:16.727959 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-da911e53-788c-40e1-925c-8a7d0a688efa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:16.755214 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-da911e53-788c-40e1-925c-8a7d0a688efa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040777 Mar 03 02:37:16.755782 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 635/1281] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:16 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:16.770732 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0c9acf55-a241-4a00-9221-922943530997 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:16.771805 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0c9acf55-a241-4a00-9221-922943530997 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:16.777996 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0c9acf55-a241-4a00-9221-922943530997 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:16.778441 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0c9acf55-a241-4a00-9221-922943530997 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:16.779213 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0c9acf55-a241-4a00-9221-922943530997 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:16.779668 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0c9acf55-a241-4a00-9221-922943530997 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:16.808466 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0c9acf55-a241-4a00-9221-922943530997 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042190 Mar 03 02:37:16.809024 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 647/1282] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:16 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:16.862011 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4a14f036-3ed4-4052-a7ec-f3897fe98376 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:16.862921 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4a14f036-3ed4-4052-a7ec-f3897fe98376 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:16.868745 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4a14f036-3ed4-4052-a7ec-f3897fe98376 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:16.869453 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4a14f036-3ed4-4052-a7ec-f3897fe98376 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:16.870233 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4a14f036-3ed4-4052-a7ec-f3897fe98376 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:16.870673 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4a14f036-3ed4-4052-a7ec-f3897fe98376 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:16.898149 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4a14f036-3ed4-4052-a7ec-f3897fe98376 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040002 Mar 03 02:37:16.898699 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 636/1283] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:16 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:17.207551 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1e5ed12f-4d3e-44a1-bca4-aba600a19a20 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:17.208838 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1e5ed12f-4d3e-44a1-bca4-aba600a19a20 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:17.214717 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1e5ed12f-4d3e-44a1-bca4-aba600a19a20 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:17.215171 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1e5ed12f-4d3e-44a1-bca4-aba600a19a20 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:17.215983 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1e5ed12f-4d3e-44a1-bca4-aba600a19a20 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:17.216423 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1e5ed12f-4d3e-44a1-bca4-aba600a19a20 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:17.280565 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1e5ed12f-4d3e-44a1-bca4-aba600a19a20 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:17.287721 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1e5ed12f-4d3e-44a1-bca4-aba600a19a20 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.084196 Mar 03 02:37:17.288279 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 648/1284] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:17 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:37:17.312996 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8660f292-df95-4b9a-bbf8-d9da32811051 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:17.313537 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8660f292-df95-4b9a-bbf8-d9da32811051 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:17.320168 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8660f292-df95-4b9a-bbf8-d9da32811051 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:17.320624 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8660f292-df95-4b9a-bbf8-d9da32811051 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:17.321419 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8660f292-df95-4b9a-bbf8-d9da32811051 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:17.321854 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8660f292-df95-4b9a-bbf8-d9da32811051 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:17.452082 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8660f292-df95-4b9a-bbf8-d9da32811051 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:17.460582 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8660f292-df95-4b9a-bbf8-d9da32811051 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:17.462080 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8660f292-df95-4b9a-bbf8-d9da32811051 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:17.463226 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8660f292-df95-4b9a-bbf8-d9da32811051 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.154111 Mar 03 02:37:17.463808 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 637/1285] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:17 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:37:17.766434 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-54480daf-613a-43c4-8046-d51eb108f628 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:17.767345 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-54480daf-613a-43c4-8046-d51eb108f628 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:17.773385 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-54480daf-613a-43c4-8046-d51eb108f628 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:17.773976 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-54480daf-613a-43c4-8046-d51eb108f628 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:17.774626 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-54480daf-613a-43c4-8046-d51eb108f628 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:17.775067 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-54480daf-613a-43c4-8046-d51eb108f628 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:17.803725 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-54480daf-613a-43c4-8046-d51eb108f628 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041277 Mar 03 02:37:17.804281 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 649/1286] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:17 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:17.820473 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e1b34e76-ffd5-40a2-8433-683545cfde9e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:17.821376 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e1b34e76-ffd5-40a2-8433-683545cfde9e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:17.827439 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e1b34e76-ffd5-40a2-8433-683545cfde9e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:17.827918 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e1b34e76-ffd5-40a2-8433-683545cfde9e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:17.828685 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e1b34e76-ffd5-40a2-8433-683545cfde9e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:17.829117 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e1b34e76-ffd5-40a2-8433-683545cfde9e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:17.856798 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e1b34e76-ffd5-40a2-8433-683545cfde9e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041006 Mar 03 02:37:17.857330 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 638/1287] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:17 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:17.909691 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-efb7c147-d4f7-4318-8dac-051ac0576a9b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:17.910607 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-efb7c147-d4f7-4318-8dac-051ac0576a9b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:17.916994 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-efb7c147-d4f7-4318-8dac-051ac0576a9b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:17.917448 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-efb7c147-d4f7-4318-8dac-051ac0576a9b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:17.918232 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-efb7c147-d4f7-4318-8dac-051ac0576a9b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:17.918673 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-efb7c147-d4f7-4318-8dac-051ac0576a9b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:17.946886 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-efb7c147-d4f7-4318-8dac-051ac0576a9b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041193 Mar 03 02:37:17.947432 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 650/1288] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:17 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:18.304349 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a2890340-5004-4223-981d-65b76ca6c88c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:18.304883 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a2890340-5004-4223-981d-65b76ca6c88c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:18.310674 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a2890340-5004-4223-981d-65b76ca6c88c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:18.311117 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a2890340-5004-4223-981d-65b76ca6c88c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:18.311911 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a2890340-5004-4223-981d-65b76ca6c88c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:18.312339 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a2890340-5004-4223-981d-65b76ca6c88c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:18.370326 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a2890340-5004-4223-981d-65b76ca6c88c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:18.377438 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a2890340-5004-4223-981d-65b76ca6c88c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.077093 Mar 03 02:37:18.378111 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 639/1289] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:18 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:37:18.481659 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-63110c86-8de7-42d8-a4b7-1ffa7ea7b08b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:18.482262 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-63110c86-8de7-42d8-a4b7-1ffa7ea7b08b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:18.488080 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-63110c86-8de7-42d8-a4b7-1ffa7ea7b08b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:18.488529 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-63110c86-8de7-42d8-a4b7-1ffa7ea7b08b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:18.489651 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-63110c86-8de7-42d8-a4b7-1ffa7ea7b08b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:18.490088 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-63110c86-8de7-42d8-a4b7-1ffa7ea7b08b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:18.617762 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-63110c86-8de7-42d8-a4b7-1ffa7ea7b08b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:18.626219 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-63110c86-8de7-42d8-a4b7-1ffa7ea7b08b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:18.627748 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-63110c86-8de7-42d8-a4b7-1ffa7ea7b08b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:18.628983 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-63110c86-8de7-42d8-a4b7-1ffa7ea7b08b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.151155 Mar 03 02:37:18.630649 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 651/1290] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:18 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:37:18.815189 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2f2607e7-663d-4649-a744-91d32a2a6777 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:18.816126 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2f2607e7-663d-4649-a744-91d32a2a6777 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:18.822532 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2f2607e7-663d-4649-a744-91d32a2a6777 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:18.822996 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2f2607e7-663d-4649-a744-91d32a2a6777 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:18.823845 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2f2607e7-663d-4649-a744-91d32a2a6777 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:18.824287 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2f2607e7-663d-4649-a744-91d32a2a6777 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:18.853692 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2f2607e7-663d-4649-a744-91d32a2a6777 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042391 Mar 03 02:37:18.854246 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 640/1291] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:18 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:18.867706 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ab248076-d75d-4cc1-b1e5-94ff3580feb4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:18.869668 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ab248076-d75d-4cc1-b1e5-94ff3580feb4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:18.876025 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ab248076-d75d-4cc1-b1e5-94ff3580feb4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:18.876478 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ab248076-d75d-4cc1-b1e5-94ff3580feb4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:18.877254 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ab248076-d75d-4cc1-b1e5-94ff3580feb4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:18.877690 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ab248076-d75d-4cc1-b1e5-94ff3580feb4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:18.906955 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ab248076-d75d-4cc1-b1e5-94ff3580feb4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043281 Mar 03 02:37:18.907506 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 652/1292] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:18 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:19.051209 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d8faae40-4c50-430f-a564-df5d8a449189 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:19.052975 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d8faae40-4c50-430f-a564-df5d8a449189 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:19.058860 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d8faae40-4c50-430f-a564-df5d8a449189 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:19.059299 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d8faae40-4c50-430f-a564-df5d8a449189 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:19.060104 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d8faae40-4c50-430f-a564-df5d8a449189 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:19.060534 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d8faae40-4c50-430f-a564-df5d8a449189 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:19.087647 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d8faae40-4c50-430f-a564-df5d8a449189 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133873 Mar 03 02:37:19.088125 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 641/1293] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:18 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:19.394012 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-40889a19-2c53-4b04-9656-ac343cc9e1c0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:19.394617 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-40889a19-2c53-4b04-9656-ac343cc9e1c0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:19.400552 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-40889a19-2c53-4b04-9656-ac343cc9e1c0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:19.400999 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-40889a19-2c53-4b04-9656-ac343cc9e1c0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:19.401796 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-40889a19-2c53-4b04-9656-ac343cc9e1c0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:19.402226 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-40889a19-2c53-4b04-9656-ac343cc9e1c0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:19.461026 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-40889a19-2c53-4b04-9656-ac343cc9e1c0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:19.468269 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-40889a19-2c53-4b04-9656-ac343cc9e1c0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078196 Mar 03 02:37:19.468831 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 653/1294] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:19 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:37:19.648469 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d8a22f81-6b81-4dd5-8b18-7e6812935ee5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:19.648996 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d8a22f81-6b81-4dd5-8b18-7e6812935ee5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:19.654716 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d8a22f81-6b81-4dd5-8b18-7e6812935ee5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:19.655173 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d8a22f81-6b81-4dd5-8b18-7e6812935ee5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:19.655981 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d8a22f81-6b81-4dd5-8b18-7e6812935ee5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:19.656417 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d8a22f81-6b81-4dd5-8b18-7e6812935ee5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:19.792529 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d8a22f81-6b81-4dd5-8b18-7e6812935ee5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:19.800583 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d8a22f81-6b81-4dd5-8b18-7e6812935ee5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:19.802250 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d8a22f81-6b81-4dd5-8b18-7e6812935ee5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:19.803403 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d8a22f81-6b81-4dd5-8b18-7e6812935ee5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.159622 Mar 03 02:37:19.803999 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 642/1295] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:19 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:37:19.865074 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1d67bc81-60cf-4d33-8274-e35cc91f894a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:19.865986 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1d67bc81-60cf-4d33-8274-e35cc91f894a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:19.872054 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1d67bc81-60cf-4d33-8274-e35cc91f894a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:19.872632 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1d67bc81-60cf-4d33-8274-e35cc91f894a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:19.873279 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1d67bc81-60cf-4d33-8274-e35cc91f894a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:19.873719 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1d67bc81-60cf-4d33-8274-e35cc91f894a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:19.902029 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1d67bc81-60cf-4d33-8274-e35cc91f894a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040803 Mar 03 02:37:19.902504 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 654/1296] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:19 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:19.918160 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-03fe5fad-3d4c-47cf-9d8c-4a8ff13e9c64 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:19.919102 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-03fe5fad-3d4c-47cf-9d8c-4a8ff13e9c64 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:19.925310 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-03fe5fad-3d4c-47cf-9d8c-4a8ff13e9c64 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:19.925755 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-03fe5fad-3d4c-47cf-9d8c-4a8ff13e9c64 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:19.926656 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-03fe5fad-3d4c-47cf-9d8c-4a8ff13e9c64 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:19.927095 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-03fe5fad-3d4c-47cf-9d8c-4a8ff13e9c64 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:19.954035 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-03fe5fad-3d4c-47cf-9d8c-4a8ff13e9c64 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039794 Mar 03 02:37:19.954572 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 643/1297] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:19 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:20.098344 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-14757b91-9219-42ae-8862-d1ed2ab7f87d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:20.099432 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-14757b91-9219-42ae-8862-d1ed2ab7f87d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:20.105216 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-14757b91-9219-42ae-8862-d1ed2ab7f87d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:20.105660 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-14757b91-9219-42ae-8862-d1ed2ab7f87d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:20.106430 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-14757b91-9219-42ae-8862-d1ed2ab7f87d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:20.106858 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-14757b91-9219-42ae-8862-d1ed2ab7f87d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:20.134599 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-14757b91-9219-42ae-8862-d1ed2ab7f87d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040245 Mar 03 02:37:20.135143 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 655/1298] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:20 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:20.484703 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-98c6ec2f-64a4-4d2c-86e4-b1c67ea91df7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:20.485306 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-98c6ec2f-64a4-4d2c-86e4-b1c67ea91df7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:20.491743 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-98c6ec2f-64a4-4d2c-86e4-b1c67ea91df7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:20.492189 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-98c6ec2f-64a4-4d2c-86e4-b1c67ea91df7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:20.492954 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-98c6ec2f-64a4-4d2c-86e4-b1c67ea91df7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:20.493384 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-98c6ec2f-64a4-4d2c-86e4-b1c67ea91df7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:20.549780 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-98c6ec2f-64a4-4d2c-86e4-b1c67ea91df7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:20.557748 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-98c6ec2f-64a4-4d2c-86e4-b1c67ea91df7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.076879 Mar 03 02:37:20.558297 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 644/1299] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:20 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:37:20.822071 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8b981b49-799d-420f-85bf-c2aa809768e1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:20.822618 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8b981b49-799d-420f-85bf-c2aa809768e1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:20.828481 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8b981b49-799d-420f-85bf-c2aa809768e1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:20.828943 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8b981b49-799d-420f-85bf-c2aa809768e1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:20.829726 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8b981b49-799d-420f-85bf-c2aa809768e1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:20.830173 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8b981b49-799d-420f-85bf-c2aa809768e1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:20.913817 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-158bf814-83e4-42e9-a416-1634f7f4cf8d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:20.914470 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-158bf814-83e4-42e9-a416-1634f7f4cf8d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:20.920457 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-158bf814-83e4-42e9-a416-1634f7f4cf8d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:20.920867 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-158bf814-83e4-42e9-a416-1634f7f4cf8d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:20.921658 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-158bf814-83e4-42e9-a416-1634f7f4cf8d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:20.922099 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-158bf814-83e4-42e9-a416-1634f7f4cf8d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:20.951986 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-158bf814-83e4-42e9-a416-1634f7f4cf8d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042397 Mar 03 02:37:20.952550 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 645/1300] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:20 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:37:20.964704 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8b981b49-799d-420f-85bf-c2aa809768e1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:20.965790 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-cb3b17b6-7f1a-4b60-9fa4-d43c1d9f22e0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:20.966709 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-cb3b17b6-7f1a-4b60-9fa4-d43c1d9f22e0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:20.972316 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cb3b17b6-7f1a-4b60-9fa4-d43c1d9f22e0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:20.972760 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cb3b17b6-7f1a-4b60-9fa4-d43c1d9f22e0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:20.972942 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8b981b49-799d-420f-85bf-c2aa809768e1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:20.973762 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cb3b17b6-7f1a-4b60-9fa4-d43c1d9f22e0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:20.974193 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cb3b17b6-7f1a-4b60-9fa4-d43c1d9f22e0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:20.974455 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8b981b49-799d-420f-85bf-c2aa809768e1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:20.975626 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8b981b49-799d-420f-85bf-c2aa809768e1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.157755 Mar 03 02:37:20.976231 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 656/1301] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:20 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:37:21.001898 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-cb3b17b6-7f1a-4b60-9fa4-d43c1d9f22e0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039813 Mar 03 02:37:21.002453 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 646/1302] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:20 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:21.146930 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4acce657-75a5-47e8-bb8c-6c9edf0fdbec tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:21.147868 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4acce657-75a5-47e8-bb8c-6c9edf0fdbec tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:21.153679 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4acce657-75a5-47e8-bb8c-6c9edf0fdbec tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:21.154129 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4acce657-75a5-47e8-bb8c-6c9edf0fdbec tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:21.154913 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4acce657-75a5-47e8-bb8c-6c9edf0fdbec tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:21.155358 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4acce657-75a5-47e8-bb8c-6c9edf0fdbec tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:21.182674 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4acce657-75a5-47e8-bb8c-6c9edf0fdbec tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040620 Mar 03 02:37:21.183216 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 657/1303] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:21 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:21.575448 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-29c1e636-6450-4033-a700-66d1e28c22ce tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:21.576098 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-29c1e636-6450-4033-a700-66d1e28c22ce tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:21.582632 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-29c1e636-6450-4033-a700-66d1e28c22ce tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:21.583205 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-29c1e636-6450-4033-a700-66d1e28c22ce tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:21.583940 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-29c1e636-6450-4033-a700-66d1e28c22ce tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:21.584383 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-29c1e636-6450-4033-a700-66d1e28c22ce tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:21.642843 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-29c1e636-6450-4033-a700-66d1e28c22ce tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:21.650237 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-29c1e636-6450-4033-a700-66d1e28c22ce tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078654 Mar 03 02:37:21.650792 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 647/1304] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:21 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:37:21.964118 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5830611c-8fb0-49c5-a4f2-c39a973f077c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:21.964955 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5830611c-8fb0-49c5-a4f2-c39a973f077c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:21.971418 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5830611c-8fb0-49c5-a4f2-c39a973f077c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:21.971907 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5830611c-8fb0-49c5-a4f2-c39a973f077c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:21.972693 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5830611c-8fb0-49c5-a4f2-c39a973f077c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:21.973764 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5830611c-8fb0-49c5-a4f2-c39a973f077c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:21.993609 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4172a962-e560-4cf8-ad87-94cdf213aa10 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:21.994479 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4172a962-e560-4cf8-ad87-94cdf213aa10 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:22.000412 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4172a962-e560-4cf8-ad87-94cdf213aa10 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:22.000873 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4172a962-e560-4cf8-ad87-94cdf213aa10 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:22.001667 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4172a962-e560-4cf8-ad87-94cdf213aa10 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:22.002091 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5830611c-8fb0-49c5-a4f2-c39a973f077c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041999 Mar 03 02:37:22.002209 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4172a962-e560-4cf8-ad87-94cdf213aa10 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:22.002668 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 658/1305] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:21 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:22.013421 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2586ce7f-109a-4dcc-af26-75dfa9cef93b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:22.014324 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2586ce7f-109a-4dcc-af26-75dfa9cef93b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:22.019913 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2586ce7f-109a-4dcc-af26-75dfa9cef93b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:22.020879 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2586ce7f-109a-4dcc-af26-75dfa9cef93b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:22.021658 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2586ce7f-109a-4dcc-af26-75dfa9cef93b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:22.022095 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2586ce7f-109a-4dcc-af26-75dfa9cef93b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:22.050404 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2586ce7f-109a-4dcc-af26-75dfa9cef93b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040671 Mar 03 02:37:22.051341 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 659/1306] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:22 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:37:22.130207 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4172a962-e560-4cf8-ad87-94cdf213aa10 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:22.138303 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4172a962-e560-4cf8-ad87-94cdf213aa10 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:22.139845 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4172a962-e560-4cf8-ad87-94cdf213aa10 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:22.140992 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4172a962-e560-4cf8-ad87-94cdf213aa10 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.151273 Mar 03 02:37:22.141547 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 648/1307] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:21 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:37:22.194038 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f498ad23-9563-41c2-b4bd-2e6ca4f0dda0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:22.194974 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f498ad23-9563-41c2-b4bd-2e6ca4f0dda0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:22.200690 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f498ad23-9563-41c2-b4bd-2e6ca4f0dda0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:22.201136 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f498ad23-9563-41c2-b4bd-2e6ca4f0dda0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:22.201901 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f498ad23-9563-41c2-b4bd-2e6ca4f0dda0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:22.202329 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f498ad23-9563-41c2-b4bd-2e6ca4f0dda0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:22.230940 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f498ad23-9563-41c2-b4bd-2e6ca4f0dda0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040803 Mar 03 02:37:22.231419 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 660/1308] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:22 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:22.666675 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-98cfd9c9-776b-46aa-b316-ab92ec694129 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:22.667295 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-98cfd9c9-776b-46aa-b316-ab92ec694129 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:22.673551 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-98cfd9c9-776b-46aa-b316-ab92ec694129 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:22.674007 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-98cfd9c9-776b-46aa-b316-ab92ec694129 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:22.674794 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-98cfd9c9-776b-46aa-b316-ab92ec694129 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:22.675238 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-98cfd9c9-776b-46aa-b316-ab92ec694129 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:22.735783 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-98cfd9c9-776b-46aa-b316-ab92ec694129 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:22.743566 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-98cfd9c9-776b-46aa-b316-ab92ec694129 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.080748 Mar 03 02:37:22.744408 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 649/1309] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:22 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:37:23.013781 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-02cc27a6-9166-4deb-9d15-9d0c54e00035 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:23.014636 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-02cc27a6-9166-4deb-9d15-9d0c54e00035 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:23.021015 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-02cc27a6-9166-4deb-9d15-9d0c54e00035 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:23.021469 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-02cc27a6-9166-4deb-9d15-9d0c54e00035 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:23.022252 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-02cc27a6-9166-4deb-9d15-9d0c54e00035 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:23.022686 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-02cc27a6-9166-4deb-9d15-9d0c54e00035 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:23.049816 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-02cc27a6-9166-4deb-9d15-9d0c54e00035 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040097 Mar 03 02:37:23.050369 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 661/1310] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:23 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:23.061632 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-24393b6e-dad7-46ff-8b54-73246291f6f3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:23.062869 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-24393b6e-dad7-46ff-8b54-73246291f6f3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:23.069491 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-24393b6e-dad7-46ff-8b54-73246291f6f3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:23.069930 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-24393b6e-dad7-46ff-8b54-73246291f6f3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:23.070696 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-24393b6e-dad7-46ff-8b54-73246291f6f3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:23.071127 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-24393b6e-dad7-46ff-8b54-73246291f6f3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:23.097944 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-24393b6e-dad7-46ff-8b54-73246291f6f3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040249 Mar 03 02:37:23.098971 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 650/1311] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:23 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:23.159202 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-92a66bf5-3227-4e8c-bd84-bb4a2b673f54 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:23.159857 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-92a66bf5-3227-4e8c-bd84-bb4a2b673f54 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:23.166158 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-92a66bf5-3227-4e8c-bd84-bb4a2b673f54 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:23.166591 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-92a66bf5-3227-4e8c-bd84-bb4a2b673f54 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:23.167365 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-92a66bf5-3227-4e8c-bd84-bb4a2b673f54 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:23.167827 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-92a66bf5-3227-4e8c-bd84-bb4a2b673f54 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:23.242990 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a46dd010-ef97-430a-b08d-1196d603a430 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:23.243908 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a46dd010-ef97-430a-b08d-1196d603a430 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:23.249885 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a46dd010-ef97-430a-b08d-1196d603a430 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:23.250327 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a46dd010-ef97-430a-b08d-1196d603a430 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:23.251097 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a46dd010-ef97-430a-b08d-1196d603a430 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:23.251527 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a46dd010-ef97-430a-b08d-1196d603a430 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:23.279123 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a46dd010-ef97-430a-b08d-1196d603a430 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040608 Mar 03 02:37:23.279593 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 651/1312] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:23 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:37:23.297669 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-92a66bf5-3227-4e8c-bd84-bb4a2b673f54 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:23.306511 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-92a66bf5-3227-4e8c-bd84-bb4a2b673f54 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:23.308061 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-92a66bf5-3227-4e8c-bd84-bb4a2b673f54 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:23.309227 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-92a66bf5-3227-4e8c-bd84-bb4a2b673f54 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.153881 Mar 03 02:37:23.309786 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 662/1313] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:23 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:37:23.760457 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-dc524625-f57f-46fc-b88f-39b70a89f096 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:23.761059 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-dc524625-f57f-46fc-b88f-39b70a89f096 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:23.767364 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dc524625-f57f-46fc-b88f-39b70a89f096 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:23.767918 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dc524625-f57f-46fc-b88f-39b70a89f096 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:23.768694 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dc524625-f57f-46fc-b88f-39b70a89f096 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:23.769132 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dc524625-f57f-46fc-b88f-39b70a89f096 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:23.829025 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-dc524625-f57f-46fc-b88f-39b70a89f096 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:23.837143 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-dc524625-f57f-46fc-b88f-39b70a89f096 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.080544 Mar 03 02:37:23.837699 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 652/1314] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:23 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:37:24.061810 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-78574b9e-544a-481f-9b12-2cdb0e87feb3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:24.062920 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-78574b9e-544a-481f-9b12-2cdb0e87feb3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:24.070342 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-78574b9e-544a-481f-9b12-2cdb0e87feb3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:24.070790 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-78574b9e-544a-481f-9b12-2cdb0e87feb3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:24.071572 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-78574b9e-544a-481f-9b12-2cdb0e87feb3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:24.072065 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-78574b9e-544a-481f-9b12-2cdb0e87feb3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:24.101263 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-78574b9e-544a-481f-9b12-2cdb0e87feb3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043403 Mar 03 02:37:24.101818 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 663/1315] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:24 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:24.109722 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6dc513f2-ed17-4d29-9dbb-14815c48427e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:24.110623 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6dc513f2-ed17-4d29-9dbb-14815c48427e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:24.116759 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6dc513f2-ed17-4d29-9dbb-14815c48427e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:24.117207 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6dc513f2-ed17-4d29-9dbb-14815c48427e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:24.117976 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6dc513f2-ed17-4d29-9dbb-14815c48427e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:24.118405 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6dc513f2-ed17-4d29-9dbb-14815c48427e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:24.146497 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6dc513f2-ed17-4d29-9dbb-14815c48427e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040611 Mar 03 02:37:24.147022 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 653/1316] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:24 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:37:24.290519 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-25512d68-4d52-47f5-b64b-c8b2ad7cefd9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:24.291451 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-25512d68-4d52-47f5-b64b-c8b2ad7cefd9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:24.297212 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-25512d68-4d52-47f5-b64b-c8b2ad7cefd9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:24.297676 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-25512d68-4d52-47f5-b64b-c8b2ad7cefd9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:24.298430 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-25512d68-4d52-47f5-b64b-c8b2ad7cefd9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:24.298859 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-25512d68-4d52-47f5-b64b-c8b2ad7cefd9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:24.326628 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-25512d68-4d52-47f5-b64b-c8b2ad7cefd9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040045 Mar 03 02:37:24.326818 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-cb28563a-b572-4c30-a511-a0c026f1085f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:24.327173 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 664/1317] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:24 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:24.327305 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-cb28563a-b572-4c30-a511-a0c026f1085f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:24.333106 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cb28563a-b572-4c30-a511-a0c026f1085f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:24.333548 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cb28563a-b572-4c30-a511-a0c026f1085f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:24.334326 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cb28563a-b572-4c30-a511-a0c026f1085f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:24.334762 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cb28563a-b572-4c30-a511-a0c026f1085f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:24.462867 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-cb28563a-b572-4c30-a511-a0c026f1085f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:24.470819 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-cb28563a-b572-4c30-a511-a0c026f1085f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:24.472328 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-cb28563a-b572-4c30-a511-a0c026f1085f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:24.473653 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-cb28563a-b572-4c30-a511-a0c026f1085f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.150763 Mar 03 02:37:24.474129 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 654/1318] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:24 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:37:24.854260 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-cea7fb79-fe26-4c50-92de-0747fdf3c49f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:24.854858 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-cea7fb79-fe26-4c50-92de-0747fdf3c49f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:24.860733 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cea7fb79-fe26-4c50-92de-0747fdf3c49f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:24.861178 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cea7fb79-fe26-4c50-92de-0747fdf3c49f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:24.861945 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cea7fb79-fe26-4c50-92de-0747fdf3c49f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:24.862373 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cea7fb79-fe26-4c50-92de-0747fdf3c49f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:24.920144 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-cea7fb79-fe26-4c50-92de-0747fdf3c49f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:24.927860 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-cea7fb79-fe26-4c50-92de-0747fdf3c49f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.077479 Mar 03 02:37:24.928422 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 665/1319] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:24 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:37:25.113050 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3d33e696-de1c-4e9e-a57c-b2bd66641268 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:25.114301 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3d33e696-de1c-4e9e-a57c-b2bd66641268 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:25.120820 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3d33e696-de1c-4e9e-a57c-b2bd66641268 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:25.121268 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3d33e696-de1c-4e9e-a57c-b2bd66641268 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:25.122044 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3d33e696-de1c-4e9e-a57c-b2bd66641268 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:25.122479 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3d33e696-de1c-4e9e-a57c-b2bd66641268 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:25.152057 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3d33e696-de1c-4e9e-a57c-b2bd66641268 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043019 Mar 03 02:37:25.152614 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 655/1320] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:25 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:25.158025 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-288b2851-69ea-49a7-ade8-12b6496f6631 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:25.158923 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-288b2851-69ea-49a7-ade8-12b6496f6631 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:25.165854 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-288b2851-69ea-49a7-ade8-12b6496f6631 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:25.166300 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-288b2851-69ea-49a7-ade8-12b6496f6631 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:25.167074 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-288b2851-69ea-49a7-ade8-12b6496f6631 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:25.167513 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-288b2851-69ea-49a7-ade8-12b6496f6631 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:25.194621 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-288b2851-69ea-49a7-ade8-12b6496f6631 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040467 Mar 03 02:37:25.195158 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 666/1321] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:25 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:25.338624 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-de964ddd-2d97-43b8-ba60-4b89e0380846 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:25.339580 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-de964ddd-2d97-43b8-ba60-4b89e0380846 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:25.345423 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-de964ddd-2d97-43b8-ba60-4b89e0380846 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:25.345863 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-de964ddd-2d97-43b8-ba60-4b89e0380846 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:25.346628 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-de964ddd-2d97-43b8-ba60-4b89e0380846 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:25.347057 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-de964ddd-2d97-43b8-ba60-4b89e0380846 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:25.374243 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-de964ddd-2d97-43b8-ba60-4b89e0380846 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039488 Mar 03 02:37:25.374705 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 656/1322] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:25 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:25.491392 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d9e62a82-01cd-4c3b-80d4-940d210df7c0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:25.492019 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d9e62a82-01cd-4c3b-80d4-940d210df7c0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:25.498072 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d9e62a82-01cd-4c3b-80d4-940d210df7c0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:25.498521 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d9e62a82-01cd-4c3b-80d4-940d210df7c0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:25.499288 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d9e62a82-01cd-4c3b-80d4-940d210df7c0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:25.499749 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d9e62a82-01cd-4c3b-80d4-940d210df7c0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:25.635190 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d9e62a82-01cd-4c3b-80d4-940d210df7c0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:25.643189 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d9e62a82-01cd-4c3b-80d4-940d210df7c0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:25.644713 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d9e62a82-01cd-4c3b-80d4-940d210df7c0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:25.646639 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d9e62a82-01cd-4c3b-80d4-940d210df7c0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.159240 Mar 03 02:37:25.647189 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 667/1323] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:25 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:37:25.944935 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-830ddd05-d32e-4b61-ae05-a7d5c5aeae34 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:25.945459 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-830ddd05-d32e-4b61-ae05-a7d5c5aeae34 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:25.951232 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-830ddd05-d32e-4b61-ae05-a7d5c5aeae34 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:25.951708 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-830ddd05-d32e-4b61-ae05-a7d5c5aeae34 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:25.952475 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-830ddd05-d32e-4b61-ae05-a7d5c5aeae34 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:25.952906 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-830ddd05-d32e-4b61-ae05-a7d5c5aeae34 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:26.012178 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-830ddd05-d32e-4b61-ae05-a7d5c5aeae34 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:26.019442 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-830ddd05-d32e-4b61-ae05-a7d5c5aeae34 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.079017 Mar 03 02:37:26.020406 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 657/1324] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:25 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:37:26.164067 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c6c63c5e-2699-4e4f-81f4-f45c9c9b8dd5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:26.164973 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c6c63c5e-2699-4e4f-81f4-f45c9c9b8dd5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:26.171123 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c6c63c5e-2699-4e4f-81f4-f45c9c9b8dd5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:26.171562 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c6c63c5e-2699-4e4f-81f4-f45c9c9b8dd5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:26.172363 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c6c63c5e-2699-4e4f-81f4-f45c9c9b8dd5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:26.172792 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c6c63c5e-2699-4e4f-81f4-f45c9c9b8dd5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:26.200651 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c6c63c5e-2699-4e4f-81f4-f45c9c9b8dd5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041013 Mar 03 02:37:26.201278 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 668/1325] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:26 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:26.206302 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7b6631ed-20bb-4a6d-83b4-86baf690714c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:26.207213 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7b6631ed-20bb-4a6d-83b4-86baf690714c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:26.213641 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7b6631ed-20bb-4a6d-83b4-86baf690714c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:26.214087 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7b6631ed-20bb-4a6d-83b4-86baf690714c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:26.214861 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7b6631ed-20bb-4a6d-83b4-86baf690714c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:26.215292 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7b6631ed-20bb-4a6d-83b4-86baf690714c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:26.243755 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7b6631ed-20bb-4a6d-83b4-86baf690714c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041284 Mar 03 02:37:26.244559 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 658/1326] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:26 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:26.385538 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e576506c-7c89-4815-a5d2-0455619dc33d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:26.386443 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e576506c-7c89-4815-a5d2-0455619dc33d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:26.392215 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e576506c-7c89-4815-a5d2-0455619dc33d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:26.392662 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e576506c-7c89-4815-a5d2-0455619dc33d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:26.393430 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e576506c-7c89-4815-a5d2-0455619dc33d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:26.393860 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e576506c-7c89-4815-a5d2-0455619dc33d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:26.420852 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e576506c-7c89-4815-a5d2-0455619dc33d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039248 Mar 03 02:37:26.421392 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 669/1327] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:26 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:26.665316 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-cc5117c0-30e8-4941-b2ad-c4e0eb245015 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:26.665925 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-cc5117c0-30e8-4941-b2ad-c4e0eb245015 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:26.671689 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cc5117c0-30e8-4941-b2ad-c4e0eb245015 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:26.672140 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cc5117c0-30e8-4941-b2ad-c4e0eb245015 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:26.672917 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cc5117c0-30e8-4941-b2ad-c4e0eb245015 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:26.673354 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cc5117c0-30e8-4941-b2ad-c4e0eb245015 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:26.805211 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-cc5117c0-30e8-4941-b2ad-c4e0eb245015 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:26.813364 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-cc5117c0-30e8-4941-b2ad-c4e0eb245015 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:26.814859 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-cc5117c0-30e8-4941-b2ad-c4e0eb245015 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:26.816057 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-cc5117c0-30e8-4941-b2ad-c4e0eb245015 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.155249 Mar 03 02:37:26.816609 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 659/1328] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:26 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:37:27.036342 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d8d708e7-0182-4ba2-af51-55fe7bd62e28 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:27.036888 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d8d708e7-0182-4ba2-af51-55fe7bd62e28 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:27.042688 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d8d708e7-0182-4ba2-af51-55fe7bd62e28 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:27.043144 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d8d708e7-0182-4ba2-af51-55fe7bd62e28 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:27.043953 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d8d708e7-0182-4ba2-af51-55fe7bd62e28 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:27.044399 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d8d708e7-0182-4ba2-af51-55fe7bd62e28 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:27.102568 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d8d708e7-0182-4ba2-af51-55fe7bd62e28 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:27.109772 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d8d708e7-0182-4ba2-af51-55fe7bd62e28 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.077619 Mar 03 02:37:27.110324 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 670/1329] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:27 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:37:27.212509 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-712b8eb9-f525-4da8-948b-210a43402bf4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:27.213414 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-712b8eb9-f525-4da8-948b-210a43402bf4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:27.219503 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-712b8eb9-f525-4da8-948b-210a43402bf4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:27.219982 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-712b8eb9-f525-4da8-948b-210a43402bf4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:27.220754 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-712b8eb9-f525-4da8-948b-210a43402bf4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:27.221188 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-712b8eb9-f525-4da8-948b-210a43402bf4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:27.249522 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-712b8eb9-f525-4da8-948b-210a43402bf4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040998 Mar 03 02:37:27.250150 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 660/1330] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:27 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:27.256748 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-61bc3ad6-acbf-4f46-8851-d811a9de3a6c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:27.257661 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-61bc3ad6-acbf-4f46-8851-d811a9de3a6c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:27.263821 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-61bc3ad6-acbf-4f46-8851-d811a9de3a6c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:27.264269 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-61bc3ad6-acbf-4f46-8851-d811a9de3a6c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:27.265045 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-61bc3ad6-acbf-4f46-8851-d811a9de3a6c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:27.265487 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-61bc3ad6-acbf-4f46-8851-d811a9de3a6c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:27.293562 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-61bc3ad6-acbf-4f46-8851-d811a9de3a6c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041808 Mar 03 02:37:27.294050 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 671/1331] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:27 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:27.432896 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-dae41442-df43-450d-af89-c293f018537e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:27.433816 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-dae41442-df43-450d-af89-c293f018537e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:27.439892 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dae41442-df43-450d-af89-c293f018537e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:27.440339 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dae41442-df43-450d-af89-c293f018537e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:27.441108 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dae41442-df43-450d-af89-c293f018537e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:27.441537 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dae41442-df43-450d-af89-c293f018537e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:27.468598 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-dae41442-df43-450d-af89-c293f018537e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039646 Mar 03 02:37:27.469129 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 661/1332] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:27 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:27.834316 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-70976328-663c-4a52-a43d-b5ecbc131f90 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:27.834914 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-70976328-663c-4a52-a43d-b5ecbc131f90 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:27.840699 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-70976328-663c-4a52-a43d-b5ecbc131f90 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:27.841145 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-70976328-663c-4a52-a43d-b5ecbc131f90 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:27.841912 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-70976328-663c-4a52-a43d-b5ecbc131f90 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:27.842341 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-70976328-663c-4a52-a43d-b5ecbc131f90 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:27.973942 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-70976328-663c-4a52-a43d-b5ecbc131f90 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:27.982129 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-70976328-663c-4a52-a43d-b5ecbc131f90 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:27.983637 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-70976328-663c-4a52-a43d-b5ecbc131f90 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:27.984786 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-70976328-663c-4a52-a43d-b5ecbc131f90 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.154540 Mar 03 02:37:27.985339 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 672/1333] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:27 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:37:28.126266 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-96552330-fc1f-4b71-9161-d48f8ad3f710 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:28.126808 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-96552330-fc1f-4b71-9161-d48f8ad3f710 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:28.132802 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-96552330-fc1f-4b71-9161-d48f8ad3f710 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:28.133251 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-96552330-fc1f-4b71-9161-d48f8ad3f710 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:28.134029 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-96552330-fc1f-4b71-9161-d48f8ad3f710 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:28.134468 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-96552330-fc1f-4b71-9161-d48f8ad3f710 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:28.193224 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-96552330-fc1f-4b71-9161-d48f8ad3f710 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:28.200385 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-96552330-fc1f-4b71-9161-d48f8ad3f710 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078069 Mar 03 02:37:28.200946 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 662/1334] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:28 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:37:28.260823 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a5ce6cec-46c6-4d02-93ae-0712297f155e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:28.261757 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a5ce6cec-46c6-4d02-93ae-0712297f155e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:28.267937 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a5ce6cec-46c6-4d02-93ae-0712297f155e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:28.268384 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a5ce6cec-46c6-4d02-93ae-0712297f155e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:28.269156 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a5ce6cec-46c6-4d02-93ae-0712297f155e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:28.269588 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a5ce6cec-46c6-4d02-93ae-0712297f155e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:28.297488 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a5ce6cec-46c6-4d02-93ae-0712297f155e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040608 Mar 03 02:37:28.298020 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 673/1335] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:28 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:28.304867 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9a50f889-c9e7-4dc6-9792-f41b0dcf166f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:28.305765 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9a50f889-c9e7-4dc6-9792-f41b0dcf166f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:28.311918 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9a50f889-c9e7-4dc6-9792-f41b0dcf166f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:28.312364 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9a50f889-c9e7-4dc6-9792-f41b0dcf166f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:28.313134 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9a50f889-c9e7-4dc6-9792-f41b0dcf166f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:28.313565 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9a50f889-c9e7-4dc6-9792-f41b0dcf166f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:28.341668 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9a50f889-c9e7-4dc6-9792-f41b0dcf166f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040755 Mar 03 02:37:28.342206 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 663/1336] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:28 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:28.480240 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7d429c9c-fda0-4b38-8d46-c41c19d51c63 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:28.481055 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7d429c9c-fda0-4b38-8d46-c41c19d51c63 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:28.487166 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7d429c9c-fda0-4b38-8d46-c41c19d51c63 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:28.487639 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7d429c9c-fda0-4b38-8d46-c41c19d51c63 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:28.488417 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7d429c9c-fda0-4b38-8d46-c41c19d51c63 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:28.488847 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7d429c9c-fda0-4b38-8d46-c41c19d51c63 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:28.516331 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7d429c9c-fda0-4b38-8d46-c41c19d51c63 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040079 Mar 03 02:37:28.516873 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 674/1337] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:28 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:29.006744 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-55a6dcb7-6a56-478b-8e71-9f43789c247b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:29.007339 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-55a6dcb7-6a56-478b-8e71-9f43789c247b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:29.013187 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-55a6dcb7-6a56-478b-8e71-9f43789c247b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:29.013637 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-55a6dcb7-6a56-478b-8e71-9f43789c247b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:29.014412 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-55a6dcb7-6a56-478b-8e71-9f43789c247b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:29.014848 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-55a6dcb7-6a56-478b-8e71-9f43789c247b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:29.143596 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-55a6dcb7-6a56-478b-8e71-9f43789c247b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:29.152051 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-55a6dcb7-6a56-478b-8e71-9f43789c247b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:29.153543 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-55a6dcb7-6a56-478b-8e71-9f43789c247b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:29.154687 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-55a6dcb7-6a56-478b-8e71-9f43789c247b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.152645 Mar 03 02:37:29.155235 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 664/1338] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:29 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:37:29.217653 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ab5a844b-5d25-45cb-9c94-4caf653b96eb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:29.218253 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ab5a844b-5d25-45cb-9c94-4caf653b96eb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:29.224622 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ab5a844b-5d25-45cb-9c94-4caf653b96eb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:29.225093 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ab5a844b-5d25-45cb-9c94-4caf653b96eb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:29.225860 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ab5a844b-5d25-45cb-9c94-4caf653b96eb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:29.226318 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ab5a844b-5d25-45cb-9c94-4caf653b96eb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:29.290362 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ab5a844b-5d25-45cb-9c94-4caf653b96eb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:29.297635 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ab5a844b-5d25-45cb-9c94-4caf653b96eb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.083786 Mar 03 02:37:29.298197 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 675/1339] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:29 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:37:29.308371 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-69b58be0-99b2-48eb-8525-dd751c85f835 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:29.309269 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-69b58be0-99b2-48eb-8525-dd751c85f835 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:29.315873 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-69b58be0-99b2-48eb-8525-dd751c85f835 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:29.316318 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-69b58be0-99b2-48eb-8525-dd751c85f835 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:29.317131 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-69b58be0-99b2-48eb-8525-dd751c85f835 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:29.317562 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-69b58be0-99b2-48eb-8525-dd751c85f835 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:29.344435 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-69b58be0-99b2-48eb-8525-dd751c85f835 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039935 Mar 03 02:37:29.344954 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 665/1340] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:29 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:29.352905 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d26f4774-5454-4063-8543-5c5ff5fa2acd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:29.353868 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d26f4774-5454-4063-8543-5c5ff5fa2acd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:29.359864 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d26f4774-5454-4063-8543-5c5ff5fa2acd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:29.360320 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d26f4774-5454-4063-8543-5c5ff5fa2acd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:29.361108 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d26f4774-5454-4063-8543-5c5ff5fa2acd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:29.361548 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d26f4774-5454-4063-8543-5c5ff5fa2acd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:29.390415 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d26f4774-5454-4063-8543-5c5ff5fa2acd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042055 Mar 03 02:37:29.390974 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 676/1341] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:29 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:29.528436 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4ace74fc-ba35-4fc6-bc3c-cad13dc9aae8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:29.529344 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4ace74fc-ba35-4fc6-bc3c-cad13dc9aae8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:29.535061 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4ace74fc-ba35-4fc6-bc3c-cad13dc9aae8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:29.536124 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4ace74fc-ba35-4fc6-bc3c-cad13dc9aae8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:29.536907 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4ace74fc-ba35-4fc6-bc3c-cad13dc9aae8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:29.537344 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4ace74fc-ba35-4fc6-bc3c-cad13dc9aae8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:29.563836 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4ace74fc-ba35-4fc6-bc3c-cad13dc9aae8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039269 Mar 03 02:37:29.564316 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 666/1342] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:29 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:30.173081 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5ff599cf-aad5-44bd-ad12-c7485fd7bee9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:30.173691 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5ff599cf-aad5-44bd-ad12-c7485fd7bee9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:30.180606 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5ff599cf-aad5-44bd-ad12-c7485fd7bee9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:30.181054 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5ff599cf-aad5-44bd-ad12-c7485fd7bee9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:30.181827 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5ff599cf-aad5-44bd-ad12-c7485fd7bee9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:30.182265 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5ff599cf-aad5-44bd-ad12-c7485fd7bee9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:30.311961 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5ff599cf-aad5-44bd-ad12-c7485fd7bee9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:30.314691 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-722599c3-916d-4023-b41e-4a447a4ee9ce tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:30.315294 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-722599c3-916d-4023-b41e-4a447a4ee9ce tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:30.320879 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5ff599cf-aad5-44bd-ad12-c7485fd7bee9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:30.321618 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-722599c3-916d-4023-b41e-4a447a4ee9ce tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:30.322084 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-722599c3-916d-4023-b41e-4a447a4ee9ce tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:30.322460 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5ff599cf-aad5-44bd-ad12-c7485fd7bee9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:30.322913 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-722599c3-916d-4023-b41e-4a447a4ee9ce tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:30.323346 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-722599c3-916d-4023-b41e-4a447a4ee9ce tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:30.323646 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5ff599cf-aad5-44bd-ad12-c7485fd7bee9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.154463 Mar 03 02:37:30.324211 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 677/1343] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:30 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:37:30.356425 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-47e18de9-df9e-4d9a-b6b0-d1001d1ca5a2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:30.357338 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-47e18de9-df9e-4d9a-b6b0-d1001d1ca5a2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:30.363237 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-47e18de9-df9e-4d9a-b6b0-d1001d1ca5a2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:30.364224 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-47e18de9-df9e-4d9a-b6b0-d1001d1ca5a2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:30.365027 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-47e18de9-df9e-4d9a-b6b0-d1001d1ca5a2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:30.365467 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-47e18de9-df9e-4d9a-b6b0-d1001d1ca5a2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:30.384892 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-722599c3-916d-4023-b41e-4a447a4ee9ce tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:30.392191 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-722599c3-916d-4023-b41e-4a447a4ee9ce tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.081234 Mar 03 02:37:30.392754 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 667/1344] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:30 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:37:30.395724 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-47e18de9-df9e-4d9a-b6b0-d1001d1ca5a2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043358 Mar 03 02:37:30.396418 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 678/1345] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:30 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:37:30.401796 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ddf43d1d-0699-4fc0-9391-3d778577e99f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:30.402701 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ddf43d1d-0699-4fc0-9391-3d778577e99f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:30.408530 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ddf43d1d-0699-4fc0-9391-3d778577e99f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:30.408980 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ddf43d1d-0699-4fc0-9391-3d778577e99f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:30.409754 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ddf43d1d-0699-4fc0-9391-3d778577e99f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:30.410183 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ddf43d1d-0699-4fc0-9391-3d778577e99f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:30.437639 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ddf43d1d-0699-4fc0-9391-3d778577e99f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039656 Mar 03 02:37:30.438175 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 668/1346] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:30 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:37:30.575586 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-61309c6d-f189-4869-974e-c510b8292c55 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:30.576522 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-61309c6d-f189-4869-974e-c510b8292c55 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:30.582810 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-61309c6d-f189-4869-974e-c510b8292c55 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:30.583267 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-61309c6d-f189-4869-974e-c510b8292c55 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:30.584096 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-61309c6d-f189-4869-974e-c510b8292c55 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:30.584532 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-61309c6d-f189-4869-974e-c510b8292c55 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:30.611815 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-61309c6d-f189-4869-974e-c510b8292c55 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040155 Mar 03 02:37:30.612359 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 679/1347] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:30 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:31.341401 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-440174e7-f75f-4eee-bccc-dbed7cd0b7e9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:31.342043 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-440174e7-f75f-4eee-bccc-dbed7cd0b7e9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:31.348452 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-440174e7-f75f-4eee-bccc-dbed7cd0b7e9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:31.348884 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-440174e7-f75f-4eee-bccc-dbed7cd0b7e9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:31.349775 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-440174e7-f75f-4eee-bccc-dbed7cd0b7e9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:31.350207 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-440174e7-f75f-4eee-bccc-dbed7cd0b7e9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:31.407194 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1c328c04-4a52-404e-b7f7-8944bd8985e0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:31.408269 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1c328c04-4a52-404e-b7f7-8944bd8985e0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:31.415432 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1c328c04-4a52-404e-b7f7-8944bd8985e0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:31.416046 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1c328c04-4a52-404e-b7f7-8944bd8985e0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:31.416957 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1c328c04-4a52-404e-b7f7-8944bd8985e0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:31.417473 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1c328c04-4a52-404e-b7f7-8944bd8985e0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:31.448555 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1c328c04-4a52-404e-b7f7-8944bd8985e0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045873 Mar 03 02:37:31.449090 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 680/1348] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:31 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:31.453850 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4891fca4-cee8-4bf9-b394-5228f53b0c8b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:31.454578 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4891fca4-cee8-4bf9-b394-5228f53b0c8b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:31.461426 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4891fca4-cee8-4bf9-b394-5228f53b0c8b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:31.461873 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4891fca4-cee8-4bf9-b394-5228f53b0c8b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:31.462957 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4891fca4-cee8-4bf9-b394-5228f53b0c8b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:31.463398 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4891fca4-cee8-4bf9-b394-5228f53b0c8b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:31.495354 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-440174e7-f75f-4eee-bccc-dbed7cd0b7e9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:31.504080 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-440174e7-f75f-4eee-bccc-dbed7cd0b7e9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:31.506228 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-440174e7-f75f-4eee-bccc-dbed7cd0b7e9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:31.507394 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-440174e7-f75f-4eee-bccc-dbed7cd0b7e9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.169897 Mar 03 02:37:31.507985 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 669/1349] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:31 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:37:31.512462 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-fea86bf0-c18d-41c0-af89-4f8443ee13f6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:31.513349 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-fea86bf0-c18d-41c0-af89-4f8443ee13f6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:31.518967 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fea86bf0-c18d-41c0-af89-4f8443ee13f6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:31.519406 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fea86bf0-c18d-41c0-af89-4f8443ee13f6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:31.520965 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fea86bf0-c18d-41c0-af89-4f8443ee13f6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:31.521398 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fea86bf0-c18d-41c0-af89-4f8443ee13f6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:31.526641 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4891fca4-cee8-4bf9-b394-5228f53b0c8b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:31.533930 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4891fca4-cee8-4bf9-b394-5228f53b0c8b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.083912 Mar 03 02:37:31.534488 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 681/1350] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:31 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:37:31.549181 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-fea86bf0-c18d-41c0-af89-4f8443ee13f6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040191 Mar 03 02:37:31.549722 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 670/1351] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:31 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:31.624145 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9e57618c-6cc4-49e9-a60b-16db82f5d344 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:31.625008 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9e57618c-6cc4-49e9-a60b-16db82f5d344 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:31.631371 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9e57618c-6cc4-49e9-a60b-16db82f5d344 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:31.631854 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9e57618c-6cc4-49e9-a60b-16db82f5d344 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:31.632609 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9e57618c-6cc4-49e9-a60b-16db82f5d344 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:31.633042 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9e57618c-6cc4-49e9-a60b-16db82f5d344 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:31.661098 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9e57618c-6cc4-49e9-a60b-16db82f5d344 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040888 Mar 03 02:37:31.661638 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 682/1352] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:31 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:32.460602 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-622f1fde-ba66-4cc6-93eb-5a503bae8b1e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:32.461511 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-622f1fde-ba66-4cc6-93eb-5a503bae8b1e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:32.467745 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-622f1fde-ba66-4cc6-93eb-5a503bae8b1e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:32.468202 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-622f1fde-ba66-4cc6-93eb-5a503bae8b1e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:32.468990 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-622f1fde-ba66-4cc6-93eb-5a503bae8b1e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:32.469431 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-622f1fde-ba66-4cc6-93eb-5a503bae8b1e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:32.502609 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-622f1fde-ba66-4cc6-93eb-5a503bae8b1e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046634 Mar 03 02:37:32.503165 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 671/1353] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:32 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:32.525760 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9bd55045-e067-4d34-ad06-b9eff93d3c30 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:32.526364 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9bd55045-e067-4d34-ad06-b9eff93d3c30 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:32.532554 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9bd55045-e067-4d34-ad06-b9eff93d3c30 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:32.532994 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9bd55045-e067-4d34-ad06-b9eff93d3c30 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:32.533759 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9bd55045-e067-4d34-ad06-b9eff93d3c30 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:32.534189 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9bd55045-e067-4d34-ad06-b9eff93d3c30 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:32.549989 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ab9eae07-9504-4752-8d0b-c44a3ab9c99b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:32.550599 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ab9eae07-9504-4752-8d0b-c44a3ab9c99b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:32.556598 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ab9eae07-9504-4752-8d0b-c44a3ab9c99b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:32.557051 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ab9eae07-9504-4752-8d0b-c44a3ab9c99b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:32.557839 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ab9eae07-9504-4752-8d0b-c44a3ab9c99b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:32.558282 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ab9eae07-9504-4752-8d0b-c44a3ab9c99b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:32.616991 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ab9eae07-9504-4752-8d0b-c44a3ab9c99b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:32.624499 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ab9eae07-9504-4752-8d0b-c44a3ab9c99b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078295 Mar 03 02:37:32.625296 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 672/1354] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:32 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:37:32.629501 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-bcb652ed-014c-4306-abd9-d772e3efcc14 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:32.630428 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-bcb652ed-014c-4306-abd9-d772e3efcc14 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:32.635016 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 02:37:32.635198 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: Thu Mar 3 02:37:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 (ip 10.222.0.30) !!! Mar 03 02:37:32.637260 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bcb652ed-014c-4306-abd9-d772e3efcc14 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:32.638005 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bcb652ed-014c-4306-abd9-d772e3efcc14 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:32.639427 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bcb652ed-014c-4306-abd9-d772e3efcc14 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:32.641096 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bcb652ed-014c-4306-abd9-d772e3efcc14 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:32.670209 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-bcb652ed-014c-4306-abd9-d772e3efcc14 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044128 Mar 03 02:37:32.670787 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 673/1355] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:32 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:32.671015 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9bd55045-e067-4d34-ad06-b9eff93d3c30 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:32.675295 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7af04181-be0e-4a41-94a0-0c806e3ccdff tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:32.676286 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7af04181-be0e-4a41-94a0-0c806e3ccdff tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:32.679701 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9bd55045-e067-4d34-ad06-b9eff93d3c30 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:32.681199 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9bd55045-e067-4d34-ad06-b9eff93d3c30 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:32.681787 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7af04181-be0e-4a41-94a0-0c806e3ccdff tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:32.682245 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7af04181-be0e-4a41-94a0-0c806e3ccdff tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:32.682357 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9bd55045-e067-4d34-ad06-b9eff93d3c30 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.160424 Mar 03 02:37:32.682870 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 683/1356] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:32 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:37:32.683029 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7af04181-be0e-4a41-94a0-0c806e3ccdff tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:32.683471 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7af04181-be0e-4a41-94a0-0c806e3ccdff tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:32.711857 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7af04181-be0e-4a41-94a0-0c806e3ccdff tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039967 Mar 03 02:37:32.712330 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 674/1357] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:32 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:33.513823 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5c9e9737-0ff6-43e9-b0c1-b5f3acf1574b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:33.514768 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5c9e9737-0ff6-43e9-b0c1-b5f3acf1574b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:33.521195 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5c9e9737-0ff6-43e9-b0c1-b5f3acf1574b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:33.521644 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5c9e9737-0ff6-43e9-b0c1-b5f3acf1574b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:33.522423 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5c9e9737-0ff6-43e9-b0c1-b5f3acf1574b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:33.522857 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5c9e9737-0ff6-43e9-b0c1-b5f3acf1574b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:33.552639 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5c9e9737-0ff6-43e9-b0c1-b5f3acf1574b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042770 Mar 03 02:37:33.553224 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 684/1358] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:33 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:33.641065 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d7708999-74aa-42bc-92ed-190e1101ad00 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:33.641594 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d7708999-74aa-42bc-92ed-190e1101ad00 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:33.648844 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d7708999-74aa-42bc-92ed-190e1101ad00 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:33.649290 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d7708999-74aa-42bc-92ed-190e1101ad00 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:33.650066 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d7708999-74aa-42bc-92ed-190e1101ad00 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:33.650493 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d7708999-74aa-42bc-92ed-190e1101ad00 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:33.685319 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-947f5a49-c1bf-4238-8a95-20e0106a0a7d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:33.686832 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-947f5a49-c1bf-4238-8a95-20e0106a0a7d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:33.695184 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-947f5a49-c1bf-4238-8a95-20e0106a0a7d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:33.695663 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-947f5a49-c1bf-4238-8a95-20e0106a0a7d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:33.696558 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-947f5a49-c1bf-4238-8a95-20e0106a0a7d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:33.696998 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-947f5a49-c1bf-4238-8a95-20e0106a0a7d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:33.718421 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d7708999-74aa-42bc-92ed-190e1101ad00 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:33.725804 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d7708999-74aa-42bc-92ed-190e1101ad00 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.088609 Mar 03 02:37:33.726192 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-947f5a49-c1bf-4238-8a95-20e0106a0a7d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048015 Mar 03 02:37:33.726370 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 675/1359] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:33 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:37:33.729871 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 685/1360] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:33 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:33.730790 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-17a25a10-ad09-4e11-bda1-ab28930d31d9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:33.731373 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7c4e2691-7268-46d8-92d6-1f1e2b4d8d74 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:33.731494 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-17a25a10-ad09-4e11-bda1-ab28930d31d9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:33.732325 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7c4e2691-7268-46d8-92d6-1f1e2b4d8d74 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:33.737528 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-17a25a10-ad09-4e11-bda1-ab28930d31d9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:33.737931 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7c4e2691-7268-46d8-92d6-1f1e2b4d8d74 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:33.738065 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-17a25a10-ad09-4e11-bda1-ab28930d31d9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:33.738380 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7c4e2691-7268-46d8-92d6-1f1e2b4d8d74 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:33.738792 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-17a25a10-ad09-4e11-bda1-ab28930d31d9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:33.739165 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7c4e2691-7268-46d8-92d6-1f1e2b4d8d74 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:33.739289 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-17a25a10-ad09-4e11-bda1-ab28930d31d9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:33.739727 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7c4e2691-7268-46d8-92d6-1f1e2b4d8d74 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:33.771304 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7c4e2691-7268-46d8-92d6-1f1e2b4d8d74 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043465 Mar 03 02:37:33.771906 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 686/1361] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:33 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:33.875658 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-17a25a10-ad09-4e11-bda1-ab28930d31d9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:33.884462 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-17a25a10-ad09-4e11-bda1-ab28930d31d9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:33.885981 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-17a25a10-ad09-4e11-bda1-ab28930d31d9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:33.887162 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-17a25a10-ad09-4e11-bda1-ab28930d31d9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.159856 Mar 03 02:37:33.887747 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 676/1362] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:33 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:37:34.564206 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ed57f078-787e-4bb3-ab0d-924cb38f69e2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:34.565145 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ed57f078-787e-4bb3-ab0d-924cb38f69e2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:34.571526 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ed57f078-787e-4bb3-ab0d-924cb38f69e2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:34.572016 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ed57f078-787e-4bb3-ab0d-924cb38f69e2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:34.572802 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ed57f078-787e-4bb3-ab0d-924cb38f69e2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:34.573242 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ed57f078-787e-4bb3-ab0d-924cb38f69e2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:34.601260 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ed57f078-787e-4bb3-ab0d-924cb38f69e2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041040 Mar 03 02:37:34.601817 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 687/1363] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:34 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:34.737067 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a7eca26b-225a-4131-a7e5-3e39361eabf4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:34.737971 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a7eca26b-225a-4131-a7e5-3e39361eabf4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:34.742432 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a5b03703-208d-4c25-b736-f12dc9ccb46e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:34.743068 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a5b03703-208d-4c25-b736-f12dc9ccb46e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:34.744651 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a7eca26b-225a-4131-a7e5-3e39361eabf4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:34.745095 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a7eca26b-225a-4131-a7e5-3e39361eabf4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:34.745874 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a7eca26b-225a-4131-a7e5-3e39361eabf4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:34.746306 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a7eca26b-225a-4131-a7e5-3e39361eabf4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:34.749070 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a5b03703-208d-4c25-b736-f12dc9ccb46e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:34.749517 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a5b03703-208d-4c25-b736-f12dc9ccb46e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:34.750318 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a5b03703-208d-4c25-b736-f12dc9ccb46e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:34.750753 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a5b03703-208d-4c25-b736-f12dc9ccb46e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:34.777486 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a7eca26b-225a-4131-a7e5-3e39361eabf4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044346 Mar 03 02:37:34.778048 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 677/1364] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:34 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:34.782538 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9fe1a53d-8095-401e-a370-a9a82069dd70 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:34.783429 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9fe1a53d-8095-401e-a370-a9a82069dd70 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:34.790311 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9fe1a53d-8095-401e-a370-a9a82069dd70 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:34.790765 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9fe1a53d-8095-401e-a370-a9a82069dd70 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:34.791547 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9fe1a53d-8095-401e-a370-a9a82069dd70 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:34.792012 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9fe1a53d-8095-401e-a370-a9a82069dd70 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:34.810708 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a5b03703-208d-4c25-b736-f12dc9ccb46e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:34.820739 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a5b03703-208d-4c25-b736-f12dc9ccb46e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.081564 Mar 03 02:37:34.820848 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 688/1365] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:34 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:37:34.826127 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9fe1a53d-8095-401e-a370-a9a82069dd70 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047066 Mar 03 02:37:34.826681 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 678/1366] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:34 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:34.905902 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-14a0c245-af90-4d7e-9653-7fbfbf10a1ce tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:34.906496 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-14a0c245-af90-4d7e-9653-7fbfbf10a1ce tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:34.913051 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-14a0c245-af90-4d7e-9653-7fbfbf10a1ce tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:34.913500 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-14a0c245-af90-4d7e-9653-7fbfbf10a1ce tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:34.914269 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-14a0c245-af90-4d7e-9653-7fbfbf10a1ce tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:34.914700 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-14a0c245-af90-4d7e-9653-7fbfbf10a1ce tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:35.042849 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-14a0c245-af90-4d7e-9653-7fbfbf10a1ce tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:35.051201 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-14a0c245-af90-4d7e-9653-7fbfbf10a1ce tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:35.052795 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-14a0c245-af90-4d7e-9653-7fbfbf10a1ce tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:35.053876 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-14a0c245-af90-4d7e-9653-7fbfbf10a1ce tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.151884 Mar 03 02:37:35.054427 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 689/1367] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:34 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:37:35.612469 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-63e6cf0d-3013-4e83-98b3-7340a5195ac4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:35.613888 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-63e6cf0d-3013-4e83-98b3-7340a5195ac4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:35.620311 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-63e6cf0d-3013-4e83-98b3-7340a5195ac4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:35.620774 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-63e6cf0d-3013-4e83-98b3-7340a5195ac4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:35.621529 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-63e6cf0d-3013-4e83-98b3-7340a5195ac4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:35.621963 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-63e6cf0d-3013-4e83-98b3-7340a5195ac4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:35.649910 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-63e6cf0d-3013-4e83-98b3-7340a5195ac4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041343 Mar 03 02:37:35.650381 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 679/1368] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:35 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:35.787943 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0d1a34c4-9397-463a-b603-d913deb7435d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:35.788849 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0d1a34c4-9397-463a-b603-d913deb7435d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:35.795001 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0d1a34c4-9397-463a-b603-d913deb7435d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:35.795446 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0d1a34c4-9397-463a-b603-d913deb7435d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:35.796261 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0d1a34c4-9397-463a-b603-d913deb7435d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:35.796699 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0d1a34c4-9397-463a-b603-d913deb7435d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:35.824853 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0d1a34c4-9397-463a-b603-d913deb7435d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041036 Mar 03 02:37:35.825392 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 690/1369] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:35 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:35.836814 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e900e02f-7244-40a9-b6dd-1b52a667d3aa tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:35.836996 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-379fdc7a-7e19-4dc3-876b-b243185b02cc tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:35.837442 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-379fdc7a-7e19-4dc3-876b-b243185b02cc tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:35.837698 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e900e02f-7244-40a9-b6dd-1b52a667d3aa tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:35.843266 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e900e02f-7244-40a9-b6dd-1b52a667d3aa tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:35.843538 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-379fdc7a-7e19-4dc3-876b-b243185b02cc tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:35.843736 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e900e02f-7244-40a9-b6dd-1b52a667d3aa tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:35.844031 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-379fdc7a-7e19-4dc3-876b-b243185b02cc tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:35.844510 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e900e02f-7244-40a9-b6dd-1b52a667d3aa tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:35.844816 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-379fdc7a-7e19-4dc3-876b-b243185b02cc tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:35.844941 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e900e02f-7244-40a9-b6dd-1b52a667d3aa tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:35.845257 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-379fdc7a-7e19-4dc3-876b-b243185b02cc tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:35.873439 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e900e02f-7244-40a9-b6dd-1b52a667d3aa tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040127 Mar 03 02:37:35.873992 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 691/1370] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:35 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:37:35.904376 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-379fdc7a-7e19-4dc3-876b-b243185b02cc tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:35.912276 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-379fdc7a-7e19-4dc3-876b-b243185b02cc tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.079352 Mar 03 02:37:35.912826 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 680/1371] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:35 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:37:36.070981 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0781dbe4-846e-4a84-88ad-e88e6a7be5c4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:36.071592 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0781dbe4-846e-4a84-88ad-e88e6a7be5c4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:36.077512 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0781dbe4-846e-4a84-88ad-e88e6a7be5c4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:36.077970 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0781dbe4-846e-4a84-88ad-e88e6a7be5c4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:36.078753 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0781dbe4-846e-4a84-88ad-e88e6a7be5c4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:36.079190 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0781dbe4-846e-4a84-88ad-e88e6a7be5c4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:36.212538 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0781dbe4-846e-4a84-88ad-e88e6a7be5c4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:36.220599 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0781dbe4-846e-4a84-88ad-e88e6a7be5c4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:36.222092 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0781dbe4-846e-4a84-88ad-e88e6a7be5c4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:36.223887 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0781dbe4-846e-4a84-88ad-e88e6a7be5c4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.156919 Mar 03 02:37:36.224440 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 692/1372] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:36 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:37:36.661751 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-79948757-c14f-4d31-9446-20c0eed52779 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:36.662658 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-79948757-c14f-4d31-9446-20c0eed52779 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:36.668493 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-79948757-c14f-4d31-9446-20c0eed52779 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:36.668943 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-79948757-c14f-4d31-9446-20c0eed52779 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:36.669721 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-79948757-c14f-4d31-9446-20c0eed52779 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:36.670160 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-79948757-c14f-4d31-9446-20c0eed52779 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:36.698293 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-79948757-c14f-4d31-9446-20c0eed52779 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041004 Mar 03 02:37:36.698831 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 681/1373] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:36 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:36.836417 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0ebe8868-8d8d-4913-9328-1192901376d2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:36.837333 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0ebe8868-8d8d-4913-9328-1192901376d2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:36.843556 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0ebe8868-8d8d-4913-9328-1192901376d2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:36.844047 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0ebe8868-8d8d-4913-9328-1192901376d2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:36.844832 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0ebe8868-8d8d-4913-9328-1192901376d2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:36.845272 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0ebe8868-8d8d-4913-9328-1192901376d2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:36.872921 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0ebe8868-8d8d-4913-9328-1192901376d2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041165 Mar 03 02:37:36.873488 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 693/1374] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:36 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:36.885395 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2ce42024-1d14-42d3-9ea4-153601140baf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:36.886296 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2ce42024-1d14-42d3-9ea4-153601140baf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:36.892487 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2ce42024-1d14-42d3-9ea4-153601140baf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:36.892929 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2ce42024-1d14-42d3-9ea4-153601140baf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:36.893701 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2ce42024-1d14-42d3-9ea4-153601140baf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:36.894131 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2ce42024-1d14-42d3-9ea4-153601140baf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:36.922313 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2ce42024-1d14-42d3-9ea4-153601140baf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040692 Mar 03 02:37:36.922995 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 682/1375] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:36 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:36.929353 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c6e55a2c-59e4-42bf-af32-45b28adf76c7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:36.929967 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c6e55a2c-59e4-42bf-af32-45b28adf76c7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:36.935877 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c6e55a2c-59e4-42bf-af32-45b28adf76c7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:36.936333 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c6e55a2c-59e4-42bf-af32-45b28adf76c7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:36.937116 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c6e55a2c-59e4-42bf-af32-45b28adf76c7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:36.937562 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c6e55a2c-59e4-42bf-af32-45b28adf76c7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:36.995385 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c6e55a2c-59e4-42bf-af32-45b28adf76c7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:37.002685 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c6e55a2c-59e4-42bf-af32-45b28adf76c7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.077778 Mar 03 02:37:37.003254 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 694/1376] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:36 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:37:37.241973 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-34f9f17e-fe87-4e1a-bacb-848aec080a62 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:37.242493 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-34f9f17e-fe87-4e1a-bacb-848aec080a62 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:37.248801 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-34f9f17e-fe87-4e1a-bacb-848aec080a62 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:37.249248 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-34f9f17e-fe87-4e1a-bacb-848aec080a62 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:37.250053 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-34f9f17e-fe87-4e1a-bacb-848aec080a62 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:37.250488 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-34f9f17e-fe87-4e1a-bacb-848aec080a62 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:37.381257 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-34f9f17e-fe87-4e1a-bacb-848aec080a62 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:37.389487 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-34f9f17e-fe87-4e1a-bacb-848aec080a62 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:37.390987 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-34f9f17e-fe87-4e1a-bacb-848aec080a62 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:37.392169 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-34f9f17e-fe87-4e1a-bacb-848aec080a62 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.154151 Mar 03 02:37:37.392728 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 683/1377] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:37 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:37:37.710962 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-06066a26-cb69-4a08-9d8d-1f27d7ce85bc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:37.711898 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-06066a26-cb69-4a08-9d8d-1f27d7ce85bc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:37.717728 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-06066a26-cb69-4a08-9d8d-1f27d7ce85bc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:37.718177 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-06066a26-cb69-4a08-9d8d-1f27d7ce85bc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:37.718957 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-06066a26-cb69-4a08-9d8d-1f27d7ce85bc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:37.719393 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-06066a26-cb69-4a08-9d8d-1f27d7ce85bc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:37.748305 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-06066a26-cb69-4a08-9d8d-1f27d7ce85bc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042023 Mar 03 02:37:37.748858 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 695/1378] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:37 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:37.884943 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7e3045f5-f368-4dd8-9f9e-64b4822209f1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:37.885846 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7e3045f5-f368-4dd8-9f9e-64b4822209f1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:37.891744 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7e3045f5-f368-4dd8-9f9e-64b4822209f1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:37.892190 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7e3045f5-f368-4dd8-9f9e-64b4822209f1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:37.892964 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7e3045f5-f368-4dd8-9f9e-64b4822209f1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:37.893395 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7e3045f5-f368-4dd8-9f9e-64b4822209f1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:37.920811 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7e3045f5-f368-4dd8-9f9e-64b4822209f1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039797 Mar 03 02:37:37.921353 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 684/1379] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:37 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:37.934116 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c2502330-9098-43ae-9890-69f6da6277e1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:37.935026 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c2502330-9098-43ae-9890-69f6da6277e1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:37.941417 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c2502330-9098-43ae-9890-69f6da6277e1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:37.943396 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c2502330-9098-43ae-9890-69f6da6277e1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:37.943396 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c2502330-9098-43ae-9890-69f6da6277e1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:37.943812 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c2502330-9098-43ae-9890-69f6da6277e1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:37.970424 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c2502330-9098-43ae-9890-69f6da6277e1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040140 Mar 03 02:37:37.970897 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 696/1380] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:37 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:38.023251 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-79b9e879-26c5-4607-b435-fe8353ae7968 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:38.023870 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-79b9e879-26c5-4607-b435-fe8353ae7968 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:38.029629 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-79b9e879-26c5-4607-b435-fe8353ae7968 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:38.030073 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-79b9e879-26c5-4607-b435-fe8353ae7968 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:38.030840 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-79b9e879-26c5-4607-b435-fe8353ae7968 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:38.031270 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-79b9e879-26c5-4607-b435-fe8353ae7968 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:38.091901 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-79b9e879-26c5-4607-b435-fe8353ae7968 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:38.099448 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-79b9e879-26c5-4607-b435-fe8353ae7968 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.080206 Mar 03 02:37:38.100035 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 685/1381] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:38 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:37:38.409889 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6e7ed1a0-b340-4e07-98c6-039d05b2b5ef tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:38.411319 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6e7ed1a0-b340-4e07-98c6-039d05b2b5ef tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:38.417057 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6e7ed1a0-b340-4e07-98c6-039d05b2b5ef tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:38.417501 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6e7ed1a0-b340-4e07-98c6-039d05b2b5ef tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:38.418271 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6e7ed1a0-b340-4e07-98c6-039d05b2b5ef tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:38.418701 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6e7ed1a0-b340-4e07-98c6-039d05b2b5ef tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:38.548102 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-6e7ed1a0-b340-4e07-98c6-039d05b2b5ef tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:38.556218 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-6e7ed1a0-b340-4e07-98c6-039d05b2b5ef tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:38.557715 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-6e7ed1a0-b340-4e07-98c6-039d05b2b5ef tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:38.558868 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6e7ed1a0-b340-4e07-98c6-039d05b2b5ef tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.152833 Mar 03 02:37:38.559408 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 697/1382] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:38 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:37:38.760091 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-32c47c32-33d1-4dde-bbce-8134925c160d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:38.761045 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-32c47c32-33d1-4dde-bbce-8134925c160d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:38.766860 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-32c47c32-33d1-4dde-bbce-8134925c160d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:38.767300 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-32c47c32-33d1-4dde-bbce-8134925c160d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:38.768123 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-32c47c32-33d1-4dde-bbce-8134925c160d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:38.768558 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-32c47c32-33d1-4dde-bbce-8134925c160d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:38.796926 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-32c47c32-33d1-4dde-bbce-8134925c160d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040878 Mar 03 02:37:38.797464 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 686/1383] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:38 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:38.932202 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-cb04ca00-a6fe-491a-8658-d8888d247eb1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:38.933140 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-cb04ca00-a6fe-491a-8658-d8888d247eb1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:38.939520 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cb04ca00-a6fe-491a-8658-d8888d247eb1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:38.940116 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cb04ca00-a6fe-491a-8658-d8888d247eb1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:38.940775 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cb04ca00-a6fe-491a-8658-d8888d247eb1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:38.941213 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cb04ca00-a6fe-491a-8658-d8888d247eb1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:38.969792 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-cb04ca00-a6fe-491a-8658-d8888d247eb1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041543 Mar 03 02:37:38.970343 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 698/1384] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:38 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:38.980812 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-28340981-b9b7-46d4-8030-4dd94adb053c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:38.981712 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-28340981-b9b7-46d4-8030-4dd94adb053c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:38.987796 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-28340981-b9b7-46d4-8030-4dd94adb053c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:38.988237 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-28340981-b9b7-46d4-8030-4dd94adb053c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:38.989036 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-28340981-b9b7-46d4-8030-4dd94adb053c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:38.989439 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-28340981-b9b7-46d4-8030-4dd94adb053c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:39.017001 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-28340981-b9b7-46d4-8030-4dd94adb053c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040007 Mar 03 02:37:39.017467 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 687/1385] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:38 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:39.116132 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-bb72e6f6-6a69-4d47-8369-9371c8807707 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:39.116748 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-bb72e6f6-6a69-4d47-8369-9371c8807707 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:39.122942 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bb72e6f6-6a69-4d47-8369-9371c8807707 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:39.123389 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bb72e6f6-6a69-4d47-8369-9371c8807707 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:39.124196 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bb72e6f6-6a69-4d47-8369-9371c8807707 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:39.124633 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bb72e6f6-6a69-4d47-8369-9371c8807707 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:39.186642 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-bb72e6f6-6a69-4d47-8369-9371c8807707 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:39.194523 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-bb72e6f6-6a69-4d47-8369-9371c8807707 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.082552 Mar 03 02:37:39.195082 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 699/1386] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:39 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:37:39.576688 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5ffd175c-0117-4884-b45a-49332d1c1059 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:39.577287 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5ffd175c-0117-4884-b45a-49332d1c1059 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:39.583173 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5ffd175c-0117-4884-b45a-49332d1c1059 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:39.583626 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5ffd175c-0117-4884-b45a-49332d1c1059 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:39.584401 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5ffd175c-0117-4884-b45a-49332d1c1059 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:39.584832 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5ffd175c-0117-4884-b45a-49332d1c1059 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:39.711960 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5ffd175c-0117-4884-b45a-49332d1c1059 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:39.719967 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5ffd175c-0117-4884-b45a-49332d1c1059 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:39.721543 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5ffd175c-0117-4884-b45a-49332d1c1059 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:39.723198 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5ffd175c-0117-4884-b45a-49332d1c1059 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.149927 Mar 03 02:37:39.724405 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 688/1387] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:39 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:37:39.808761 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-690162c9-2ea1-4b68-a7b8-c19987ab1dcb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:39.809677 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-690162c9-2ea1-4b68-a7b8-c19987ab1dcb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:39.815382 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-690162c9-2ea1-4b68-a7b8-c19987ab1dcb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:39.815870 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-690162c9-2ea1-4b68-a7b8-c19987ab1dcb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:39.817222 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-690162c9-2ea1-4b68-a7b8-c19987ab1dcb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:39.817668 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-690162c9-2ea1-4b68-a7b8-c19987ab1dcb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:39.844884 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-690162c9-2ea1-4b68-a7b8-c19987ab1dcb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040132 Mar 03 02:37:39.845430 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 700/1388] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:39 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:39.981263 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d127bb8c-78aa-4465-8032-623a2806a048 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:39.982093 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d127bb8c-78aa-4465-8032-623a2806a048 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:39.988189 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d127bb8c-78aa-4465-8032-623a2806a048 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:39.988758 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d127bb8c-78aa-4465-8032-623a2806a048 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:39.989533 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d127bb8c-78aa-4465-8032-623a2806a048 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:39.989966 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d127bb8c-78aa-4465-8032-623a2806a048 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:40.017672 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d127bb8c-78aa-4465-8032-623a2806a048 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040392 Mar 03 02:37:40.018213 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 689/1389] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:39 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:40.029268 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-11166975-dfdd-4d9a-9559-aa163b53e6ac tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:40.030169 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-11166975-dfdd-4d9a-9559-aa163b53e6ac tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:40.037100 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-11166975-dfdd-4d9a-9559-aa163b53e6ac tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:40.037556 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-11166975-dfdd-4d9a-9559-aa163b53e6ac tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:40.038340 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-11166975-dfdd-4d9a-9559-aa163b53e6ac tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:40.038786 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-11166975-dfdd-4d9a-9559-aa163b53e6ac tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:40.066443 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-11166975-dfdd-4d9a-9559-aa163b53e6ac tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041079 Mar 03 02:37:40.067077 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 701/1390] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:40 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:40.211741 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c341f831-463f-4ad5-8a79-3c125d1ac9df tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:40.212339 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c341f831-463f-4ad5-8a79-3c125d1ac9df tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:40.218034 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c341f831-463f-4ad5-8a79-3c125d1ac9df tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:40.218478 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c341f831-463f-4ad5-8a79-3c125d1ac9df tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:40.219242 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c341f831-463f-4ad5-8a79-3c125d1ac9df tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:40.219724 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c341f831-463f-4ad5-8a79-3c125d1ac9df tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:40.277285 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c341f831-463f-4ad5-8a79-3c125d1ac9df tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:40.284436 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c341f831-463f-4ad5-8a79-3c125d1ac9df tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.077019 Mar 03 02:37:40.284991 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 690/1391] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:40 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:37:40.741660 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-51882c5f-b0f1-4588-9605-50ee119b92ec tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:40.742259 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-51882c5f-b0f1-4588-9605-50ee119b92ec tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:40.748391 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-51882c5f-b0f1-4588-9605-50ee119b92ec tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:40.748838 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-51882c5f-b0f1-4588-9605-50ee119b92ec tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:40.749607 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-51882c5f-b0f1-4588-9605-50ee119b92ec tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:40.750040 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-51882c5f-b0f1-4588-9605-50ee119b92ec tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:40.857400 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d0179bf5-9f05-4460-b4d6-f892acb4888a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:40.858336 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d0179bf5-9f05-4460-b4d6-f892acb4888a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:40.864520 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d0179bf5-9f05-4460-b4d6-f892acb4888a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:40.865026 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d0179bf5-9f05-4460-b4d6-f892acb4888a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:40.865810 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d0179bf5-9f05-4460-b4d6-f892acb4888a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:40.866247 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d0179bf5-9f05-4460-b4d6-f892acb4888a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:40.880439 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-51882c5f-b0f1-4588-9605-50ee119b92ec tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:40.888577 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-51882c5f-b0f1-4588-9605-50ee119b92ec tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:40.890097 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-51882c5f-b0f1-4588-9605-50ee119b92ec tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:40.891260 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-51882c5f-b0f1-4588-9605-50ee119b92ec tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.154116 Mar 03 02:37:40.891873 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 702/1392] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:40 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:37:40.895205 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d0179bf5-9f05-4460-b4d6-f892acb4888a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041756 Mar 03 02:37:40.895760 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 691/1393] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:40 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:37:41.030445 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f5957ae6-0c4f-485a-bdbe-dd678c170b08 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:41.031283 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f5957ae6-0c4f-485a-bdbe-dd678c170b08 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:41.038042 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f5957ae6-0c4f-485a-bdbe-dd678c170b08 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:41.038494 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f5957ae6-0c4f-485a-bdbe-dd678c170b08 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:41.039279 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f5957ae6-0c4f-485a-bdbe-dd678c170b08 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:41.039742 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f5957ae6-0c4f-485a-bdbe-dd678c170b08 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:41.069422 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f5957ae6-0c4f-485a-bdbe-dd678c170b08 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042925 Mar 03 02:37:41.069985 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 703/1394] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:41 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:41.077417 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-fb69688b-9d06-4d13-ac0e-8b40fd1d937e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:41.078353 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-fb69688b-9d06-4d13-ac0e-8b40fd1d937e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:41.085211 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fb69688b-9d06-4d13-ac0e-8b40fd1d937e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:41.085661 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fb69688b-9d06-4d13-ac0e-8b40fd1d937e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:41.086431 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fb69688b-9d06-4d13-ac0e-8b40fd1d937e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:41.086865 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fb69688b-9d06-4d13-ac0e-8b40fd1d937e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:41.115421 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-fb69688b-9d06-4d13-ac0e-8b40fd1d937e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041937 Mar 03 02:37:41.115994 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 692/1395] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:41 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:41.302464 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1148b828-7b91-4c53-9b86-fcc79e459e86 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:41.302992 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1148b828-7b91-4c53-9b86-fcc79e459e86 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:41.308912 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1148b828-7b91-4c53-9b86-fcc79e459e86 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:41.309361 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1148b828-7b91-4c53-9b86-fcc79e459e86 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:41.310140 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1148b828-7b91-4c53-9b86-fcc79e459e86 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:41.310578 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1148b828-7b91-4c53-9b86-fcc79e459e86 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:41.368851 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1148b828-7b91-4c53-9b86-fcc79e459e86 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:41.376326 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1148b828-7b91-4c53-9b86-fcc79e459e86 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078396 Mar 03 02:37:41.376897 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 704/1396] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:41 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:37:41.906668 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-57d5c7f2-5558-4cd2-b3ef-f6366c37fbce tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:41.907574 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-57d5c7f2-5558-4cd2-b3ef-f6366c37fbce tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:41.909059 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-323872f8-7afa-4f03-bdb5-52d0f194cfef tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:41.909674 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-323872f8-7afa-4f03-bdb5-52d0f194cfef tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:41.913542 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-57d5c7f2-5558-4cd2-b3ef-f6366c37fbce tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:41.913982 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-57d5c7f2-5558-4cd2-b3ef-f6366c37fbce tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:41.914753 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-57d5c7f2-5558-4cd2-b3ef-f6366c37fbce tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:41.915181 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-57d5c7f2-5558-4cd2-b3ef-f6366c37fbce tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:41.915447 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-323872f8-7afa-4f03-bdb5-52d0f194cfef tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:41.915936 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-323872f8-7afa-4f03-bdb5-52d0f194cfef tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:41.916727 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-323872f8-7afa-4f03-bdb5-52d0f194cfef tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:41.917169 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-323872f8-7afa-4f03-bdb5-52d0f194cfef tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:41.942760 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-57d5c7f2-5558-4cd2-b3ef-f6366c37fbce tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040040 Mar 03 02:37:41.943320 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 693/1397] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:41 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:42.051244 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-323872f8-7afa-4f03-bdb5-52d0f194cfef tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:42.059491 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-323872f8-7afa-4f03-bdb5-52d0f194cfef tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:42.061017 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-323872f8-7afa-4f03-bdb5-52d0f194cfef tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:42.062169 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-323872f8-7afa-4f03-bdb5-52d0f194cfef tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.156928 Mar 03 02:37:42.062720 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 705/1398] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:41 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:37:42.080791 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-08dd8e87-e4ba-4bcc-943c-bab2e1b587a5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:42.081683 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-08dd8e87-e4ba-4bcc-943c-bab2e1b587a5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:42.088496 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-08dd8e87-e4ba-4bcc-943c-bab2e1b587a5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:42.088935 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-08dd8e87-e4ba-4bcc-943c-bab2e1b587a5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:42.089707 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-08dd8e87-e4ba-4bcc-943c-bab2e1b587a5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:42.090135 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-08dd8e87-e4ba-4bcc-943c-bab2e1b587a5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:42.116871 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-08dd8e87-e4ba-4bcc-943c-bab2e1b587a5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040032 Mar 03 02:37:42.117397 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 694/1399] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:42 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:42.126155 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ee9765a7-d49c-406b-ad3b-04b2aafe9c35 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:42.127067 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ee9765a7-d49c-406b-ad3b-04b2aafe9c35 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:42.133507 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ee9765a7-d49c-406b-ad3b-04b2aafe9c35 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:42.133956 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ee9765a7-d49c-406b-ad3b-04b2aafe9c35 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:42.134730 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ee9765a7-d49c-406b-ad3b-04b2aafe9c35 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:42.135169 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ee9765a7-d49c-406b-ad3b-04b2aafe9c35 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:42.162700 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ee9765a7-d49c-406b-ad3b-04b2aafe9c35 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040361 Mar 03 02:37:42.163175 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 706/1400] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:42 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:42.392787 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4cdc8cfc-ab17-4ad4-9092-8aba55823158 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:42.393392 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4cdc8cfc-ab17-4ad4-9092-8aba55823158 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:42.399557 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4cdc8cfc-ab17-4ad4-9092-8aba55823158 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:42.400037 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4cdc8cfc-ab17-4ad4-9092-8aba55823158 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:42.400810 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4cdc8cfc-ab17-4ad4-9092-8aba55823158 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:42.401247 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4cdc8cfc-ab17-4ad4-9092-8aba55823158 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:42.461746 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4cdc8cfc-ab17-4ad4-9092-8aba55823158 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:42.468917 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4cdc8cfc-ab17-4ad4-9092-8aba55823158 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.079976 Mar 03 02:37:42.469469 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 695/1401] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:42 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:37:42.954462 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0a062a75-6d89-4ba4-842a-ebc9c4239644 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:42.955423 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0a062a75-6d89-4ba4-842a-ebc9c4239644 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:42.961778 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0a062a75-6d89-4ba4-842a-ebc9c4239644 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:42.962234 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0a062a75-6d89-4ba4-842a-ebc9c4239644 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:42.963017 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0a062a75-6d89-4ba4-842a-ebc9c4239644 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:42.963454 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0a062a75-6d89-4ba4-842a-ebc9c4239644 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:42.992150 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0a062a75-6d89-4ba4-842a-ebc9c4239644 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041600 Mar 03 02:37:42.992704 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 707/1402] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:42 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:43.080652 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e9c93d2f-a025-474e-bab3-6cd6307bf220 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:43.081246 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e9c93d2f-a025-474e-bab3-6cd6307bf220 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:43.087704 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e9c93d2f-a025-474e-bab3-6cd6307bf220 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:43.088157 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e9c93d2f-a025-474e-bab3-6cd6307bf220 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:43.088927 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e9c93d2f-a025-474e-bab3-6cd6307bf220 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:43.089358 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e9c93d2f-a025-474e-bab3-6cd6307bf220 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:43.128636 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-37aa221a-7472-4ecf-b7d4-2e8502e4a1cb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:43.129544 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-37aa221a-7472-4ecf-b7d4-2e8502e4a1cb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:43.135723 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-37aa221a-7472-4ecf-b7d4-2e8502e4a1cb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:43.136166 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-37aa221a-7472-4ecf-b7d4-2e8502e4a1cb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:43.136948 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-37aa221a-7472-4ecf-b7d4-2e8502e4a1cb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:43.137380 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-37aa221a-7472-4ecf-b7d4-2e8502e4a1cb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:43.166395 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-37aa221a-7472-4ecf-b7d4-2e8502e4a1cb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041597 Mar 03 02:37:43.166953 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 708/1403] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:43 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:37:43.174997 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-82aa555e-cf48-498a-85db-0a23f62d2449 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:43.175966 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-82aa555e-cf48-498a-85db-0a23f62d2449 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:43.182050 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-82aa555e-cf48-498a-85db-0a23f62d2449 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:43.182495 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-82aa555e-cf48-498a-85db-0a23f62d2449 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:43.183273 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-82aa555e-cf48-498a-85db-0a23f62d2449 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:43.183731 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-82aa555e-cf48-498a-85db-0a23f62d2449 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:43.211732 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-82aa555e-cf48-498a-85db-0a23f62d2449 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040251 Mar 03 02:37:43.212213 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 709/1404] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:43 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:37:43.220571 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e9c93d2f-a025-474e-bab3-6cd6307bf220 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:43.229375 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e9c93d2f-a025-474e-bab3-6cd6307bf220 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:43.230872 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e9c93d2f-a025-474e-bab3-6cd6307bf220 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:43.232053 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e9c93d2f-a025-474e-bab3-6cd6307bf220 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.155293 Mar 03 02:37:43.232599 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 696/1405] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:43 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:37:43.485890 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-292e507e-56a4-47d9-a660-7cd3df97648f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:43.486498 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-292e507e-56a4-47d9-a660-7cd3df97648f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:43.492871 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-292e507e-56a4-47d9-a660-7cd3df97648f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:43.493318 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-292e507e-56a4-47d9-a660-7cd3df97648f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:43.494668 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-292e507e-56a4-47d9-a660-7cd3df97648f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:43.495110 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-292e507e-56a4-47d9-a660-7cd3df97648f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:43.555031 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-292e507e-56a4-47d9-a660-7cd3df97648f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:43.562296 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-292e507e-56a4-47d9-a660-7cd3df97648f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.080216 Mar 03 02:37:43.563088 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 710/1406] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:43 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:37:44.004819 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1fbe9597-a59b-4ebe-bf9e-92678ff96da9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:44.005738 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1fbe9597-a59b-4ebe-bf9e-92678ff96da9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:44.011628 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1fbe9597-a59b-4ebe-bf9e-92678ff96da9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:44.012084 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1fbe9597-a59b-4ebe-bf9e-92678ff96da9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:44.012863 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1fbe9597-a59b-4ebe-bf9e-92678ff96da9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:44.013302 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1fbe9597-a59b-4ebe-bf9e-92678ff96da9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:44.040222 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1fbe9597-a59b-4ebe-bf9e-92678ff96da9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040184 Mar 03 02:37:44.040770 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 697/1407] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:43 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:44.178505 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c51cf165-f899-4ff9-90e1-760264323351 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:44.179416 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c51cf165-f899-4ff9-90e1-760264323351 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:44.185696 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c51cf165-f899-4ff9-90e1-760264323351 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:44.186143 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c51cf165-f899-4ff9-90e1-760264323351 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:44.186914 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c51cf165-f899-4ff9-90e1-760264323351 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:44.187346 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c51cf165-f899-4ff9-90e1-760264323351 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:44.214512 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c51cf165-f899-4ff9-90e1-760264323351 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040705 Mar 03 02:37:44.215053 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 711/1408] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:44 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:44.222155 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-54b3b27e-8eb2-4548-8e36-bead9e7b8b9e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:44.223793 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-54b3b27e-8eb2-4548-8e36-bead9e7b8b9e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:44.229898 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-54b3b27e-8eb2-4548-8e36-bead9e7b8b9e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:44.230347 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-54b3b27e-8eb2-4548-8e36-bead9e7b8b9e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:44.231126 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-54b3b27e-8eb2-4548-8e36-bead9e7b8b9e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:44.231562 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-54b3b27e-8eb2-4548-8e36-bead9e7b8b9e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:44.250081 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3b1bebe7-9c35-4f86-a471-89b5f4cb74b7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:44.250687 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3b1bebe7-9c35-4f86-a471-89b5f4cb74b7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:44.256958 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3b1bebe7-9c35-4f86-a471-89b5f4cb74b7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:44.257408 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3b1bebe7-9c35-4f86-a471-89b5f4cb74b7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:44.258202 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3b1bebe7-9c35-4f86-a471-89b5f4cb74b7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:44.258636 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3b1bebe7-9c35-4f86-a471-89b5f4cb74b7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:44.259535 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-54b3b27e-8eb2-4548-8e36-bead9e7b8b9e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041232 Mar 03 02:37:44.260128 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 698/1409] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:44 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:44.389936 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3b1bebe7-9c35-4f86-a471-89b5f4cb74b7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:44.398081 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3b1bebe7-9c35-4f86-a471-89b5f4cb74b7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:44.399590 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3b1bebe7-9c35-4f86-a471-89b5f4cb74b7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:44.400772 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3b1bebe7-9c35-4f86-a471-89b5f4cb74b7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.154558 Mar 03 02:37:44.401338 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 712/1410] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:44 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:37:44.579247 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9e11fb7b-53e7-44cd-94df-57b085689633 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:44.579907 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9e11fb7b-53e7-44cd-94df-57b085689633 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:44.586292 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9e11fb7b-53e7-44cd-94df-57b085689633 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:44.586736 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9e11fb7b-53e7-44cd-94df-57b085689633 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:44.587502 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9e11fb7b-53e7-44cd-94df-57b085689633 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:44.587956 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9e11fb7b-53e7-44cd-94df-57b085689633 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:44.646021 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9e11fb7b-53e7-44cd-94df-57b085689633 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:44.653142 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9e11fb7b-53e7-44cd-94df-57b085689633 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.077816 Mar 03 02:37:44.653688 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 699/1411] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:44 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:37:45.051880 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4421d1cc-aa20-4436-a16d-2d80425be069 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:45.052715 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4421d1cc-aa20-4436-a16d-2d80425be069 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:45.058881 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4421d1cc-aa20-4436-a16d-2d80425be069 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:45.059345 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4421d1cc-aa20-4436-a16d-2d80425be069 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:45.060198 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4421d1cc-aa20-4436-a16d-2d80425be069 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:45.060637 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4421d1cc-aa20-4436-a16d-2d80425be069 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:45.090123 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4421d1cc-aa20-4436-a16d-2d80425be069 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042351 Mar 03 02:37:45.090678 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 713/1412] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:45 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:45.225823 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-53ebe597-c4f3-45b7-bfe3-d4520b2390ff tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:45.226767 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-53ebe597-c4f3-45b7-bfe3-d4520b2390ff tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:45.233118 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-53ebe597-c4f3-45b7-bfe3-d4520b2390ff tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:45.233571 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-53ebe597-c4f3-45b7-bfe3-d4520b2390ff tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:45.234356 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-53ebe597-c4f3-45b7-bfe3-d4520b2390ff tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:45.234790 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-53ebe597-c4f3-45b7-bfe3-d4520b2390ff tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:45.263360 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-53ebe597-c4f3-45b7-bfe3-d4520b2390ff tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041471 Mar 03 02:37:45.263936 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 700/1413] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:45 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:45.270615 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8a6c7ca0-b937-4223-86b9-d5c9a1a41641 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:45.271593 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8a6c7ca0-b937-4223-86b9-d5c9a1a41641 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:45.277830 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8a6c7ca0-b937-4223-86b9-d5c9a1a41641 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:45.278283 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8a6c7ca0-b937-4223-86b9-d5c9a1a41641 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:45.279067 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8a6c7ca0-b937-4223-86b9-d5c9a1a41641 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:45.279509 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8a6c7ca0-b937-4223-86b9-d5c9a1a41641 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:45.307100 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8a6c7ca0-b937-4223-86b9-d5c9a1a41641 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040559 Mar 03 02:37:45.307580 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 714/1414] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:45 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:45.419342 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-aa64a57a-1c34-4f34-b2d4-1449a5a02442 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:45.419971 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-aa64a57a-1c34-4f34-b2d4-1449a5a02442 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:45.425883 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aa64a57a-1c34-4f34-b2d4-1449a5a02442 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:45.426310 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aa64a57a-1c34-4f34-b2d4-1449a5a02442 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:45.427115 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aa64a57a-1c34-4f34-b2d4-1449a5a02442 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:45.427551 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aa64a57a-1c34-4f34-b2d4-1449a5a02442 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:45.564080 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-aa64a57a-1c34-4f34-b2d4-1449a5a02442 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:45.572867 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-aa64a57a-1c34-4f34-b2d4-1449a5a02442 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:45.574365 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-aa64a57a-1c34-4f34-b2d4-1449a5a02442 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:45.575548 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-aa64a57a-1c34-4f34-b2d4-1449a5a02442 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.160066 Mar 03 02:37:45.576123 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 701/1415] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:45 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:37:45.670132 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c666765e-604b-4787-9f48-0b6366aff95e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:45.670772 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c666765e-604b-4787-9f48-0b6366aff95e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:45.676611 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c666765e-604b-4787-9f48-0b6366aff95e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:45.677059 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c666765e-604b-4787-9f48-0b6366aff95e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:45.677835 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c666765e-604b-4787-9f48-0b6366aff95e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:45.678270 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c666765e-604b-4787-9f48-0b6366aff95e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:45.740069 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c666765e-604b-4787-9f48-0b6366aff95e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:45.747745 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c666765e-604b-4787-9f48-0b6366aff95e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.081457 Mar 03 02:37:45.748310 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 715/1416] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:45 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:37:46.101360 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-367c18eb-6230-47a0-aa5e-4d1234feb525 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:46.102272 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-367c18eb-6230-47a0-aa5e-4d1234feb525 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:46.108143 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-367c18eb-6230-47a0-aa5e-4d1234feb525 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:46.108598 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-367c18eb-6230-47a0-aa5e-4d1234feb525 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:46.109383 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-367c18eb-6230-47a0-aa5e-4d1234feb525 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:46.109824 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-367c18eb-6230-47a0-aa5e-4d1234feb525 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:46.138402 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-367c18eb-6230-47a0-aa5e-4d1234feb525 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041182 Mar 03 02:37:46.138938 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 702/1417] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:46 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:46.273999 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1bec828e-0ec2-4656-a10e-3a0bcfddf790 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:46.274899 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1bec828e-0ec2-4656-a10e-3a0bcfddf790 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:46.281998 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1bec828e-0ec2-4656-a10e-3a0bcfddf790 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:46.282448 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1bec828e-0ec2-4656-a10e-3a0bcfddf790 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:46.283231 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1bec828e-0ec2-4656-a10e-3a0bcfddf790 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:46.283685 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1bec828e-0ec2-4656-a10e-3a0bcfddf790 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:46.312314 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1bec828e-0ec2-4656-a10e-3a0bcfddf790 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042302 Mar 03 02:37:46.312792 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 716/1418] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:46 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:46.319500 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2197772f-5af0-4e52-8dbf-33e5e1eb2e96 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:46.320442 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2197772f-5af0-4e52-8dbf-33e5e1eb2e96 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:46.326538 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2197772f-5af0-4e52-8dbf-33e5e1eb2e96 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:46.326985 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2197772f-5af0-4e52-8dbf-33e5e1eb2e96 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:46.327790 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2197772f-5af0-4e52-8dbf-33e5e1eb2e96 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:46.328227 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2197772f-5af0-4e52-8dbf-33e5e1eb2e96 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:46.356241 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2197772f-5af0-4e52-8dbf-33e5e1eb2e96 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041780 Mar 03 02:37:46.356806 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 703/1419] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:46 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:37:46.594303 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c00c0c25-1f3c-41c4-b4cc-cdcd3bc57d05 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:46.594907 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c00c0c25-1f3c-41c4-b4cc-cdcd3bc57d05 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:46.601443 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c00c0c25-1f3c-41c4-b4cc-cdcd3bc57d05 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:46.601890 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c00c0c25-1f3c-41c4-b4cc-cdcd3bc57d05 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:46.602655 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c00c0c25-1f3c-41c4-b4cc-cdcd3bc57d05 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:46.603084 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c00c0c25-1f3c-41c4-b4cc-cdcd3bc57d05 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:46.733539 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c00c0c25-1f3c-41c4-b4cc-cdcd3bc57d05 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:46.741733 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c00c0c25-1f3c-41c4-b4cc-cdcd3bc57d05 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:46.743225 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c00c0c25-1f3c-41c4-b4cc-cdcd3bc57d05 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:46.744666 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c00c0c25-1f3c-41c4-b4cc-cdcd3bc57d05 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.154368 Mar 03 02:37:46.745219 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 717/1420] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:46 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:37:46.764616 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e6c69578-b2c0-4c52-9a99-98488404bc75 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:46.765221 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e6c69578-b2c0-4c52-9a99-98488404bc75 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:46.771402 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e6c69578-b2c0-4c52-9a99-98488404bc75 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:46.771879 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e6c69578-b2c0-4c52-9a99-98488404bc75 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:46.772673 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e6c69578-b2c0-4c52-9a99-98488404bc75 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:46.773101 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e6c69578-b2c0-4c52-9a99-98488404bc75 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:46.829847 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e6c69578-b2c0-4c52-9a99-98488404bc75 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:46.837634 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e6c69578-b2c0-4c52-9a99-98488404bc75 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.076819 Mar 03 02:37:46.838187 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 704/1421] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:46 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:37:47.151093 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b5bab8f9-e9df-4554-9698-46df18dba49b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:47.152025 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b5bab8f9-e9df-4554-9698-46df18dba49b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:47.157931 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b5bab8f9-e9df-4554-9698-46df18dba49b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:47.158380 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b5bab8f9-e9df-4554-9698-46df18dba49b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:47.159159 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b5bab8f9-e9df-4554-9698-46df18dba49b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:47.159615 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b5bab8f9-e9df-4554-9698-46df18dba49b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:47.187457 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b5bab8f9-e9df-4554-9698-46df18dba49b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040383 Mar 03 02:37:47.188029 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 718/1422] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:47 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:47.323774 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b9071cca-2ebb-461e-8fc5-4905bf35f659 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:47.324719 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b9071cca-2ebb-461e-8fc5-4905bf35f659 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:47.330857 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b9071cca-2ebb-461e-8fc5-4905bf35f659 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:47.331303 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b9071cca-2ebb-461e-8fc5-4905bf35f659 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:47.332942 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b9071cca-2ebb-461e-8fc5-4905bf35f659 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:47.333530 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b9071cca-2ebb-461e-8fc5-4905bf35f659 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:47.360911 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b9071cca-2ebb-461e-8fc5-4905bf35f659 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041113 Mar 03 02:37:47.362883 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 705/1423] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:47 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:47.367936 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-762ba919-b640-46f7-9e9f-462f8f69c963 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:47.368839 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-762ba919-b640-46f7-9e9f-462f8f69c963 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:47.375193 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-762ba919-b640-46f7-9e9f-462f8f69c963 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:47.375665 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-762ba919-b640-46f7-9e9f-462f8f69c963 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:47.376437 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-762ba919-b640-46f7-9e9f-462f8f69c963 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:47.376866 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-762ba919-b640-46f7-9e9f-462f8f69c963 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:47.405056 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-762ba919-b640-46f7-9e9f-462f8f69c963 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041191 Mar 03 02:37:47.405607 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 719/1424] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:47 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:37:47.762205 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f2cc2f7e-d4ab-472e-ae43-6d85189f1405 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:47.762808 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f2cc2f7e-d4ab-472e-ae43-6d85189f1405 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:47.768763 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f2cc2f7e-d4ab-472e-ae43-6d85189f1405 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:47.769215 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f2cc2f7e-d4ab-472e-ae43-6d85189f1405 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:47.770727 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f2cc2f7e-d4ab-472e-ae43-6d85189f1405 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:47.771164 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f2cc2f7e-d4ab-472e-ae43-6d85189f1405 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:47.854672 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-99f75cfc-e8db-43a1-98de-ebabff5a0f0e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:47.855305 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-99f75cfc-e8db-43a1-98de-ebabff5a0f0e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:47.861186 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-99f75cfc-e8db-43a1-98de-ebabff5a0f0e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:47.861636 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-99f75cfc-e8db-43a1-98de-ebabff5a0f0e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:47.862421 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-99f75cfc-e8db-43a1-98de-ebabff5a0f0e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:47.862860 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-99f75cfc-e8db-43a1-98de-ebabff5a0f0e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:47.902228 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f2cc2f7e-d4ab-472e-ae43-6d85189f1405 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:47.910814 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f2cc2f7e-d4ab-472e-ae43-6d85189f1405 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:47.912374 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f2cc2f7e-d4ab-472e-ae43-6d85189f1405 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:47.913563 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f2cc2f7e-d4ab-472e-ae43-6d85189f1405 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.155286 Mar 03 02:37:47.914112 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 706/1425] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:47 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:37:47.922785 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-99f75cfc-e8db-43a1-98de-ebabff5a0f0e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:47.930641 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-99f75cfc-e8db-43a1-98de-ebabff5a0f0e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.079880 Mar 03 02:37:47.931199 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 720/1426] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:47 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:37:48.198945 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ef859a63-8f41-4da4-be8e-906e7cf80316 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:48.199852 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ef859a63-8f41-4da4-be8e-906e7cf80316 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:48.205678 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ef859a63-8f41-4da4-be8e-906e7cf80316 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:48.206132 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ef859a63-8f41-4da4-be8e-906e7cf80316 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:48.207423 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ef859a63-8f41-4da4-be8e-906e7cf80316 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:48.207997 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ef859a63-8f41-4da4-be8e-906e7cf80316 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:48.236657 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ef859a63-8f41-4da4-be8e-906e7cf80316 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041748 Mar 03 02:37:48.237208 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 707/1427] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:48 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:48.374165 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-657bde97-a8bf-4357-ad6f-749d4a85f6cb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:48.375076 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-657bde97-a8bf-4357-ad6f-749d4a85f6cb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:48.381429 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-657bde97-a8bf-4357-ad6f-749d4a85f6cb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:48.381881 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-657bde97-a8bf-4357-ad6f-749d4a85f6cb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:48.382666 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-657bde97-a8bf-4357-ad6f-749d4a85f6cb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:48.383104 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-657bde97-a8bf-4357-ad6f-749d4a85f6cb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:48.411362 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-657bde97-a8bf-4357-ad6f-749d4a85f6cb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041113 Mar 03 02:37:48.412036 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 721/1428] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:48 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:48.417266 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9fff76b4-7153-4d57-a032-8fe62b14f50e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:48.418169 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9fff76b4-7153-4d57-a032-8fe62b14f50e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:48.424301 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9fff76b4-7153-4d57-a032-8fe62b14f50e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:48.424743 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9fff76b4-7153-4d57-a032-8fe62b14f50e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:48.425509 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9fff76b4-7153-4d57-a032-8fe62b14f50e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:48.426099 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9fff76b4-7153-4d57-a032-8fe62b14f50e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:48.452875 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9fff76b4-7153-4d57-a032-8fe62b14f50e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039476 Mar 03 02:37:48.453343 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 708/1429] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:48 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:48.931948 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9744a12a-53c2-4dab-acc1-5488143b9084 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:48.932573 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9744a12a-53c2-4dab-acc1-5488143b9084 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:48.938407 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9744a12a-53c2-4dab-acc1-5488143b9084 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:48.938865 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9744a12a-53c2-4dab-acc1-5488143b9084 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:48.939670 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9744a12a-53c2-4dab-acc1-5488143b9084 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:48.940126 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9744a12a-53c2-4dab-acc1-5488143b9084 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:48.946696 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-78edb277-730d-4326-af4f-37e97f465f3a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:48.947451 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-78edb277-730d-4326-af4f-37e97f465f3a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:48.953661 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-78edb277-730d-4326-af4f-37e97f465f3a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:48.954111 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-78edb277-730d-4326-af4f-37e97f465f3a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:48.954884 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-78edb277-730d-4326-af4f-37e97f465f3a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:48.955315 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-78edb277-730d-4326-af4f-37e97f465f3a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:49.018162 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-78edb277-730d-4326-af4f-37e97f465f3a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:49.025984 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-78edb277-730d-4326-af4f-37e97f465f3a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.083096 Mar 03 02:37:49.026549 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 709/1430] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:48 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:37:49.077542 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9744a12a-53c2-4dab-acc1-5488143b9084 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:49.086337 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9744a12a-53c2-4dab-acc1-5488143b9084 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:49.087873 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9744a12a-53c2-4dab-acc1-5488143b9084 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:49.089025 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9744a12a-53c2-4dab-acc1-5488143b9084 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.161088 Mar 03 02:37:49.089572 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 722/1431] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:48 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:37:49.248978 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-55e2add8-af93-430f-add1-02e081313cd0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:49.249970 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-55e2add8-af93-430f-add1-02e081313cd0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:49.256614 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-55e2add8-af93-430f-add1-02e081313cd0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:49.257069 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-55e2add8-af93-430f-add1-02e081313cd0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:49.257855 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-55e2add8-af93-430f-add1-02e081313cd0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:49.258296 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-55e2add8-af93-430f-add1-02e081313cd0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:49.289707 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-55e2add8-af93-430f-add1-02e081313cd0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044693 Mar 03 02:37:49.290281 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 710/1432] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:49 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:49.422541 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-bc57518e-922a-4719-a0e1-f6f2e5ab0da1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:49.423449 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-bc57518e-922a-4719-a0e1-f6f2e5ab0da1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:49.429754 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bc57518e-922a-4719-a0e1-f6f2e5ab0da1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:49.430190 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bc57518e-922a-4719-a0e1-f6f2e5ab0da1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:49.430958 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bc57518e-922a-4719-a0e1-f6f2e5ab0da1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:49.431387 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bc57518e-922a-4719-a0e1-f6f2e5ab0da1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:49.459908 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-bc57518e-922a-4719-a0e1-f6f2e5ab0da1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041284 Mar 03 02:37:49.460636 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 723/1433] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:49 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:49.464375 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4e058e7a-1515-4cb4-81ba-c2273320fb00 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:49.465289 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4e058e7a-1515-4cb4-81ba-c2273320fb00 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:49.471436 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4e058e7a-1515-4cb4-81ba-c2273320fb00 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:49.471926 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4e058e7a-1515-4cb4-81ba-c2273320fb00 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:49.472918 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4e058e7a-1515-4cb4-81ba-c2273320fb00 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:49.473436 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4e058e7a-1515-4cb4-81ba-c2273320fb00 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:49.501211 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4e058e7a-1515-4cb4-81ba-c2273320fb00 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040715 Mar 03 02:37:49.501693 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 711/1434] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:49 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:37:50.043027 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-71413874-8f8d-4fb1-bb13-090072c1aeca tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:50.043653 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-71413874-8f8d-4fb1-bb13-090072c1aeca tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:50.049916 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-71413874-8f8d-4fb1-bb13-090072c1aeca tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:50.050378 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-71413874-8f8d-4fb1-bb13-090072c1aeca tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:50.051817 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-71413874-8f8d-4fb1-bb13-090072c1aeca tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:50.052263 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-71413874-8f8d-4fb1-bb13-090072c1aeca tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:50.107159 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7132fa9b-d39c-4006-92f4-4932759dd8fa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:50.107785 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7132fa9b-d39c-4006-92f4-4932759dd8fa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:50.111219 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-71413874-8f8d-4fb1-bb13-090072c1aeca tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:50.114281 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7132fa9b-d39c-4006-92f4-4932759dd8fa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:50.114726 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7132fa9b-d39c-4006-92f4-4932759dd8fa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:50.115507 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7132fa9b-d39c-4006-92f4-4932759dd8fa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:50.115964 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7132fa9b-d39c-4006-92f4-4932759dd8fa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:50.119521 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-71413874-8f8d-4fb1-bb13-090072c1aeca tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.080264 Mar 03 02:37:50.120123 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 724/1435] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:50 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:37:50.245054 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-7132fa9b-d39c-4006-92f4-4932759dd8fa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:50.253034 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-7132fa9b-d39c-4006-92f4-4932759dd8fa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:50.254646 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-7132fa9b-d39c-4006-92f4-4932759dd8fa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:50.255834 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7132fa9b-d39c-4006-92f4-4932759dd8fa tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.152633 Mar 03 02:37:50.256385 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 712/1436] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:50 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:37:50.301908 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e9acaf3c-b6d2-4f15-860e-1d8afe223483 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:50.302798 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e9acaf3c-b6d2-4f15-860e-1d8afe223483 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:50.308504 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e9acaf3c-b6d2-4f15-860e-1d8afe223483 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:50.308949 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e9acaf3c-b6d2-4f15-860e-1d8afe223483 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:50.309719 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e9acaf3c-b6d2-4f15-860e-1d8afe223483 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:50.310152 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e9acaf3c-b6d2-4f15-860e-1d8afe223483 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:50.338162 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e9acaf3c-b6d2-4f15-860e-1d8afe223483 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040975 Mar 03 02:37:50.338720 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 725/1437] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:50 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:50.471582 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c758e745-7b85-4560-b81a-68a0bb180e10 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:50.473071 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c758e745-7b85-4560-b81a-68a0bb180e10 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:50.479219 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c758e745-7b85-4560-b81a-68a0bb180e10 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:50.479710 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c758e745-7b85-4560-b81a-68a0bb180e10 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:50.480488 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c758e745-7b85-4560-b81a-68a0bb180e10 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:50.480921 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c758e745-7b85-4560-b81a-68a0bb180e10 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:50.507817 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c758e745-7b85-4560-b81a-68a0bb180e10 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040215 Mar 03 02:37:50.508362 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 713/1438] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:50 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:50.512393 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c4bca276-b62d-4eb0-80b1-fded0e5049c2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:50.513326 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c4bca276-b62d-4eb0-80b1-fded0e5049c2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:50.519982 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c4bca276-b62d-4eb0-80b1-fded0e5049c2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:50.520544 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c4bca276-b62d-4eb0-80b1-fded0e5049c2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:50.521315 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c4bca276-b62d-4eb0-80b1-fded0e5049c2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:50.521744 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c4bca276-b62d-4eb0-80b1-fded0e5049c2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:50.548752 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c4bca276-b62d-4eb0-80b1-fded0e5049c2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040262 Mar 03 02:37:50.549299 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 726/1439] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:50 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:37:51.136039 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-97f2d386-76c9-49b3-98a6-974e3e461cff tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:51.136651 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-97f2d386-76c9-49b3-98a6-974e3e461cff tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:51.142492 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-97f2d386-76c9-49b3-98a6-974e3e461cff tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:51.142943 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-97f2d386-76c9-49b3-98a6-974e3e461cff tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:51.143746 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-97f2d386-76c9-49b3-98a6-974e3e461cff tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:51.144191 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-97f2d386-76c9-49b3-98a6-974e3e461cff tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:51.202758 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-97f2d386-76c9-49b3-98a6-974e3e461cff tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:51.210608 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-97f2d386-76c9-49b3-98a6-974e3e461cff tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078438 Mar 03 02:37:51.211164 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 714/1440] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:51 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:37:51.273876 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-fd179a2a-5fef-4197-9486-9cc6102a914b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:51.274474 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-fd179a2a-5fef-4197-9486-9cc6102a914b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:51.280257 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fd179a2a-5fef-4197-9486-9cc6102a914b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:51.280702 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fd179a2a-5fef-4197-9486-9cc6102a914b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:51.281471 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fd179a2a-5fef-4197-9486-9cc6102a914b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:51.281900 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fd179a2a-5fef-4197-9486-9cc6102a914b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:51.349687 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f41347db-6ae5-4b34-8b61-c40e2ce69e90 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:51.350607 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f41347db-6ae5-4b34-8b61-c40e2ce69e90 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:51.356335 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f41347db-6ae5-4b34-8b61-c40e2ce69e90 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:51.356786 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f41347db-6ae5-4b34-8b61-c40e2ce69e90 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:51.357576 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f41347db-6ae5-4b34-8b61-c40e2ce69e90 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:51.358011 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f41347db-6ae5-4b34-8b61-c40e2ce69e90 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:51.387474 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f41347db-6ae5-4b34-8b61-c40e2ce69e90 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041740 Mar 03 02:37:51.388070 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 715/1441] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:51 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:37:51.413332 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-fd179a2a-5fef-4197-9486-9cc6102a914b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:51.421393 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-fd179a2a-5fef-4197-9486-9cc6102a914b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:51.422873 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-fd179a2a-5fef-4197-9486-9cc6102a914b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:51.424040 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-fd179a2a-5fef-4197-9486-9cc6102a914b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.154184 Mar 03 02:37:51.424596 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 727/1442] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:51 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:37:51.518939 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-92f2d6fd-a417-4cc0-b669-fa987bcebeb1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:51.519901 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-92f2d6fd-a417-4cc0-b669-fa987bcebeb1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:51.526071 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-92f2d6fd-a417-4cc0-b669-fa987bcebeb1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:51.526512 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-92f2d6fd-a417-4cc0-b669-fa987bcebeb1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:51.527292 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-92f2d6fd-a417-4cc0-b669-fa987bcebeb1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:51.527765 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-92f2d6fd-a417-4cc0-b669-fa987bcebeb1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:51.556361 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-92f2d6fd-a417-4cc0-b669-fa987bcebeb1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041238 Mar 03 02:37:51.556921 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 716/1443] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:51 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:51.560084 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-38a89186-5951-4d28-b349-bed9a8476d6f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:51.560996 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-38a89186-5951-4d28-b349-bed9a8476d6f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:51.567095 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-38a89186-5951-4d28-b349-bed9a8476d6f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:51.567674 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-38a89186-5951-4d28-b349-bed9a8476d6f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:51.568489 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-38a89186-5951-4d28-b349-bed9a8476d6f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:51.568928 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-38a89186-5951-4d28-b349-bed9a8476d6f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:51.596169 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-38a89186-5951-4d28-b349-bed9a8476d6f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040271 Mar 03 02:37:51.596719 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 728/1444] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:51 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:37:52.227121 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-92b91250-c635-4ab0-a1bd-c5e6d06bedd1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:52.227745 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-92b91250-c635-4ab0-a1bd-c5e6d06bedd1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:52.233543 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-92b91250-c635-4ab0-a1bd-c5e6d06bedd1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:52.233992 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-92b91250-c635-4ab0-a1bd-c5e6d06bedd1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:52.234766 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-92b91250-c635-4ab0-a1bd-c5e6d06bedd1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:52.235198 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-92b91250-c635-4ab0-a1bd-c5e6d06bedd1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:52.293237 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-92b91250-c635-4ab0-a1bd-c5e6d06bedd1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:52.300421 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-92b91250-c635-4ab0-a1bd-c5e6d06bedd1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.077953 Mar 03 02:37:52.300989 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 717/1445] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:52 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:37:52.399501 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b263dd39-a07c-41b0-bcd4-17059882fe0a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:52.400461 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b263dd39-a07c-41b0-bcd4-17059882fe0a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:52.406303 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b263dd39-a07c-41b0-bcd4-17059882fe0a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:52.406785 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b263dd39-a07c-41b0-bcd4-17059882fe0a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:52.407554 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b263dd39-a07c-41b0-bcd4-17059882fe0a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:52.408009 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b263dd39-a07c-41b0-bcd4-17059882fe0a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:52.434778 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b263dd39-a07c-41b0-bcd4-17059882fe0a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039923 Mar 03 02:37:52.435316 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 729/1446] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:52 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:52.442747 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0ed4cb0e-4a43-4797-af26-422472322083 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:52.443355 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0ed4cb0e-4a43-4797-af26-422472322083 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:52.449340 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0ed4cb0e-4a43-4797-af26-422472322083 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:52.449786 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0ed4cb0e-4a43-4797-af26-422472322083 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:52.450580 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0ed4cb0e-4a43-4797-af26-422472322083 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:52.451016 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0ed4cb0e-4a43-4797-af26-422472322083 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:52.568464 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7ee6afdf-4174-4a98-be2b-c2f8f278fed7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:52.569521 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7ee6afdf-4174-4a98-be2b-c2f8f278fed7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:52.575812 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7ee6afdf-4174-4a98-be2b-c2f8f278fed7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:52.576331 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7ee6afdf-4174-4a98-be2b-c2f8f278fed7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:52.577116 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7ee6afdf-4174-4a98-be2b-c2f8f278fed7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:52.577543 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7ee6afdf-4174-4a98-be2b-c2f8f278fed7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:52.589642 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0ed4cb0e-4a43-4797-af26-422472322083 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:52.597888 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0ed4cb0e-4a43-4797-af26-422472322083 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:52.599533 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0ed4cb0e-4a43-4797-af26-422472322083 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:52.600793 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0ed4cb0e-4a43-4797-af26-422472322083 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.162427 Mar 03 02:37:52.601364 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 718/1447] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:52 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:37:52.607210 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7ee6afdf-4174-4a98-be2b-c2f8f278fed7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043358 Mar 03 02:37:52.607807 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 730/1448] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:52 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:37:52.613949 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2115fdf6-4a5a-43ac-8d9a-d3b91ad57a01 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:52.615057 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2115fdf6-4a5a-43ac-8d9a-d3b91ad57a01 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:52.621101 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2115fdf6-4a5a-43ac-8d9a-d3b91ad57a01 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:52.621555 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2115fdf6-4a5a-43ac-8d9a-d3b91ad57a01 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:52.622333 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2115fdf6-4a5a-43ac-8d9a-d3b91ad57a01 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:52.622775 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2115fdf6-4a5a-43ac-8d9a-d3b91ad57a01 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:52.650805 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2115fdf6-4a5a-43ac-8d9a-d3b91ad57a01 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046047 Mar 03 02:37:52.651285 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 719/1449] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:52 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:53.317196 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-be6aac2e-37e0-478c-a8c8-8b4c4234ea4c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:53.317728 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-be6aac2e-37e0-478c-a8c8-8b4c4234ea4c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:53.323531 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-be6aac2e-37e0-478c-a8c8-8b4c4234ea4c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:53.324002 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-be6aac2e-37e0-478c-a8c8-8b4c4234ea4c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:53.324772 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-be6aac2e-37e0-478c-a8c8-8b4c4234ea4c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:53.325205 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-be6aac2e-37e0-478c-a8c8-8b4c4234ea4c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:53.383973 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-be6aac2e-37e0-478c-a8c8-8b4c4234ea4c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:53.391630 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-be6aac2e-37e0-478c-a8c8-8b4c4234ea4c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078033 Mar 03 02:37:53.392312 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 731/1450] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:53 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:37:53.446462 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-17677494-03d1-475c-ba2d-00596da6c5f4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:53.447393 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-17677494-03d1-475c-ba2d-00596da6c5f4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:53.453563 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-17677494-03d1-475c-ba2d-00596da6c5f4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:53.454005 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-17677494-03d1-475c-ba2d-00596da6c5f4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:53.454772 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-17677494-03d1-475c-ba2d-00596da6c5f4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:53.455205 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-17677494-03d1-475c-ba2d-00596da6c5f4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:53.483276 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-17677494-03d1-475c-ba2d-00596da6c5f4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040910 Mar 03 02:37:53.483830 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 720/1451] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:53 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:53.618024 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4c712a8c-1bfe-4532-9ae2-61f049c67787 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:53.618579 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0b4a13cc-ac4e-4c5f-9d9e-5eff58c8b1bd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:53.619230 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0b4a13cc-ac4e-4c5f-9d9e-5eff58c8b1bd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:53.619325 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4c712a8c-1bfe-4532-9ae2-61f049c67787 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:53.624832 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0b4a13cc-ac4e-4c5f-9d9e-5eff58c8b1bd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:53.625285 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0b4a13cc-ac4e-4c5f-9d9e-5eff58c8b1bd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:53.625406 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4c712a8c-1bfe-4532-9ae2-61f049c67787 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:53.625852 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4c712a8c-1bfe-4532-9ae2-61f049c67787 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:53.626076 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0b4a13cc-ac4e-4c5f-9d9e-5eff58c8b1bd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:53.626515 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0b4a13cc-ac4e-4c5f-9d9e-5eff58c8b1bd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:53.626622 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4c712a8c-1bfe-4532-9ae2-61f049c67787 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:53.627050 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4c712a8c-1bfe-4532-9ae2-61f049c67787 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:53.655359 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4c712a8c-1bfe-4532-9ae2-61f049c67787 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041308 Mar 03 02:37:53.656157 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 732/1452] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:53 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:53.662869 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-228b6eb0-1fba-4a5a-b8cf-35fa6bc2cce4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:53.663807 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-228b6eb0-1fba-4a5a-b8cf-35fa6bc2cce4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:53.669574 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-228b6eb0-1fba-4a5a-b8cf-35fa6bc2cce4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:53.670029 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-228b6eb0-1fba-4a5a-b8cf-35fa6bc2cce4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:53.670825 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-228b6eb0-1fba-4a5a-b8cf-35fa6bc2cce4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:53.671263 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-228b6eb0-1fba-4a5a-b8cf-35fa6bc2cce4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:53.699572 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-228b6eb0-1fba-4a5a-b8cf-35fa6bc2cce4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041281 Mar 03 02:37:53.703535 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 733/1453] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:53 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:37:53.756848 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0b4a13cc-ac4e-4c5f-9d9e-5eff58c8b1bd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:53.764934 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0b4a13cc-ac4e-4c5f-9d9e-5eff58c8b1bd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:53.766412 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0b4a13cc-ac4e-4c5f-9d9e-5eff58c8b1bd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:53.767545 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0b4a13cc-ac4e-4c5f-9d9e-5eff58c8b1bd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.153405 Mar 03 02:37:53.768169 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 721/1454] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:53 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:37:54.408644 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ef05cecb-b2a9-448c-9fea-a6390447612e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:54.409284 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ef05cecb-b2a9-448c-9fea-a6390447612e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:54.415717 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ef05cecb-b2a9-448c-9fea-a6390447612e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:54.416173 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ef05cecb-b2a9-448c-9fea-a6390447612e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:54.416954 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ef05cecb-b2a9-448c-9fea-a6390447612e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:54.417397 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ef05cecb-b2a9-448c-9fea-a6390447612e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:54.479230 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ef05cecb-b2a9-448c-9fea-a6390447612e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:54.486517 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ef05cecb-b2a9-448c-9fea-a6390447612e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.081796 Mar 03 02:37:54.487078 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 734/1455] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:54 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:37:54.495333 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-83fb1820-a6d3-447c-ab13-c85bd7a0ea41 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:54.496282 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-83fb1820-a6d3-447c-ab13-c85bd7a0ea41 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:54.502414 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-83fb1820-a6d3-447c-ab13-c85bd7a0ea41 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:54.502860 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-83fb1820-a6d3-447c-ab13-c85bd7a0ea41 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:54.503658 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-83fb1820-a6d3-447c-ab13-c85bd7a0ea41 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:54.504096 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-83fb1820-a6d3-447c-ab13-c85bd7a0ea41 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:54.531449 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-83fb1820-a6d3-447c-ab13-c85bd7a0ea41 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040313 Mar 03 02:37:54.532012 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 722/1456] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:54 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:54.668095 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0472ec7a-1810-4733-8c73-c3f2a23f1193 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:54.668916 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0472ec7a-1810-4733-8c73-c3f2a23f1193 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:54.675013 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0472ec7a-1810-4733-8c73-c3f2a23f1193 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:54.675456 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0472ec7a-1810-4733-8c73-c3f2a23f1193 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:54.676263 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0472ec7a-1810-4733-8c73-c3f2a23f1193 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:54.677472 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0472ec7a-1810-4733-8c73-c3f2a23f1193 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:54.704599 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0472ec7a-1810-4733-8c73-c3f2a23f1193 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040591 Mar 03 02:37:54.705242 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 735/1457] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:54 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:54.710868 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d1a5e6fb-4450-4d7c-918a-949134f6e76d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:54.711815 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d1a5e6fb-4450-4d7c-918a-949134f6e76d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:54.717505 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d1a5e6fb-4450-4d7c-918a-949134f6e76d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:54.717954 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d1a5e6fb-4450-4d7c-918a-949134f6e76d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:54.718728 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d1a5e6fb-4450-4d7c-918a-949134f6e76d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:54.719162 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d1a5e6fb-4450-4d7c-918a-949134f6e76d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:54.747481 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d1a5e6fb-4450-4d7c-918a-949134f6e76d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040747 Mar 03 02:37:54.748050 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 723/1458] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:54 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:54.786532 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e86c7eed-8ebe-4650-91e0-055f006bb6db tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:54.787127 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e86c7eed-8ebe-4650-91e0-055f006bb6db tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:54.793030 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e86c7eed-8ebe-4650-91e0-055f006bb6db tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:54.793477 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e86c7eed-8ebe-4650-91e0-055f006bb6db tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:54.794245 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e86c7eed-8ebe-4650-91e0-055f006bb6db tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:54.794676 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e86c7eed-8ebe-4650-91e0-055f006bb6db tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:54.922492 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e86c7eed-8ebe-4650-91e0-055f006bb6db tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:54.931188 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e86c7eed-8ebe-4650-91e0-055f006bb6db tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:54.932712 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e86c7eed-8ebe-4650-91e0-055f006bb6db tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:54.933864 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e86c7eed-8ebe-4650-91e0-055f006bb6db tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.151682 Mar 03 02:37:54.934427 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 736/1459] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:54 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:37:55.504125 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c6736a68-258d-4252-bc50-4c73311c01d7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:55.505231 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c6736a68-258d-4252-bc50-4c73311c01d7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:55.511396 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c6736a68-258d-4252-bc50-4c73311c01d7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:55.511889 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c6736a68-258d-4252-bc50-4c73311c01d7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:55.512669 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c6736a68-258d-4252-bc50-4c73311c01d7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:55.513107 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c6736a68-258d-4252-bc50-4c73311c01d7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:55.542400 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-549fdbe5-e7c7-4027-958e-7bbb9e2f252b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:55.543314 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-549fdbe5-e7c7-4027-958e-7bbb9e2f252b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:55.551218 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-549fdbe5-e7c7-4027-958e-7bbb9e2f252b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:55.551810 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-549fdbe5-e7c7-4027-958e-7bbb9e2f252b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:55.552898 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-549fdbe5-e7c7-4027-958e-7bbb9e2f252b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:55.553341 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-549fdbe5-e7c7-4027-958e-7bbb9e2f252b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:55.570814 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c6736a68-258d-4252-bc50-4c73311c01d7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:55.578051 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c6736a68-258d-4252-bc50-4c73311c01d7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.077793 Mar 03 02:37:55.578609 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 724/1460] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:55 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:37:55.582424 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-549fdbe5-e7c7-4027-958e-7bbb9e2f252b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044049 Mar 03 02:37:55.583939 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 737/1461] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:55 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:37:55.715874 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5b40a9e0-f5c0-43ef-9ae1-04bb40c6ad8c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:55.716716 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5b40a9e0-f5c0-43ef-9ae1-04bb40c6ad8c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:55.722475 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5b40a9e0-f5c0-43ef-9ae1-04bb40c6ad8c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:55.722923 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5b40a9e0-f5c0-43ef-9ae1-04bb40c6ad8c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:55.724014 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5b40a9e0-f5c0-43ef-9ae1-04bb40c6ad8c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:55.724451 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5b40a9e0-f5c0-43ef-9ae1-04bb40c6ad8c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:55.752354 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5b40a9e0-f5c0-43ef-9ae1-04bb40c6ad8c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040447 Mar 03 02:37:55.752886 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 725/1462] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:55 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:55.759226 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-bfd67d9d-b65e-4db0-a4db-e71e612dac5b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:55.760183 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-bfd67d9d-b65e-4db0-a4db-e71e612dac5b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:55.766341 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bfd67d9d-b65e-4db0-a4db-e71e612dac5b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:55.766788 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bfd67d9d-b65e-4db0-a4db-e71e612dac5b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:55.767554 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bfd67d9d-b65e-4db0-a4db-e71e612dac5b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:55.768014 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bfd67d9d-b65e-4db0-a4db-e71e612dac5b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:55.795226 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-bfd67d9d-b65e-4db0-a4db-e71e612dac5b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040753 Mar 03 02:37:55.795830 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 738/1463] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:55 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:55.952188 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6d3e3d06-d82f-4211-8737-23a2b267f781 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:55.952797 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6d3e3d06-d82f-4211-8737-23a2b267f781 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:55.958593 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6d3e3d06-d82f-4211-8737-23a2b267f781 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:55.959044 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6d3e3d06-d82f-4211-8737-23a2b267f781 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:55.959855 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6d3e3d06-d82f-4211-8737-23a2b267f781 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:55.960299 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6d3e3d06-d82f-4211-8737-23a2b267f781 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:56.099631 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6d3e3d06-d82f-4211-8737-23a2b267f781 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:56.107702 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6d3e3d06-d82f-4211-8737-23a2b267f781 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:56.109197 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6d3e3d06-d82f-4211-8737-23a2b267f781 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:56.110342 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6d3e3d06-d82f-4211-8737-23a2b267f781 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.162085 Mar 03 02:37:56.110890 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 726/1464] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:55 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:37:56.594641 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5a5d70f6-162b-4567-adbc-2314a1cd9823 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:56.595217 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4828c2be-48fb-4262-8e07-cce15c7d7e32 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:56.595863 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4828c2be-48fb-4262-8e07-cce15c7d7e32 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:56.596122 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5a5d70f6-162b-4567-adbc-2314a1cd9823 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:56.602666 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4828c2be-48fb-4262-8e07-cce15c7d7e32 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:56.603125 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4828c2be-48fb-4262-8e07-cce15c7d7e32 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:56.603283 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5a5d70f6-162b-4567-adbc-2314a1cd9823 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:56.603691 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5a5d70f6-162b-4567-adbc-2314a1cd9823 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:56.603943 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4828c2be-48fb-4262-8e07-cce15c7d7e32 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:56.604380 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4828c2be-48fb-4262-8e07-cce15c7d7e32 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:56.604500 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5a5d70f6-162b-4567-adbc-2314a1cd9823 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:56.604899 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5a5d70f6-162b-4567-adbc-2314a1cd9823 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:56.633432 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5a5d70f6-162b-4567-adbc-2314a1cd9823 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042746 Mar 03 02:37:56.634016 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 739/1465] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:56 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:56.664750 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4828c2be-48fb-4262-8e07-cce15c7d7e32 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:56.672003 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4828c2be-48fb-4262-8e07-cce15c7d7e32 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.080661 Mar 03 02:37:56.672560 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 727/1466] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:56 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:37:56.764774 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-322c62ac-c444-4d96-9dfa-5136ca959ad1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:56.765675 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-322c62ac-c444-4d96-9dfa-5136ca959ad1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:56.772633 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-322c62ac-c444-4d96-9dfa-5136ca959ad1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:56.773085 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-322c62ac-c444-4d96-9dfa-5136ca959ad1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:56.773867 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-322c62ac-c444-4d96-9dfa-5136ca959ad1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:56.774301 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-322c62ac-c444-4d96-9dfa-5136ca959ad1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:56.802295 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-322c62ac-c444-4d96-9dfa-5136ca959ad1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041306 Mar 03 02:37:56.802853 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 740/1467] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:56 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:56.806494 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-478a3ef7-adeb-4102-a68c-9dbe6865c270 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:56.807426 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-478a3ef7-adeb-4102-a68c-9dbe6865c270 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:56.813173 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-478a3ef7-adeb-4102-a68c-9dbe6865c270 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:56.813620 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-478a3ef7-adeb-4102-a68c-9dbe6865c270 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:56.814391 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-478a3ef7-adeb-4102-a68c-9dbe6865c270 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:56.814816 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-478a3ef7-adeb-4102-a68c-9dbe6865c270 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:56.842187 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-478a3ef7-adeb-4102-a68c-9dbe6865c270 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039621 Mar 03 02:37:56.842722 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 728/1468] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:56 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:37:57.130191 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-afe0b3df-b651-4871-93ca-df6fd87e1925 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:57.130795 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-afe0b3df-b651-4871-93ca-df6fd87e1925 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:57.136859 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-afe0b3df-b651-4871-93ca-df6fd87e1925 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:57.137304 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-afe0b3df-b651-4871-93ca-df6fd87e1925 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:57.138078 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-afe0b3df-b651-4871-93ca-df6fd87e1925 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:57.138510 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-afe0b3df-b651-4871-93ca-df6fd87e1925 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:57.268374 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-afe0b3df-b651-4871-93ca-df6fd87e1925 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:57.276625 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-afe0b3df-b651-4871-93ca-df6fd87e1925 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:57.278114 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-afe0b3df-b651-4871-93ca-df6fd87e1925 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:57.279256 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-afe0b3df-b651-4871-93ca-df6fd87e1925 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.153571 Mar 03 02:37:57.279849 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 741/1469] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:57 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:37:57.643988 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a4b44ab8-bbf0-4157-807d-8c321656332f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:57.644939 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a4b44ab8-bbf0-4157-807d-8c321656332f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:57.651588 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a4b44ab8-bbf0-4157-807d-8c321656332f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:57.652066 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a4b44ab8-bbf0-4157-807d-8c321656332f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:57.652848 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a4b44ab8-bbf0-4157-807d-8c321656332f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:57.653284 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a4b44ab8-bbf0-4157-807d-8c321656332f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:57.682056 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a4b44ab8-bbf0-4157-807d-8c321656332f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042066 Mar 03 02:37:57.682606 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 729/1470] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:57 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:57.688316 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-33a70596-5d4d-49cd-8864-6f8cfd3f7525 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:57.688928 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-33a70596-5d4d-49cd-8864-6f8cfd3f7525 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:57.694730 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-33a70596-5d4d-49cd-8864-6f8cfd3f7525 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:57.695182 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-33a70596-5d4d-49cd-8864-6f8cfd3f7525 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:57.695991 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-33a70596-5d4d-49cd-8864-6f8cfd3f7525 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:57.696433 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-33a70596-5d4d-49cd-8864-6f8cfd3f7525 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:57.757641 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-33a70596-5d4d-49cd-8864-6f8cfd3f7525 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:57.764912 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-33a70596-5d4d-49cd-8864-6f8cfd3f7525 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.080453 Mar 03 02:37:57.765507 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 742/1471] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:57 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:37:57.813643 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8281eade-52c6-4bfb-bda1-ea2626948c96 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:57.814549 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8281eade-52c6-4bfb-bda1-ea2626948c96 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:57.821121 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8281eade-52c6-4bfb-bda1-ea2626948c96 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:57.821568 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8281eade-52c6-4bfb-bda1-ea2626948c96 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:57.822377 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8281eade-52c6-4bfb-bda1-ea2626948c96 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:57.822809 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8281eade-52c6-4bfb-bda1-ea2626948c96 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:57.850665 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8281eade-52c6-4bfb-bda1-ea2626948c96 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040992 Mar 03 02:37:57.851214 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 730/1472] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:57 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:57.853724 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-075e504d-89df-4afd-9df6-bf5ef88792de tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:57.854636 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-075e504d-89df-4afd-9df6-bf5ef88792de tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:57.861006 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-075e504d-89df-4afd-9df6-bf5ef88792de tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:57.861457 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-075e504d-89df-4afd-9df6-bf5ef88792de tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:57.862232 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-075e504d-89df-4afd-9df6-bf5ef88792de tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:57.862665 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-075e504d-89df-4afd-9df6-bf5ef88792de tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:57.891130 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-075e504d-89df-4afd-9df6-bf5ef88792de tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041747 Mar 03 02:37:57.891691 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 743/1473] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:57 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:37:58.297634 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1ef1c155-1847-45bd-b859-a4621e488268 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:58.298242 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1ef1c155-1847-45bd-b859-a4621e488268 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:58.304228 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1ef1c155-1847-45bd-b859-a4621e488268 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:58.304629 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1ef1c155-1847-45bd-b859-a4621e488268 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:58.305409 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1ef1c155-1847-45bd-b859-a4621e488268 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:58.305850 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1ef1c155-1847-45bd-b859-a4621e488268 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:58.438194 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1ef1c155-1847-45bd-b859-a4621e488268 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:58.447092 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1ef1c155-1847-45bd-b859-a4621e488268 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:58.448663 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1ef1c155-1847-45bd-b859-a4621e488268 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:58.449817 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1ef1c155-1847-45bd-b859-a4621e488268 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.156487 Mar 03 02:37:58.450371 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 731/1474] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:58 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:37:58.694291 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-560bf909-0014-4982-8725-b3fae36e3de9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:58.695194 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-560bf909-0014-4982-8725-b3fae36e3de9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:58.701395 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-560bf909-0014-4982-8725-b3fae36e3de9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:58.701844 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-560bf909-0014-4982-8725-b3fae36e3de9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:58.702615 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-560bf909-0014-4982-8725-b3fae36e3de9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:58.703047 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-560bf909-0014-4982-8725-b3fae36e3de9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:58.730727 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-560bf909-0014-4982-8725-b3fae36e3de9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041146 Mar 03 02:37:58.731264 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 744/1475] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:58 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:58.781814 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4539d336-bc99-47f4-b27a-946efd776ed8 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:58.782419 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4539d336-bc99-47f4-b27a-946efd776ed8 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:58.788720 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4539d336-bc99-47f4-b27a-946efd776ed8 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:58.789170 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4539d336-bc99-47f4-b27a-946efd776ed8 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:58.789982 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4539d336-bc99-47f4-b27a-946efd776ed8 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:58.790424 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4539d336-bc99-47f4-b27a-946efd776ed8 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:58.848342 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4539d336-bc99-47f4-b27a-946efd776ed8 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:58.855447 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4539d336-bc99-47f4-b27a-946efd776ed8 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.077470 Mar 03 02:37:58.856039 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 732/1476] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:58 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:37:58.862070 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-848cf51e-120b-4b99-9132-fc1ef300fbf2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:58.863091 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-848cf51e-120b-4b99-9132-fc1ef300fbf2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:58.870385 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-848cf51e-120b-4b99-9132-fc1ef300fbf2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:58.870935 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-848cf51e-120b-4b99-9132-fc1ef300fbf2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:58.871761 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-848cf51e-120b-4b99-9132-fc1ef300fbf2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:58.872199 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-848cf51e-120b-4b99-9132-fc1ef300fbf2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:58.901015 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-848cf51e-120b-4b99-9132-fc1ef300fbf2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042743 Mar 03 02:37:58.901573 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 745/1477] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:58 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:58.902422 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-20826115-6959-48fc-b8b8-4c506bcc7f16 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:58.903318 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-20826115-6959-48fc-b8b8-4c506bcc7f16 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:58.908998 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-20826115-6959-48fc-b8b8-4c506bcc7f16 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:58.909443 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-20826115-6959-48fc-b8b8-4c506bcc7f16 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:58.910247 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-20826115-6959-48fc-b8b8-4c506bcc7f16 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:58.910679 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-20826115-6959-48fc-b8b8-4c506bcc7f16 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:58.938677 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-20826115-6959-48fc-b8b8-4c506bcc7f16 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040193 Mar 03 02:37:58.939220 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 733/1478] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:58 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:37:59.468319 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0bd4895d-bb85-406c-99dc-11b3f86d5e42 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:59.468921 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0bd4895d-bb85-406c-99dc-11b3f86d5e42 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:59.475230 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0bd4895d-bb85-406c-99dc-11b3f86d5e42 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:59.475700 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0bd4895d-bb85-406c-99dc-11b3f86d5e42 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:59.476470 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0bd4895d-bb85-406c-99dc-11b3f86d5e42 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:59.476900 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0bd4895d-bb85-406c-99dc-11b3f86d5e42 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:59.609423 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0bd4895d-bb85-406c-99dc-11b3f86d5e42 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:59.617538 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0bd4895d-bb85-406c-99dc-11b3f86d5e42 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:59.619290 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0bd4895d-bb85-406c-99dc-11b3f86d5e42 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:59.620457 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0bd4895d-bb85-406c-99dc-11b3f86d5e42 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.156024 Mar 03 02:37:59.621005 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 746/1479] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:37:59 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:37:59.742285 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8436dd91-606e-414d-bd6c-683065e3919d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:59.743115 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8436dd91-606e-414d-bd6c-683065e3919d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:59.749056 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8436dd91-606e-414d-bd6c-683065e3919d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:59.749502 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8436dd91-606e-414d-bd6c-683065e3919d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:59.750268 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8436dd91-606e-414d-bd6c-683065e3919d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:59.750701 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8436dd91-606e-414d-bd6c-683065e3919d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:59.779050 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8436dd91-606e-414d-bd6c-683065e3919d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040931 Mar 03 02:37:59.779625 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 734/1480] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:59 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:37:59.872761 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-42c2fc63-e58f-4177-baa7-2c728a18ea5a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:59.873367 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-42c2fc63-e58f-4177-baa7-2c728a18ea5a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:59.880110 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-42c2fc63-e58f-4177-baa7-2c728a18ea5a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:59.880599 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-42c2fc63-e58f-4177-baa7-2c728a18ea5a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:59.881396 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-42c2fc63-e58f-4177-baa7-2c728a18ea5a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:59.881813 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-42c2fc63-e58f-4177-baa7-2c728a18ea5a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:59.912529 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-43e574a7-267b-4c4d-a3a6-77adcfe7a440 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:59.913460 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-43e574a7-267b-4c4d-a3a6-77adcfe7a440 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:59.919765 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-43e574a7-267b-4c4d-a3a6-77adcfe7a440 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:59.920208 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-43e574a7-267b-4c4d-a3a6-77adcfe7a440 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:59.920991 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-43e574a7-267b-4c4d-a3a6-77adcfe7a440 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:59.921423 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-43e574a7-267b-4c4d-a3a6-77adcfe7a440 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:59.939449 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-42c2fc63-e58f-4177-baa7-2c728a18ea5a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:37:59.947473 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-42c2fc63-e58f-4177-baa7-2c728a18ea5a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078747 Mar 03 02:37:59.948084 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 747/1481] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:37:59 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:37:59.949843 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-43e574a7-267b-4c4d-a3a6-77adcfe7a440 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041287 Mar 03 02:37:59.950537 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 735/1482] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:59 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:37:59.952622 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9c8ad1e9-8929-42bc-b991-3f82b0cba1e3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:37:59.953520 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9c8ad1e9-8929-42bc-b991-3f82b0cba1e3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:37:59.959820 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9c8ad1e9-8929-42bc-b991-3f82b0cba1e3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:59.960269 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9c8ad1e9-8929-42bc-b991-3f82b0cba1e3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:59.961053 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9c8ad1e9-8929-42bc-b991-3f82b0cba1e3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:37:59.961489 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9c8ad1e9-8929-42bc-b991-3f82b0cba1e3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:37:59.988051 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9c8ad1e9-8929-42bc-b991-3f82b0cba1e3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038976 Mar 03 02:37:59.988594 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 748/1483] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:37:59 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:00.638365 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e8fee1ce-7b80-43ad-8571-3903254cf507 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:00.638963 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e8fee1ce-7b80-43ad-8571-3903254cf507 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:00.644765 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e8fee1ce-7b80-43ad-8571-3903254cf507 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:00.645862 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e8fee1ce-7b80-43ad-8571-3903254cf507 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:00.646774 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e8fee1ce-7b80-43ad-8571-3903254cf507 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:00.647200 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e8fee1ce-7b80-43ad-8571-3903254cf507 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:00.776391 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e8fee1ce-7b80-43ad-8571-3903254cf507 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:00.784447 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e8fee1ce-7b80-43ad-8571-3903254cf507 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:00.785934 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e8fee1ce-7b80-43ad-8571-3903254cf507 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:00.787088 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e8fee1ce-7b80-43ad-8571-3903254cf507 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.152650 Mar 03 02:38:00.787643 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 736/1484] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:00 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:38:00.790370 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6406d717-20b6-4cae-af60-d3546dd6489e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:00.791290 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6406d717-20b6-4cae-af60-d3546dd6489e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:00.797082 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6406d717-20b6-4cae-af60-d3546dd6489e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:00.797594 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6406d717-20b6-4cae-af60-d3546dd6489e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:00.798413 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6406d717-20b6-4cae-af60-d3546dd6489e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:00.798849 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6406d717-20b6-4cae-af60-d3546dd6489e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:00.827212 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6406d717-20b6-4cae-af60-d3546dd6489e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040792 Mar 03 02:38:00.827786 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 749/1485] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:00 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:00.961197 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ef787863-6bce-4574-8a07-62f422eecbae tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:00.962025 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ef787863-6bce-4574-8a07-62f422eecbae tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:00.963646 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7aa32e22-e670-4e71-988d-6d10a76ccdd5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:00.964252 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7aa32e22-e670-4e71-988d-6d10a76ccdd5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:00.968218 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ef787863-6bce-4574-8a07-62f422eecbae tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:00.968776 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ef787863-6bce-4574-8a07-62f422eecbae tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:00.969564 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ef787863-6bce-4574-8a07-62f422eecbae tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:00.969995 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ef787863-6bce-4574-8a07-62f422eecbae tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:00.970500 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7aa32e22-e670-4e71-988d-6d10a76ccdd5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:00.970955 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7aa32e22-e670-4e71-988d-6d10a76ccdd5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:00.971759 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7aa32e22-e670-4e71-988d-6d10a76ccdd5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:00.972193 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7aa32e22-e670-4e71-988d-6d10a76ccdd5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:00.999797 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ef787863-6bce-4574-8a07-62f422eecbae tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042527 Mar 03 02:38:01.003762 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 737/1486] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:00 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:01.005648 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e7898ecc-c76e-4a56-a642-927396f4363d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:01.006533 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e7898ecc-c76e-4a56-a642-927396f4363d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:01.012285 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e7898ecc-c76e-4a56-a642-927396f4363d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:01.012734 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e7898ecc-c76e-4a56-a642-927396f4363d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:01.013514 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e7898ecc-c76e-4a56-a642-927396f4363d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:01.013944 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e7898ecc-c76e-4a56-a642-927396f4363d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:01.036424 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-7aa32e22-e670-4e71-988d-6d10a76ccdd5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:01.041247 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e7898ecc-c76e-4a56-a642-927396f4363d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039892 Mar 03 02:38:01.041813 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 738/1487] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:01 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:01.043648 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7aa32e22-e670-4e71-988d-6d10a76ccdd5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.083767 Mar 03 02:38:01.044208 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 750/1488] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:00 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:38:01.805933 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c7489521-bea0-4538-b8b4-4a68be6b0666 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:01.806452 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c7489521-bea0-4538-b8b4-4a68be6b0666 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:01.812139 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c7489521-bea0-4538-b8b4-4a68be6b0666 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:01.812584 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c7489521-bea0-4538-b8b4-4a68be6b0666 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:01.813365 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c7489521-bea0-4538-b8b4-4a68be6b0666 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:01.813778 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c7489521-bea0-4538-b8b4-4a68be6b0666 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:01.839050 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-973a9877-bb3f-42c1-9f4a-c346c2fd30e6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:01.840017 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-973a9877-bb3f-42c1-9f4a-c346c2fd30e6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:01.845995 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-973a9877-bb3f-42c1-9f4a-c346c2fd30e6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:01.846442 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-973a9877-bb3f-42c1-9f4a-c346c2fd30e6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:01.847221 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-973a9877-bb3f-42c1-9f4a-c346c2fd30e6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:01.847685 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-973a9877-bb3f-42c1-9f4a-c346c2fd30e6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:01.880480 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-973a9877-bb3f-42c1-9f4a-c346c2fd30e6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044748 Mar 03 02:38:01.881165 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 751/1489] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:01 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:01.949432 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c7489521-bea0-4538-b8b4-4a68be6b0666 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:01.957432 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c7489521-bea0-4538-b8b4-4a68be6b0666 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:01.958943 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c7489521-bea0-4538-b8b4-4a68be6b0666 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:01.960140 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c7489521-bea0-4538-b8b4-4a68be6b0666 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.158903 Mar 03 02:38:01.960695 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 739/1490] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:01 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:38:02.011852 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3e508426-da32-479c-81d5-f6cb209c15cc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:02.012743 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3e508426-da32-479c-81d5-f6cb209c15cc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:02.018572 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3e508426-da32-479c-81d5-f6cb209c15cc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:02.019019 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3e508426-da32-479c-81d5-f6cb209c15cc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:02.019837 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3e508426-da32-479c-81d5-f6cb209c15cc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:02.020415 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3e508426-da32-479c-81d5-f6cb209c15cc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:02.049174 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3e508426-da32-479c-81d5-f6cb209c15cc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041246 Mar 03 02:38:02.049890 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 752/1491] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:02 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:02.055074 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6bc2bb97-359a-4565-8d78-327ad277a205 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:02.055074 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6bc2bb97-359a-4565-8d78-327ad277a205 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:02.060123 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0bf9f838-53e8-4157-816b-847dba73526e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:02.060666 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0bf9f838-53e8-4157-816b-847dba73526e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:02.061165 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6bc2bb97-359a-4565-8d78-327ad277a205 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:02.061613 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6bc2bb97-359a-4565-8d78-327ad277a205 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:02.062396 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6bc2bb97-359a-4565-8d78-327ad277a205 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:02.062824 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6bc2bb97-359a-4565-8d78-327ad277a205 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:02.066417 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0bf9f838-53e8-4157-816b-847dba73526e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:02.066871 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0bf9f838-53e8-4157-816b-847dba73526e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:02.068382 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0bf9f838-53e8-4157-816b-847dba73526e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:02.068827 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0bf9f838-53e8-4157-816b-847dba73526e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:02.090760 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6bc2bb97-359a-4565-8d78-327ad277a205 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041560 Mar 03 02:38:02.091290 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 740/1492] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:02 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:02.128388 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0bf9f838-53e8-4157-816b-847dba73526e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:02.136168 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0bf9f838-53e8-4157-816b-847dba73526e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.079783 Mar 03 02:38:02.136738 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 753/1493] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:02 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:38:02.894785 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6d30b247-c7c0-499e-a428-98759ce08c1f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:02.896916 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6d30b247-c7c0-499e-a428-98759ce08c1f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:02.903205 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6d30b247-c7c0-499e-a428-98759ce08c1f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:02.903744 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6d30b247-c7c0-499e-a428-98759ce08c1f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:02.904605 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6d30b247-c7c0-499e-a428-98759ce08c1f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:02.905039 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6d30b247-c7c0-499e-a428-98759ce08c1f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:02.933411 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6d30b247-c7c0-499e-a428-98759ce08c1f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043441 Mar 03 02:38:02.933971 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 741/1494] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:02 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:02.978864 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b0c4912e-faee-4b3c-bb6b-b6d93ea40cbc tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:02.979462 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b0c4912e-faee-4b3c-bb6b-b6d93ea40cbc tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:02.985745 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b0c4912e-faee-4b3c-bb6b-b6d93ea40cbc tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:02.986197 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b0c4912e-faee-4b3c-bb6b-b6d93ea40cbc tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:02.986974 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b0c4912e-faee-4b3c-bb6b-b6d93ea40cbc tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:02.987409 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b0c4912e-faee-4b3c-bb6b-b6d93ea40cbc tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:03.062389 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1cb552aa-7834-4508-9db2-55c006628980 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:03.063303 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1cb552aa-7834-4508-9db2-55c006628980 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:03.070534 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1cb552aa-7834-4508-9db2-55c006628980 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:03.070983 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1cb552aa-7834-4508-9db2-55c006628980 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:03.071802 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1cb552aa-7834-4508-9db2-55c006628980 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:03.072238 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1cb552aa-7834-4508-9db2-55c006628980 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:03.103991 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1cb552aa-7834-4508-9db2-55c006628980 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045844 Mar 03 02:38:03.104577 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 742/1495] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:03 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:03.109780 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-308ee8cf-f7a0-4802-bb9d-4c4ce89a11a5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:03.110687 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-308ee8cf-f7a0-4802-bb9d-4c4ce89a11a5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:03.117388 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-308ee8cf-f7a0-4802-bb9d-4c4ce89a11a5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:03.118136 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-308ee8cf-f7a0-4802-bb9d-4c4ce89a11a5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:03.119719 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-308ee8cf-f7a0-4802-bb9d-4c4ce89a11a5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:03.120452 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-308ee8cf-f7a0-4802-bb9d-4c4ce89a11a5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:03.141384 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b0c4912e-faee-4b3c-bb6b-b6d93ea40cbc tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:03.150655 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b0c4912e-faee-4b3c-bb6b-b6d93ea40cbc tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:03.152101 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b0c4912e-faee-4b3c-bb6b-b6d93ea40cbc tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:03.153311 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b0c4912e-faee-4b3c-bb6b-b6d93ea40cbc tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.178382 Mar 03 02:38:03.153881 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 754/1496] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:02 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:38:03.156746 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-308ee8cf-f7a0-4802-bb9d-4c4ce89a11a5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051132 Mar 03 02:38:03.157312 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 743/1497] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:03 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:03.158649 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4af1b7c7-f1f0-421b-9b7e-d347c04a0a07 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:03.159257 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4af1b7c7-f1f0-421b-9b7e-d347c04a0a07 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:03.165680 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4af1b7c7-f1f0-421b-9b7e-d347c04a0a07 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:03.166131 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4af1b7c7-f1f0-421b-9b7e-d347c04a0a07 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:03.166925 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4af1b7c7-f1f0-421b-9b7e-d347c04a0a07 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:03.167363 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4af1b7c7-f1f0-421b-9b7e-d347c04a0a07 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:03.230723 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4af1b7c7-f1f0-421b-9b7e-d347c04a0a07 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:03.238162 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4af1b7c7-f1f0-421b-9b7e-d347c04a0a07 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.083330 Mar 03 02:38:03.238728 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 755/1498] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:03 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:38:03.946030 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e4a51022-c436-4f53-a846-04308f71c129 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:03.946936 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e4a51022-c436-4f53-a846-04308f71c129 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:03.952785 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e4a51022-c436-4f53-a846-04308f71c129 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:03.953235 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e4a51022-c436-4f53-a846-04308f71c129 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:03.954015 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e4a51022-c436-4f53-a846-04308f71c129 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:03.954452 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e4a51022-c436-4f53-a846-04308f71c129 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:03.981549 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e4a51022-c436-4f53-a846-04308f71c129 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040208 Mar 03 02:38:03.982096 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 744/1499] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:03 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:04.116267 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4fa76daa-2d56-456c-92e5-e92727390766 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:04.117181 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4fa76daa-2d56-456c-92e5-e92727390766 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:04.123778 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4fa76daa-2d56-456c-92e5-e92727390766 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:04.124237 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4fa76daa-2d56-456c-92e5-e92727390766 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:04.125024 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4fa76daa-2d56-456c-92e5-e92727390766 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:04.125467 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4fa76daa-2d56-456c-92e5-e92727390766 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:04.153460 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4fa76daa-2d56-456c-92e5-e92727390766 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041762 Mar 03 02:38:04.154061 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 756/1500] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:04 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:04.167364 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-aba1aeff-1f70-4936-8282-37a1bdd3d8bb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:04.168317 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-aba1aeff-1f70-4936-8282-37a1bdd3d8bb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:04.171163 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c161f945-c033-4c3f-b434-8e1994fec90c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:04.171785 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c161f945-c033-4c3f-b434-8e1994fec90c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:04.174469 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aba1aeff-1f70-4936-8282-37a1bdd3d8bb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:04.174922 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aba1aeff-1f70-4936-8282-37a1bdd3d8bb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:04.175733 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aba1aeff-1f70-4936-8282-37a1bdd3d8bb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:04.176172 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aba1aeff-1f70-4936-8282-37a1bdd3d8bb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:04.177896 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c161f945-c033-4c3f-b434-8e1994fec90c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:04.178333 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c161f945-c033-4c3f-b434-8e1994fec90c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:04.179106 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c161f945-c033-4c3f-b434-8e1994fec90c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:04.179536 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c161f945-c033-4c3f-b434-8e1994fec90c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:04.205066 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-aba1aeff-1f70-4936-8282-37a1bdd3d8bb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041689 Mar 03 02:38:04.205565 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 745/1501] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:04 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:04.258123 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9d8d74f6-9353-4161-aa99-f9a835843b0f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:04.258733 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9d8d74f6-9353-4161-aa99-f9a835843b0f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:04.264648 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9d8d74f6-9353-4161-aa99-f9a835843b0f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:04.265143 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9d8d74f6-9353-4161-aa99-f9a835843b0f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:04.265933 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9d8d74f6-9353-4161-aa99-f9a835843b0f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:04.266379 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9d8d74f6-9353-4161-aa99-f9a835843b0f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:04.312640 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c161f945-c033-4c3f-b434-8e1994fec90c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:04.320905 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c161f945-c033-4c3f-b434-8e1994fec90c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:04.322422 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c161f945-c033-4c3f-b434-8e1994fec90c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:04.323596 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c161f945-c033-4c3f-b434-8e1994fec90c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.156193 Mar 03 02:38:04.324334 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 757/1502] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:04 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:38:04.325480 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9d8d74f6-9353-4161-aa99-f9a835843b0f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:04.332805 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9d8d74f6-9353-4161-aa99-f9a835843b0f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.079312 Mar 03 02:38:04.333595 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 746/1503] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:04 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:38:04.993714 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-261a3345-ff53-4a71-b59c-a47629fda706 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:04.995032 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-261a3345-ff53-4a71-b59c-a47629fda706 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:05.001027 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-261a3345-ff53-4a71-b59c-a47629fda706 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:05.001481 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-261a3345-ff53-4a71-b59c-a47629fda706 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:05.002264 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-261a3345-ff53-4a71-b59c-a47629fda706 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:05.002711 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-261a3345-ff53-4a71-b59c-a47629fda706 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:05.037697 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-261a3345-ff53-4a71-b59c-a47629fda706 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048138 Mar 03 02:38:05.038326 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 758/1504] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:04 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:05.165389 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-937eb46f-480c-4457-9f24-cd9f4d586b71 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:05.166293 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-937eb46f-480c-4457-9f24-cd9f4d586b71 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:05.172467 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-937eb46f-480c-4457-9f24-cd9f4d586b71 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:05.173033 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-937eb46f-480c-4457-9f24-cd9f4d586b71 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:05.173665 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-937eb46f-480c-4457-9f24-cd9f4d586b71 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:05.174102 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-937eb46f-480c-4457-9f24-cd9f4d586b71 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:05.202192 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-937eb46f-480c-4457-9f24-cd9f4d586b71 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041134 Mar 03 02:38:05.202738 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 747/1505] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:05 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:05.216723 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e975b9f4-e21f-4a54-981e-275b5dc879db tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:05.217636 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e975b9f4-e21f-4a54-981e-275b5dc879db tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:05.224329 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e975b9f4-e21f-4a54-981e-275b5dc879db tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:05.224782 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e975b9f4-e21f-4a54-981e-275b5dc879db tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:05.225566 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e975b9f4-e21f-4a54-981e-275b5dc879db tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:05.226002 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e975b9f4-e21f-4a54-981e-275b5dc879db tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:05.253594 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e975b9f4-e21f-4a54-981e-275b5dc879db tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040820 Mar 03 02:38:05.254142 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 759/1506] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:05 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:05.341549 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-511bca2c-3101-430d-a87f-e23e2ed2491e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:05.342158 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-511bca2c-3101-430d-a87f-e23e2ed2491e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:05.348013 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-511bca2c-3101-430d-a87f-e23e2ed2491e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:05.348171 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-fc9a6ffe-d5b8-4a3d-9fd3-238165c83373 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:05.348678 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-511bca2c-3101-430d-a87f-e23e2ed2491e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:05.349337 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-fc9a6ffe-d5b8-4a3d-9fd3-238165c83373 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:05.349564 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-511bca2c-3101-430d-a87f-e23e2ed2491e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:05.350012 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-511bca2c-3101-430d-a87f-e23e2ed2491e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:05.355034 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fc9a6ffe-d5b8-4a3d-9fd3-238165c83373 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:05.355483 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fc9a6ffe-d5b8-4a3d-9fd3-238165c83373 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:05.356307 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fc9a6ffe-d5b8-4a3d-9fd3-238165c83373 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:05.356745 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fc9a6ffe-d5b8-4a3d-9fd3-238165c83373 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:05.417570 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-fc9a6ffe-d5b8-4a3d-9fd3-238165c83373 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:05.424833 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-fc9a6ffe-d5b8-4a3d-9fd3-238165c83373 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.080353 Mar 03 02:38:05.425408 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 760/1507] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:05 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:38:05.482288 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-511bca2c-3101-430d-a87f-e23e2ed2491e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:05.490964 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-511bca2c-3101-430d-a87f-e23e2ed2491e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:05.492492 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-511bca2c-3101-430d-a87f-e23e2ed2491e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:05.493633 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-511bca2c-3101-430d-a87f-e23e2ed2491e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.155937 Mar 03 02:38:05.494449 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 748/1508] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:05 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:38:06.048694 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-50c3b392-fb66-4ac6-a060-c804f5ec3e4f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:06.049645 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-50c3b392-fb66-4ac6-a060-c804f5ec3e4f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:06.056820 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-50c3b392-fb66-4ac6-a060-c804f5ec3e4f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:06.057271 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-50c3b392-fb66-4ac6-a060-c804f5ec3e4f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:06.058060 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-50c3b392-fb66-4ac6-a060-c804f5ec3e4f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:06.058497 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-50c3b392-fb66-4ac6-a060-c804f5ec3e4f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:06.086043 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-50c3b392-fb66-4ac6-a060-c804f5ec3e4f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041288 Mar 03 02:38:06.086593 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 761/1509] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:06 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:06.214180 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a663f859-c1d4-4a47-b0e6-997b6c08bee7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:06.215084 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a663f859-c1d4-4a47-b0e6-997b6c08bee7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:06.221203 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a663f859-c1d4-4a47-b0e6-997b6c08bee7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:06.221646 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a663f859-c1d4-4a47-b0e6-997b6c08bee7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:06.222411 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a663f859-c1d4-4a47-b0e6-997b6c08bee7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:06.222846 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a663f859-c1d4-4a47-b0e6-997b6c08bee7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:06.250454 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a663f859-c1d4-4a47-b0e6-997b6c08bee7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040188 Mar 03 02:38:06.250989 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 749/1510] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:06 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:06.265381 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d5638306-f655-4739-9059-ff322e22572c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:06.266281 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d5638306-f655-4739-9059-ff322e22572c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:06.273044 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d5638306-f655-4739-9059-ff322e22572c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:06.273490 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d5638306-f655-4739-9059-ff322e22572c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:06.274260 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d5638306-f655-4739-9059-ff322e22572c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:06.274693 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d5638306-f655-4739-9059-ff322e22572c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:06.301980 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d5638306-f655-4739-9059-ff322e22572c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040349 Mar 03 02:38:06.303220 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 762/1511] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:06 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:06.442129 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4497b302-ddc3-4a12-95ad-da8e2736ec48 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:06.442693 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4497b302-ddc3-4a12-95ad-da8e2736ec48 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:06.448462 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4497b302-ddc3-4a12-95ad-da8e2736ec48 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:06.448913 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4497b302-ddc3-4a12-95ad-da8e2736ec48 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:06.449688 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4497b302-ddc3-4a12-95ad-da8e2736ec48 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:06.450124 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4497b302-ddc3-4a12-95ad-da8e2736ec48 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:06.508703 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4497b302-ddc3-4a12-95ad-da8e2736ec48 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:06.511900 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e5a2571c-70fa-46a7-84f1-9fe6756d3ac2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:06.512510 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e5a2571c-70fa-46a7-84f1-9fe6756d3ac2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:06.515972 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4497b302-ddc3-4a12-95ad-da8e2736ec48 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.077733 Mar 03 02:38:06.516526 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 750/1512] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:06 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:38:06.518279 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e5a2571c-70fa-46a7-84f1-9fe6756d3ac2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:06.518737 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e5a2571c-70fa-46a7-84f1-9fe6756d3ac2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:06.519521 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e5a2571c-70fa-46a7-84f1-9fe6756d3ac2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:06.520555 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e5a2571c-70fa-46a7-84f1-9fe6756d3ac2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:06.649975 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e5a2571c-70fa-46a7-84f1-9fe6756d3ac2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:06.658029 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e5a2571c-70fa-46a7-84f1-9fe6756d3ac2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:06.659535 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e5a2571c-70fa-46a7-84f1-9fe6756d3ac2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:06.660729 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e5a2571c-70fa-46a7-84f1-9fe6756d3ac2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.152724 Mar 03 02:38:06.661322 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 763/1513] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:06 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:38:07.097526 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-79c2f256-b6a7-4895-b2cd-b3873543cf15 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:07.098426 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-79c2f256-b6a7-4895-b2cd-b3873543cf15 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:07.104184 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-79c2f256-b6a7-4895-b2cd-b3873543cf15 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:07.104630 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-79c2f256-b6a7-4895-b2cd-b3873543cf15 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:07.105430 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-79c2f256-b6a7-4895-b2cd-b3873543cf15 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:07.105861 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-79c2f256-b6a7-4895-b2cd-b3873543cf15 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:07.134084 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-79c2f256-b6a7-4895-b2cd-b3873543cf15 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040538 Mar 03 02:38:07.134654 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 751/1514] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:07 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:07.261728 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4037546c-2c48-41c7-ba63-0cbfb2340652 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:07.262626 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4037546c-2c48-41c7-ba63-0cbfb2340652 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:07.268451 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4037546c-2c48-41c7-ba63-0cbfb2340652 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:07.269016 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4037546c-2c48-41c7-ba63-0cbfb2340652 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:07.269653 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4037546c-2c48-41c7-ba63-0cbfb2340652 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:07.270135 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4037546c-2c48-41c7-ba63-0cbfb2340652 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:07.298859 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4037546c-2c48-41c7-ba63-0cbfb2340652 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041061 Mar 03 02:38:07.299395 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 764/1515] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:07 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:07.313161 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-98639cc2-7710-4af1-bdda-8f9161db0645 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:07.314003 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-98639cc2-7710-4af1-bdda-8f9161db0645 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:07.320523 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-98639cc2-7710-4af1-bdda-8f9161db0645 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:07.320979 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-98639cc2-7710-4af1-bdda-8f9161db0645 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:07.321752 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-98639cc2-7710-4af1-bdda-8f9161db0645 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:07.322185 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-98639cc2-7710-4af1-bdda-8f9161db0645 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:07.350281 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-98639cc2-7710-4af1-bdda-8f9161db0645 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041057 Mar 03 02:38:07.350822 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 752/1516] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:07 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:07.533146 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4fee416c-f740-475f-ac07-8758694146ee tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:07.533754 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4fee416c-f740-475f-ac07-8758694146ee tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:07.540134 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4fee416c-f740-475f-ac07-8758694146ee tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:07.540580 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4fee416c-f740-475f-ac07-8758694146ee tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:07.541351 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4fee416c-f740-475f-ac07-8758694146ee tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:07.541783 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4fee416c-f740-475f-ac07-8758694146ee tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:07.603016 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4fee416c-f740-475f-ac07-8758694146ee tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:07.610290 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4fee416c-f740-475f-ac07-8758694146ee tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.081031 Mar 03 02:38:07.610851 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 765/1517] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:07 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:38:07.678205 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d6d29c86-f440-4e56-9517-f5d5af0523e6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:07.678835 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d6d29c86-f440-4e56-9517-f5d5af0523e6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:07.684556 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d6d29c86-f440-4e56-9517-f5d5af0523e6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:07.685002 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d6d29c86-f440-4e56-9517-f5d5af0523e6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:07.685770 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d6d29c86-f440-4e56-9517-f5d5af0523e6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:07.686202 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d6d29c86-f440-4e56-9517-f5d5af0523e6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:07.819222 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d6d29c86-f440-4e56-9517-f5d5af0523e6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:07.827272 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d6d29c86-f440-4e56-9517-f5d5af0523e6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:07.828810 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d6d29c86-f440-4e56-9517-f5d5af0523e6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:07.829956 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d6d29c86-f440-4e56-9517-f5d5af0523e6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.155707 Mar 03 02:38:07.830507 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 753/1518] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:07 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:38:08.144554 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e563d0c7-3975-4285-8ef3-c5fcbac76aa7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:08.146096 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e563d0c7-3975-4285-8ef3-c5fcbac76aa7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:08.151864 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e563d0c7-3975-4285-8ef3-c5fcbac76aa7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:08.152312 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e563d0c7-3975-4285-8ef3-c5fcbac76aa7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:08.153086 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e563d0c7-3975-4285-8ef3-c5fcbac76aa7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:08.153549 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e563d0c7-3975-4285-8ef3-c5fcbac76aa7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:08.180546 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e563d0c7-3975-4285-8ef3-c5fcbac76aa7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039961 Mar 03 02:38:08.181083 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 766/1519] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:08 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:08.311384 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-47c5dd0c-a2da-47bf-9b0e-e7f5f663ae60 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:08.312232 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-47c5dd0c-a2da-47bf-9b0e-e7f5f663ae60 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:08.319156 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-47c5dd0c-a2da-47bf-9b0e-e7f5f663ae60 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:08.319766 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-47c5dd0c-a2da-47bf-9b0e-e7f5f663ae60 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:08.320372 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-47c5dd0c-a2da-47bf-9b0e-e7f5f663ae60 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:08.320802 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-47c5dd0c-a2da-47bf-9b0e-e7f5f663ae60 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:08.348332 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-47c5dd0c-a2da-47bf-9b0e-e7f5f663ae60 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040858 Mar 03 02:38:08.349000 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 754/1520] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:08 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:08.361534 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-79190d42-2f14-4e99-a997-03b2e40b9153 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:08.362469 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-79190d42-2f14-4e99-a997-03b2e40b9153 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:08.368679 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-79190d42-2f14-4e99-a997-03b2e40b9153 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:08.369412 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-79190d42-2f14-4e99-a997-03b2e40b9153 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:08.370186 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-79190d42-2f14-4e99-a997-03b2e40b9153 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:08.370616 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-79190d42-2f14-4e99-a997-03b2e40b9153 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:08.398533 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-79190d42-2f14-4e99-a997-03b2e40b9153 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040921 Mar 03 02:38:08.399078 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 767/1521] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:08 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:08.627878 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d1c70a04-7bef-408b-b424-de336aff42a9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:08.628519 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d1c70a04-7bef-408b-b424-de336aff42a9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:08.635116 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d1c70a04-7bef-408b-b424-de336aff42a9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:08.635579 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d1c70a04-7bef-408b-b424-de336aff42a9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:08.636387 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d1c70a04-7bef-408b-b424-de336aff42a9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:08.636929 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d1c70a04-7bef-408b-b424-de336aff42a9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:08.701375 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d1c70a04-7bef-408b-b424-de336aff42a9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:08.708706 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d1c70a04-7bef-408b-b424-de336aff42a9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.084758 Mar 03 02:38:08.709258 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 755/1522] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:08 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:38:08.848866 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9527c5b9-2f2c-42d5-8525-9fddebcb87b2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:08.849466 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9527c5b9-2f2c-42d5-8525-9fddebcb87b2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:08.855279 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9527c5b9-2f2c-42d5-8525-9fddebcb87b2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:08.855762 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9527c5b9-2f2c-42d5-8525-9fddebcb87b2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:08.856536 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9527c5b9-2f2c-42d5-8525-9fddebcb87b2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:08.856967 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9527c5b9-2f2c-42d5-8525-9fddebcb87b2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:08.986316 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9527c5b9-2f2c-42d5-8525-9fddebcb87b2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:08.995820 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9527c5b9-2f2c-42d5-8525-9fddebcb87b2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:08.997336 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9527c5b9-2f2c-42d5-8525-9fddebcb87b2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:08.998505 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9527c5b9-2f2c-42d5-8525-9fddebcb87b2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.154087 Mar 03 02:38:08.999062 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 768/1523] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:08 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:38:09.191886 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2150f096-2f74-4641-9ade-1918a6b02f9f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:09.192892 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2150f096-2f74-4641-9ade-1918a6b02f9f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:09.198755 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2150f096-2f74-4641-9ade-1918a6b02f9f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:09.199207 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2150f096-2f74-4641-9ade-1918a6b02f9f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:09.200010 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2150f096-2f74-4641-9ade-1918a6b02f9f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:09.200443 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2150f096-2f74-4641-9ade-1918a6b02f9f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:09.228672 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2150f096-2f74-4641-9ade-1918a6b02f9f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040860 Mar 03 02:38:09.229216 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 756/1524] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:09 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:09.359648 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2902223b-39af-4458-9ee1-f1762f0bb328 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:09.360552 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2902223b-39af-4458-9ee1-f1762f0bb328 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:09.367030 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2902223b-39af-4458-9ee1-f1762f0bb328 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:09.367660 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2902223b-39af-4458-9ee1-f1762f0bb328 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:09.368255 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2902223b-39af-4458-9ee1-f1762f0bb328 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:09.368687 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2902223b-39af-4458-9ee1-f1762f0bb328 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:09.397232 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2902223b-39af-4458-9ee1-f1762f0bb328 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041504 Mar 03 02:38:09.397786 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 769/1525] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:09 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:09.408974 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3bbb76a5-47d8-482d-a7c0-945c9719ea46 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:09.409872 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3bbb76a5-47d8-482d-a7c0-945c9719ea46 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:09.416674 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3bbb76a5-47d8-482d-a7c0-945c9719ea46 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:09.417122 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3bbb76a5-47d8-482d-a7c0-945c9719ea46 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:09.417893 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3bbb76a5-47d8-482d-a7c0-945c9719ea46 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:09.418318 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3bbb76a5-47d8-482d-a7c0-945c9719ea46 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:09.444988 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3bbb76a5-47d8-482d-a7c0-945c9719ea46 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039838 Mar 03 02:38:09.445455 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 757/1526] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:09 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:09.724902 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4af22835-6120-41d3-96a4-f1382539b8c7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:09.725429 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4af22835-6120-41d3-96a4-f1382539b8c7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:09.731202 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4af22835-6120-41d3-96a4-f1382539b8c7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:09.731675 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4af22835-6120-41d3-96a4-f1382539b8c7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:09.732449 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4af22835-6120-41d3-96a4-f1382539b8c7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:09.732882 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4af22835-6120-41d3-96a4-f1382539b8c7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:09.792873 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4af22835-6120-41d3-96a4-f1382539b8c7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:09.800215 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4af22835-6120-41d3-96a4-f1382539b8c7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.079225 Mar 03 02:38:09.800774 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 770/1527] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:09 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:38:10.016095 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-256288e7-feef-4a4a-84fc-78c4382bb980 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:10.016634 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-256288e7-feef-4a4a-84fc-78c4382bb980 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:10.022637 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-256288e7-feef-4a4a-84fc-78c4382bb980 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:10.023091 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-256288e7-feef-4a4a-84fc-78c4382bb980 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:10.023905 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-256288e7-feef-4a4a-84fc-78c4382bb980 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:10.024347 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-256288e7-feef-4a4a-84fc-78c4382bb980 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:10.153312 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-256288e7-feef-4a4a-84fc-78c4382bb980 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:10.161475 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-256288e7-feef-4a4a-84fc-78c4382bb980 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:10.162983 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-256288e7-feef-4a4a-84fc-78c4382bb980 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:10.164176 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-256288e7-feef-4a4a-84fc-78c4382bb980 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.152048 Mar 03 02:38:10.164735 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 758/1528] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:10 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:38:10.240877 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-772af342-e769-4198-bf7f-0ea0ecadb9c3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:10.241851 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-772af342-e769-4198-bf7f-0ea0ecadb9c3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:10.247902 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-772af342-e769-4198-bf7f-0ea0ecadb9c3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:10.248400 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-772af342-e769-4198-bf7f-0ea0ecadb9c3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:10.249176 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-772af342-e769-4198-bf7f-0ea0ecadb9c3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:10.249609 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-772af342-e769-4198-bf7f-0ea0ecadb9c3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:10.277584 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-772af342-e769-4198-bf7f-0ea0ecadb9c3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041349 Mar 03 02:38:10.278060 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 771/1529] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:10 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:10.408552 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-158814df-5c6a-4496-b8d3-e1651b375d7a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:10.409495 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-158814df-5c6a-4496-b8d3-e1651b375d7a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:10.416039 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-158814df-5c6a-4496-b8d3-e1651b375d7a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:10.416495 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-158814df-5c6a-4496-b8d3-e1651b375d7a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:10.417276 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-158814df-5c6a-4496-b8d3-e1651b375d7a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:10.417722 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-158814df-5c6a-4496-b8d3-e1651b375d7a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:10.445882 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-158814df-5c6a-4496-b8d3-e1651b375d7a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041249 Mar 03 02:38:10.446434 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 759/1530] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:10 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:10.456179 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-21d0465e-2c64-4034-9a4b-25d939230937 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:10.457086 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-21d0465e-2c64-4034-9a4b-25d939230937 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:10.463172 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-21d0465e-2c64-4034-9a4b-25d939230937 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:10.463622 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-21d0465e-2c64-4034-9a4b-25d939230937 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:10.464405 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-21d0465e-2c64-4034-9a4b-25d939230937 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:10.464931 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-21d0465e-2c64-4034-9a4b-25d939230937 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:10.492908 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-21d0465e-2c64-4034-9a4b-25d939230937 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040666 Mar 03 02:38:10.493451 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 772/1531] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:10 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:10.816845 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c8cd1556-6c9e-4cdc-9059-859f7a14dd22 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:10.817998 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c8cd1556-6c9e-4cdc-9059-859f7a14dd22 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:10.824068 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c8cd1556-6c9e-4cdc-9059-859f7a14dd22 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:10.824519 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c8cd1556-6c9e-4cdc-9059-859f7a14dd22 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:10.825298 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c8cd1556-6c9e-4cdc-9059-859f7a14dd22 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:10.825731 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c8cd1556-6c9e-4cdc-9059-859f7a14dd22 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:10.887142 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c8cd1556-6c9e-4cdc-9059-859f7a14dd22 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:10.894422 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c8cd1556-6c9e-4cdc-9059-859f7a14dd22 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.081591 Mar 03 02:38:10.895714 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 760/1532] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:10 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:38:11.181771 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-421d54ac-fd42-49b7-a1dd-fc552e1bbc37 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:11.182375 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-421d54ac-fd42-49b7-a1dd-fc552e1bbc37 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:11.188371 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-421d54ac-fd42-49b7-a1dd-fc552e1bbc37 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:11.188820 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-421d54ac-fd42-49b7-a1dd-fc552e1bbc37 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:11.189589 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-421d54ac-fd42-49b7-a1dd-fc552e1bbc37 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:11.190023 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-421d54ac-fd42-49b7-a1dd-fc552e1bbc37 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:11.288802 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9af36364-314b-44e4-82e4-6a239e22f573 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:11.289719 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9af36364-314b-44e4-82e4-6a239e22f573 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:11.295422 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9af36364-314b-44e4-82e4-6a239e22f573 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:11.295947 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9af36364-314b-44e4-82e4-6a239e22f573 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:11.296738 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9af36364-314b-44e4-82e4-6a239e22f573 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:11.297178 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9af36364-314b-44e4-82e4-6a239e22f573 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:11.323339 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-421d54ac-fd42-49b7-a1dd-fc552e1bbc37 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:11.325746 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9af36364-314b-44e4-82e4-6a239e22f573 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041191 Mar 03 02:38:11.326320 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 761/1533] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:11 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:11.331534 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-421d54ac-fd42-49b7-a1dd-fc552e1bbc37 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:11.334028 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-421d54ac-fd42-49b7-a1dd-fc552e1bbc37 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:11.335172 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-421d54ac-fd42-49b7-a1dd-fc552e1bbc37 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.157350 Mar 03 02:38:11.335742 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 773/1534] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:11 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:38:11.457266 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-55b0c6dd-5707-41de-b5fb-9cde8a5d3bed tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:11.458100 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-55b0c6dd-5707-41de-b5fb-9cde8a5d3bed tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:11.464284 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-55b0c6dd-5707-41de-b5fb-9cde8a5d3bed tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:11.464734 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-55b0c6dd-5707-41de-b5fb-9cde8a5d3bed tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:11.465511 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-55b0c6dd-5707-41de-b5fb-9cde8a5d3bed tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:11.465946 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-55b0c6dd-5707-41de-b5fb-9cde8a5d3bed tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:11.493706 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-55b0c6dd-5707-41de-b5fb-9cde8a5d3bed tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040424 Mar 03 02:38:11.494527 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 762/1535] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:11 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:11.505134 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-dafcab1e-2a45-430c-ba64-6d9d93832f76 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:11.506045 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-dafcab1e-2a45-430c-ba64-6d9d93832f76 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:11.512239 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dafcab1e-2a45-430c-ba64-6d9d93832f76 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:11.512684 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dafcab1e-2a45-430c-ba64-6d9d93832f76 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:11.513454 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dafcab1e-2a45-430c-ba64-6d9d93832f76 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:11.513885 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dafcab1e-2a45-430c-ba64-6d9d93832f76 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:11.541090 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-dafcab1e-2a45-430c-ba64-6d9d93832f76 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040613 Mar 03 02:38:11.541632 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 774/1536] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:11 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:11.912280 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-913a3b04-887d-425c-a6c8-711dc83cdac9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:11.912887 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-913a3b04-887d-425c-a6c8-711dc83cdac9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:11.918793 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-913a3b04-887d-425c-a6c8-711dc83cdac9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:11.919241 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-913a3b04-887d-425c-a6c8-711dc83cdac9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:11.920044 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-913a3b04-887d-425c-a6c8-711dc83cdac9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:11.920482 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-913a3b04-887d-425c-a6c8-711dc83cdac9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:11.978704 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-913a3b04-887d-425c-a6c8-711dc83cdac9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:11.985844 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-913a3b04-887d-425c-a6c8-711dc83cdac9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078413 Mar 03 02:38:11.986402 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 763/1537] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:11 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:38:12.337787 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4813587a-2360-401f-953a-27fa74a4d492 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:12.338688 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4813587a-2360-401f-953a-27fa74a4d492 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:12.344704 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4813587a-2360-401f-953a-27fa74a4d492 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:12.345151 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4813587a-2360-401f-953a-27fa74a4d492 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:12.345925 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4813587a-2360-401f-953a-27fa74a4d492 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:12.346360 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4813587a-2360-401f-953a-27fa74a4d492 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:12.354333 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3648403a-b08c-48fd-b189-4f1e2e9166a8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:12.354929 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3648403a-b08c-48fd-b189-4f1e2e9166a8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:12.360548 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3648403a-b08c-48fd-b189-4f1e2e9166a8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:12.360990 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3648403a-b08c-48fd-b189-4f1e2e9166a8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:12.361759 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3648403a-b08c-48fd-b189-4f1e2e9166a8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:12.362189 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3648403a-b08c-48fd-b189-4f1e2e9166a8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:12.374879 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4813587a-2360-401f-953a-27fa74a4d492 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041583 Mar 03 02:38:12.375443 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 775/1538] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:12 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:12.490607 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-3648403a-b08c-48fd-b189-4f1e2e9166a8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:12.499109 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-3648403a-b08c-48fd-b189-4f1e2e9166a8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:12.500630 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-3648403a-b08c-48fd-b189-4f1e2e9166a8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:12.501771 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3648403a-b08c-48fd-b189-4f1e2e9166a8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.151366 Mar 03 02:38:12.502317 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 764/1539] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:12 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:38:12.506017 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-fee10b21-5c60-4df8-807c-a66fe627b580 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:12.506930 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-fee10b21-5c60-4df8-807c-a66fe627b580 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:12.513162 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fee10b21-5c60-4df8-807c-a66fe627b580 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:12.513612 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fee10b21-5c60-4df8-807c-a66fe627b580 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:12.514394 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fee10b21-5c60-4df8-807c-a66fe627b580 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:12.514832 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fee10b21-5c60-4df8-807c-a66fe627b580 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:12.543181 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-fee10b21-5c60-4df8-807c-a66fe627b580 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041754 Mar 03 02:38:12.543753 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 776/1540] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:12 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:12.552340 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c263d02d-32b0-4d05-94b4-a866d1329573 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:12.553237 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c263d02d-32b0-4d05-94b4-a866d1329573 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:12.558987 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c263d02d-32b0-4d05-94b4-a866d1329573 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:12.559431 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c263d02d-32b0-4d05-94b4-a866d1329573 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:12.560247 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c263d02d-32b0-4d05-94b4-a866d1329573 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:12.560676 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c263d02d-32b0-4d05-94b4-a866d1329573 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:12.588173 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c263d02d-32b0-4d05-94b4-a866d1329573 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039595 Mar 03 02:38:12.588646 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 765/1541] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:12 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:13.002959 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c694a9ef-75dc-4999-b812-275bbb0549d6 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:13.003488 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c694a9ef-75dc-4999-b812-275bbb0549d6 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:13.010150 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c694a9ef-75dc-4999-b812-275bbb0549d6 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:13.010603 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c694a9ef-75dc-4999-b812-275bbb0549d6 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:13.011383 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c694a9ef-75dc-4999-b812-275bbb0549d6 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:13.011848 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c694a9ef-75dc-4999-b812-275bbb0549d6 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:13.070445 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c694a9ef-75dc-4999-b812-275bbb0549d6 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:13.077720 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c694a9ef-75dc-4999-b812-275bbb0549d6 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078695 Mar 03 02:38:13.078275 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 777/1542] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:12 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:38:13.386432 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-85130ccd-948e-43ed-9ec7-df5eae3248fe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:13.387329 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-85130ccd-948e-43ed-9ec7-df5eae3248fe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:13.393053 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-85130ccd-948e-43ed-9ec7-df5eae3248fe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:13.393494 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-85130ccd-948e-43ed-9ec7-df5eae3248fe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:13.394349 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-85130ccd-948e-43ed-9ec7-df5eae3248fe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:13.394784 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-85130ccd-948e-43ed-9ec7-df5eae3248fe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:13.423029 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-85130ccd-948e-43ed-9ec7-df5eae3248fe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040509 Mar 03 02:38:13.423575 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 766/1543] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:13 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:13.520125 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-913c336f-2263-4d88-b390-ed4ca1442f5c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:13.521171 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-913c336f-2263-4d88-b390-ed4ca1442f5c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:13.527395 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-913c336f-2263-4d88-b390-ed4ca1442f5c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:13.527879 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-913c336f-2263-4d88-b390-ed4ca1442f5c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:13.528659 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-913c336f-2263-4d88-b390-ed4ca1442f5c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:13.529095 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-913c336f-2263-4d88-b390-ed4ca1442f5c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:13.555048 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-10b5d36b-536d-4db2-afdb-a83bf145acb4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:13.555966 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-10b5d36b-536d-4db2-afdb-a83bf145acb4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:13.562123 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-10b5d36b-536d-4db2-afdb-a83bf145acb4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:13.562569 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-10b5d36b-536d-4db2-afdb-a83bf145acb4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:13.563348 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-10b5d36b-536d-4db2-afdb-a83bf145acb4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:13.563837 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-10b5d36b-536d-4db2-afdb-a83bf145acb4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:13.593027 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-10b5d36b-536d-4db2-afdb-a83bf145acb4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042473 Mar 03 02:38:13.593588 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 767/1544] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:13 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:13.599758 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ac126d54-f23e-4f57-9a3b-be3d58b58f6a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:13.600653 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ac126d54-f23e-4f57-9a3b-be3d58b58f6a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:13.606174 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ac126d54-f23e-4f57-9a3b-be3d58b58f6a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:13.606624 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ac126d54-f23e-4f57-9a3b-be3d58b58f6a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:13.607403 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ac126d54-f23e-4f57-9a3b-be3d58b58f6a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:13.607859 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ac126d54-f23e-4f57-9a3b-be3d58b58f6a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:13.635751 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ac126d54-f23e-4f57-9a3b-be3d58b58f6a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040528 Mar 03 02:38:13.636307 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 768/1545] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:13 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:13.663950 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-913c336f-2263-4d88-b390-ed4ca1442f5c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:13.672082 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-913c336f-2263-4d88-b390-ed4ca1442f5c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:13.673571 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-913c336f-2263-4d88-b390-ed4ca1442f5c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:13.674733 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-913c336f-2263-4d88-b390-ed4ca1442f5c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.158498 Mar 03 02:38:13.675294 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 778/1546] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:13 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:38:14.094171 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-aff39525-337f-4450-97cd-af5c9c1d5bfd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:14.094771 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-aff39525-337f-4450-97cd-af5c9c1d5bfd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:14.100686 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aff39525-337f-4450-97cd-af5c9c1d5bfd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:14.101120 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aff39525-337f-4450-97cd-af5c9c1d5bfd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:14.101889 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aff39525-337f-4450-97cd-af5c9c1d5bfd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:14.102326 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aff39525-337f-4450-97cd-af5c9c1d5bfd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:14.159488 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-aff39525-337f-4450-97cd-af5c9c1d5bfd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:14.166766 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-aff39525-337f-4450-97cd-af5c9c1d5bfd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.076440 Mar 03 02:38:14.167322 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 769/1547] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:14 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:38:14.434489 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2257bfc1-17ae-4d39-a768-3c81a00b07a9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:14.435402 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2257bfc1-17ae-4d39-a768-3c81a00b07a9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:14.441203 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2257bfc1-17ae-4d39-a768-3c81a00b07a9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:14.441653 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2257bfc1-17ae-4d39-a768-3c81a00b07a9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:14.443197 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2257bfc1-17ae-4d39-a768-3c81a00b07a9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:14.443672 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2257bfc1-17ae-4d39-a768-3c81a00b07a9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:14.470601 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2257bfc1-17ae-4d39-a768-3c81a00b07a9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040112 Mar 03 02:38:14.471142 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 779/1548] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:14 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:14.604696 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8c58c951-c93f-496c-8e33-9c801b93c119 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:14.605526 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8c58c951-c93f-496c-8e33-9c801b93c119 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:14.611717 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8c58c951-c93f-496c-8e33-9c801b93c119 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:14.612165 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8c58c951-c93f-496c-8e33-9c801b93c119 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:14.612935 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8c58c951-c93f-496c-8e33-9c801b93c119 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:14.613364 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8c58c951-c93f-496c-8e33-9c801b93c119 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:14.641448 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8c58c951-c93f-496c-8e33-9c801b93c119 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040768 Mar 03 02:38:14.641992 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 770/1549] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:14 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:14.647199 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2e90190b-d3ea-44fc-b371-1aa9927a9620 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:14.648143 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2e90190b-d3ea-44fc-b371-1aa9927a9620 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:14.654383 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2e90190b-d3ea-44fc-b371-1aa9927a9620 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:14.654834 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2e90190b-d3ea-44fc-b371-1aa9927a9620 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:14.655622 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2e90190b-d3ea-44fc-b371-1aa9927a9620 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:14.656075 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2e90190b-d3ea-44fc-b371-1aa9927a9620 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:14.684912 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2e90190b-d3ea-44fc-b371-1aa9927a9620 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042223 Mar 03 02:38:14.685468 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 780/1550] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:14 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:14.693452 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-dc8f7738-8da1-4435-96a7-f23143df30f1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:14.694049 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-dc8f7738-8da1-4435-96a7-f23143df30f1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:14.699730 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dc8f7738-8da1-4435-96a7-f23143df30f1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:14.700189 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dc8f7738-8da1-4435-96a7-f23143df30f1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:14.700954 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dc8f7738-8da1-4435-96a7-f23143df30f1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:14.701387 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dc8f7738-8da1-4435-96a7-f23143df30f1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:14.832604 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-dc8f7738-8da1-4435-96a7-f23143df30f1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:14.841213 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-dc8f7738-8da1-4435-96a7-f23143df30f1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:14.842703 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-dc8f7738-8da1-4435-96a7-f23143df30f1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:14.843888 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-dc8f7738-8da1-4435-96a7-f23143df30f1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.155119 Mar 03 02:38:14.844445 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 771/1551] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:14 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:38:15.183327 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2445dbc2-cb8b-4b0e-a625-61c73f3d21c5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:15.183955 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2445dbc2-cb8b-4b0e-a625-61c73f3d21c5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:15.189946 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2445dbc2-cb8b-4b0e-a625-61c73f3d21c5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:15.190511 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2445dbc2-cb8b-4b0e-a625-61c73f3d21c5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:15.191285 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2445dbc2-cb8b-4b0e-a625-61c73f3d21c5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:15.191746 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2445dbc2-cb8b-4b0e-a625-61c73f3d21c5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:15.254878 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2445dbc2-cb8b-4b0e-a625-61c73f3d21c5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:15.262345 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2445dbc2-cb8b-4b0e-a625-61c73f3d21c5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.082875 Mar 03 02:38:15.262934 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 781/1552] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:15 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:38:15.481926 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-904ca1c5-6ad7-41b0-a3c7-304cc5cb9d54 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:15.482826 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-904ca1c5-6ad7-41b0-a3c7-304cc5cb9d54 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:15.488681 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-904ca1c5-6ad7-41b0-a3c7-304cc5cb9d54 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:15.489133 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-904ca1c5-6ad7-41b0-a3c7-304cc5cb9d54 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:15.490061 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-904ca1c5-6ad7-41b0-a3c7-304cc5cb9d54 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:15.490446 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-904ca1c5-6ad7-41b0-a3c7-304cc5cb9d54 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:15.517904 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-904ca1c5-6ad7-41b0-a3c7-304cc5cb9d54 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039989 Mar 03 02:38:15.518437 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 772/1553] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:15 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:15.652786 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3643ed47-0c2f-4855-b338-e115bb1625ad tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:15.653694 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3643ed47-0c2f-4855-b338-e115bb1625ad tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:15.659983 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3643ed47-0c2f-4855-b338-e115bb1625ad tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:15.660380 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3643ed47-0c2f-4855-b338-e115bb1625ad tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:15.661158 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3643ed47-0c2f-4855-b338-e115bb1625ad tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:15.662040 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3643ed47-0c2f-4855-b338-e115bb1625ad tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:15.689597 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3643ed47-0c2f-4855-b338-e115bb1625ad tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040738 Mar 03 02:38:15.690151 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 782/1554] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:15 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:15.696791 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-33849210-c923-4fd7-8eda-f1fb1973803e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:15.697677 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-33849210-c923-4fd7-8eda-f1fb1973803e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:15.703835 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-33849210-c923-4fd7-8eda-f1fb1973803e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:15.704282 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-33849210-c923-4fd7-8eda-f1fb1973803e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:15.705160 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-33849210-c923-4fd7-8eda-f1fb1973803e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:15.705628 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-33849210-c923-4fd7-8eda-f1fb1973803e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:15.732542 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-33849210-c923-4fd7-8eda-f1fb1973803e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040142 Mar 03 02:38:15.733079 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 773/1555] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:15 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:15.862624 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-776e6d52-b8c1-479d-bd22-e09419f3959f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:15.863268 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-776e6d52-b8c1-479d-bd22-e09419f3959f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:15.869456 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-776e6d52-b8c1-479d-bd22-e09419f3959f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:15.869909 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-776e6d52-b8c1-479d-bd22-e09419f3959f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:15.870693 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-776e6d52-b8c1-479d-bd22-e09419f3959f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:15.871131 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-776e6d52-b8c1-479d-bd22-e09419f3959f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:15.998544 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-776e6d52-b8c1-479d-bd22-e09419f3959f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:16.007829 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-776e6d52-b8c1-479d-bd22-e09419f3959f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:16.009333 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-776e6d52-b8c1-479d-bd22-e09419f3959f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:16.010500 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-776e6d52-b8c1-479d-bd22-e09419f3959f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.151801 Mar 03 02:38:16.011060 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 783/1556] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:15 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:38:16.279455 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8c7b28bd-ef24-4814-b5ed-0eb99a415735 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:16.280093 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8c7b28bd-ef24-4814-b5ed-0eb99a415735 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:16.285868 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8c7b28bd-ef24-4814-b5ed-0eb99a415735 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:16.286926 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8c7b28bd-ef24-4814-b5ed-0eb99a415735 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:16.287643 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8c7b28bd-ef24-4814-b5ed-0eb99a415735 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:16.288085 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8c7b28bd-ef24-4814-b5ed-0eb99a415735 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:16.345036 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8c7b28bd-ef24-4814-b5ed-0eb99a415735 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:16.352622 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8c7b28bd-ef24-4814-b5ed-0eb99a415735 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.077128 Mar 03 02:38:16.353178 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 774/1557] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:16 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:38:16.530060 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e30cee00-de3c-4ecd-bd57-460e9ab2f1ab tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:16.530901 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e30cee00-de3c-4ecd-bd57-460e9ab2f1ab tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:16.537499 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e30cee00-de3c-4ecd-bd57-460e9ab2f1ab tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:16.537944 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e30cee00-de3c-4ecd-bd57-460e9ab2f1ab tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:16.538720 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e30cee00-de3c-4ecd-bd57-460e9ab2f1ab tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:16.539154 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e30cee00-de3c-4ecd-bd57-460e9ab2f1ab tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:16.567040 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e30cee00-de3c-4ecd-bd57-460e9ab2f1ab tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040993 Mar 03 02:38:16.567708 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 784/1558] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:16 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:16.702494 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-20d9c91c-e380-4a36-9c33-9a5b851a5ed6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:16.703400 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-20d9c91c-e380-4a36-9c33-9a5b851a5ed6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:16.710557 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-20d9c91c-e380-4a36-9c33-9a5b851a5ed6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:16.711003 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-20d9c91c-e380-4a36-9c33-9a5b851a5ed6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:16.711812 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-20d9c91c-e380-4a36-9c33-9a5b851a5ed6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:16.712250 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-20d9c91c-e380-4a36-9c33-9a5b851a5ed6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:16.740875 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-20d9c91c-e380-4a36-9c33-9a5b851a5ed6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042425 Mar 03 02:38:16.741436 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 775/1559] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:16 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:16.744403 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1406d343-2de3-4244-b701-186f64a17798 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:16.745310 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1406d343-2de3-4244-b701-186f64a17798 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:16.751449 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1406d343-2de3-4244-b701-186f64a17798 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:16.751921 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1406d343-2de3-4244-b701-186f64a17798 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:16.752697 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1406d343-2de3-4244-b701-186f64a17798 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:16.753127 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1406d343-2de3-4244-b701-186f64a17798 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:16.780594 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1406d343-2de3-4244-b701-186f64a17798 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040612 Mar 03 02:38:16.781081 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 785/1560] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:16 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:17.028351 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f565f188-9166-4e32-91a5-68cfb3c9ace7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:17.028947 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f565f188-9166-4e32-91a5-68cfb3c9ace7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:17.034960 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f565f188-9166-4e32-91a5-68cfb3c9ace7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:17.035353 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f565f188-9166-4e32-91a5-68cfb3c9ace7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:17.036205 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f565f188-9166-4e32-91a5-68cfb3c9ace7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:17.036641 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f565f188-9166-4e32-91a5-68cfb3c9ace7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:17.167121 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f565f188-9166-4e32-91a5-68cfb3c9ace7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:17.175266 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f565f188-9166-4e32-91a5-68cfb3c9ace7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:17.176902 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f565f188-9166-4e32-91a5-68cfb3c9ace7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:17.178090 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f565f188-9166-4e32-91a5-68cfb3c9ace7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.153703 Mar 03 02:38:17.178641 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 776/1561] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:17 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:38:17.369726 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8fea6e28-4c33-4ed0-bdfc-b74b6a6d46f0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:17.370328 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8fea6e28-4c33-4ed0-bdfc-b74b6a6d46f0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:17.376126 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8fea6e28-4c33-4ed0-bdfc-b74b6a6d46f0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:17.376571 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8fea6e28-4c33-4ed0-bdfc-b74b6a6d46f0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:17.377344 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8fea6e28-4c33-4ed0-bdfc-b74b6a6d46f0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:17.377778 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8fea6e28-4c33-4ed0-bdfc-b74b6a6d46f0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:17.436966 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8fea6e28-4c33-4ed0-bdfc-b74b6a6d46f0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:17.444883 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8fea6e28-4c33-4ed0-bdfc-b74b6a6d46f0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.079214 Mar 03 02:38:17.445451 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 786/1562] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:17 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:38:17.578184 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b8b5584a-77ce-4a85-ad22-60744a8cdf16 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:17.579329 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b8b5584a-77ce-4a85-ad22-60744a8cdf16 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:17.585267 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b8b5584a-77ce-4a85-ad22-60744a8cdf16 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:17.585712 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b8b5584a-77ce-4a85-ad22-60744a8cdf16 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:17.586482 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b8b5584a-77ce-4a85-ad22-60744a8cdf16 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:17.586913 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b8b5584a-77ce-4a85-ad22-60744a8cdf16 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:17.613648 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b8b5584a-77ce-4a85-ad22-60744a8cdf16 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039356 Mar 03 02:38:17.614186 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 777/1563] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:17 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:17.752492 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3d1b761b-5a89-4998-b317-9f9fc8611ff9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:17.753360 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3d1b761b-5a89-4998-b317-9f9fc8611ff9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:17.760628 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3d1b761b-5a89-4998-b317-9f9fc8611ff9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:17.761075 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3d1b761b-5a89-4998-b317-9f9fc8611ff9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:17.761849 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3d1b761b-5a89-4998-b317-9f9fc8611ff9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:17.762278 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3d1b761b-5a89-4998-b317-9f9fc8611ff9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:17.791355 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3d1b761b-5a89-4998-b317-9f9fc8611ff9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042840 Mar 03 02:38:17.791946 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 787/1564] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:17 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:17.792597 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-cf40c32b-b410-41cf-b5dc-676bf59e0bcd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:17.793500 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-cf40c32b-b410-41cf-b5dc-676bf59e0bcd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:17.799589 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cf40c32b-b410-41cf-b5dc-676bf59e0bcd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:17.800064 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cf40c32b-b410-41cf-b5dc-676bf59e0bcd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:17.800832 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cf40c32b-b410-41cf-b5dc-676bf59e0bcd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:17.801261 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cf40c32b-b410-41cf-b5dc-676bf59e0bcd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:17.828715 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-cf40c32b-b410-41cf-b5dc-676bf59e0bcd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040001 Mar 03 02:38:17.829313 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 778/1565] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:17 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:18.195993 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ce58bd61-49a6-4c88-b0cc-0478609d3b40 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:18.196587 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ce58bd61-49a6-4c88-b0cc-0478609d3b40 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:18.202410 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ce58bd61-49a6-4c88-b0cc-0478609d3b40 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:18.202857 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ce58bd61-49a6-4c88-b0cc-0478609d3b40 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:18.203643 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ce58bd61-49a6-4c88-b0cc-0478609d3b40 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:18.204078 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ce58bd61-49a6-4c88-b0cc-0478609d3b40 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:18.336211 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ce58bd61-49a6-4c88-b0cc-0478609d3b40 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:18.344210 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ce58bd61-49a6-4c88-b0cc-0478609d3b40 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:18.345815 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ce58bd61-49a6-4c88-b0cc-0478609d3b40 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:18.346964 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ce58bd61-49a6-4c88-b0cc-0478609d3b40 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.154966 Mar 03 02:38:18.347521 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 788/1566] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:18 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:38:18.461391 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1c7a9724-5115-48a8-9e7f-8dc51f749761 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:18.462005 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1c7a9724-5115-48a8-9e7f-8dc51f749761 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:18.467892 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1c7a9724-5115-48a8-9e7f-8dc51f749761 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:18.468337 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1c7a9724-5115-48a8-9e7f-8dc51f749761 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:18.469137 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1c7a9724-5115-48a8-9e7f-8dc51f749761 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:18.469567 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1c7a9724-5115-48a8-9e7f-8dc51f749761 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:18.528267 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1c7a9724-5115-48a8-9e7f-8dc51f749761 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:18.535346 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1c7a9724-5115-48a8-9e7f-8dc51f749761 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078533 Mar 03 02:38:18.535942 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 779/1567] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:18 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:38:18.624803 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4fffc68e-1136-452b-be26-2b10d25e7e67 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:18.625648 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4fffc68e-1136-452b-be26-2b10d25e7e67 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:18.632221 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4fffc68e-1136-452b-be26-2b10d25e7e67 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:18.632678 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4fffc68e-1136-452b-be26-2b10d25e7e67 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:18.633465 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4fffc68e-1136-452b-be26-2b10d25e7e67 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:18.633907 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4fffc68e-1136-452b-be26-2b10d25e7e67 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:18.663233 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4fffc68e-1136-452b-be26-2b10d25e7e67 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042232 Mar 03 02:38:18.664016 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 789/1568] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:18 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:18.802962 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a5fa0c22-28ed-4fad-8d5b-e84d6e925a26 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:18.803889 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a5fa0c22-28ed-4fad-8d5b-e84d6e925a26 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:18.810158 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a5fa0c22-28ed-4fad-8d5b-e84d6e925a26 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:18.810608 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a5fa0c22-28ed-4fad-8d5b-e84d6e925a26 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:18.811382 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a5fa0c22-28ed-4fad-8d5b-e84d6e925a26 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:18.811844 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a5fa0c22-28ed-4fad-8d5b-e84d6e925a26 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:18.840433 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5051f31d-0a1c-4e62-b353-4c9d21f71d22 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:18.841160 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a5fa0c22-28ed-4fad-8d5b-e84d6e925a26 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042719 Mar 03 02:38:18.841347 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5051f31d-0a1c-4e62-b353-4c9d21f71d22 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:18.841915 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 780/1569] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:18 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:18.847495 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5051f31d-0a1c-4e62-b353-4c9d21f71d22 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:18.847974 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5051f31d-0a1c-4e62-b353-4c9d21f71d22 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:18.848834 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5051f31d-0a1c-4e62-b353-4c9d21f71d22 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:18.849267 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5051f31d-0a1c-4e62-b353-4c9d21f71d22 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:18.877132 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5051f31d-0a1c-4e62-b353-4c9d21f71d22 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040358 Mar 03 02:38:18.877605 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 790/1570] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:18 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:19.366110 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-fe1125bb-a2a2-44b3-b1ed-b06bbb833870 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:19.366708 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-fe1125bb-a2a2-44b3-b1ed-b06bbb833870 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:19.372756 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fe1125bb-a2a2-44b3-b1ed-b06bbb833870 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:19.373205 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fe1125bb-a2a2-44b3-b1ed-b06bbb833870 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:19.374011 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fe1125bb-a2a2-44b3-b1ed-b06bbb833870 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:19.374448 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fe1125bb-a2a2-44b3-b1ed-b06bbb833870 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:19.501804 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-fe1125bb-a2a2-44b3-b1ed-b06bbb833870 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:19.510053 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-fe1125bb-a2a2-44b3-b1ed-b06bbb833870 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:19.511553 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-fe1125bb-a2a2-44b3-b1ed-b06bbb833870 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:19.512723 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-fe1125bb-a2a2-44b3-b1ed-b06bbb833870 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.151181 Mar 03 02:38:19.513274 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 781/1571] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:19 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:38:19.553306 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2ae914e1-fe79-4978-a4f9-ed6b2e79a4b5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:19.553917 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2ae914e1-fe79-4978-a4f9-ed6b2e79a4b5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:19.559776 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2ae914e1-fe79-4978-a4f9-ed6b2e79a4b5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:19.560234 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2ae914e1-fe79-4978-a4f9-ed6b2e79a4b5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:19.561030 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2ae914e1-fe79-4978-a4f9-ed6b2e79a4b5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:19.561473 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2ae914e1-fe79-4978-a4f9-ed6b2e79a4b5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:19.619333 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2ae914e1-fe79-4978-a4f9-ed6b2e79a4b5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:19.626608 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2ae914e1-fe79-4978-a4f9-ed6b2e79a4b5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078118 Mar 03 02:38:19.627179 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 791/1572] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:19 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:38:19.674284 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ecb73bf4-de3f-4790-8204-42b8bc8078eb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:19.675318 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ecb73bf4-de3f-4790-8204-42b8bc8078eb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:19.681315 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ecb73bf4-de3f-4790-8204-42b8bc8078eb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:19.681770 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ecb73bf4-de3f-4790-8204-42b8bc8078eb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:19.682560 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ecb73bf4-de3f-4790-8204-42b8bc8078eb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:19.683003 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ecb73bf4-de3f-4790-8204-42b8bc8078eb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:19.711469 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ecb73bf4-de3f-4790-8204-42b8bc8078eb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041078 Mar 03 02:38:19.712059 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 782/1573] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:19 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:19.853408 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d8e18963-1c2d-4e48-b421-836222869764 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:19.854313 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d8e18963-1c2d-4e48-b421-836222869764 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:19.860555 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d8e18963-1c2d-4e48-b421-836222869764 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:19.860999 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d8e18963-1c2d-4e48-b421-836222869764 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:19.861769 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d8e18963-1c2d-4e48-b421-836222869764 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:19.862203 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d8e18963-1c2d-4e48-b421-836222869764 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:19.889366 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-30c93742-4e19-4ca4-8498-51664e710b1f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:19.889961 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d8e18963-1c2d-4e48-b421-836222869764 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041266 Mar 03 02:38:19.890220 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-30c93742-4e19-4ca4-8498-51664e710b1f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:19.890515 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 792/1574] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:19 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:19.897094 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-30c93742-4e19-4ca4-8498-51664e710b1f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:19.897538 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-30c93742-4e19-4ca4-8498-51664e710b1f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:19.898320 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-30c93742-4e19-4ca4-8498-51664e710b1f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:19.898754 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-30c93742-4e19-4ca4-8498-51664e710b1f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:19.926300 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-30c93742-4e19-4ca4-8498-51664e710b1f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040949 Mar 03 02:38:19.926842 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 783/1575] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:19 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:20.531498 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-149f5b63-64dc-4d74-a466-4fe53a7a36ee tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:20.532136 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-149f5b63-64dc-4d74-a466-4fe53a7a36ee tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:20.538934 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-149f5b63-64dc-4d74-a466-4fe53a7a36ee tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:20.539391 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-149f5b63-64dc-4d74-a466-4fe53a7a36ee tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:20.540200 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-149f5b63-64dc-4d74-a466-4fe53a7a36ee tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:20.540643 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-149f5b63-64dc-4d74-a466-4fe53a7a36ee tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:20.643472 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-55bd3db3-c2db-486f-a0be-8ff1aba53b2b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:20.644201 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-55bd3db3-c2db-486f-a0be-8ff1aba53b2b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:20.650765 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-55bd3db3-c2db-486f-a0be-8ff1aba53b2b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:20.651212 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-55bd3db3-c2db-486f-a0be-8ff1aba53b2b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:20.652016 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-55bd3db3-c2db-486f-a0be-8ff1aba53b2b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:20.652442 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-55bd3db3-c2db-486f-a0be-8ff1aba53b2b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:20.669191 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-149f5b63-64dc-4d74-a466-4fe53a7a36ee tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:20.677340 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-149f5b63-64dc-4d74-a466-4fe53a7a36ee tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:20.679476 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-149f5b63-64dc-4d74-a466-4fe53a7a36ee tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:20.680675 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-149f5b63-64dc-4d74-a466-4fe53a7a36ee tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.153096 Mar 03 02:38:20.681244 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 793/1576] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:20 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:38:20.714745 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-55bd3db3-c2db-486f-a0be-8ff1aba53b2b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:20.722105 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-55bd3db3-c2db-486f-a0be-8ff1aba53b2b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.082694 Mar 03 02:38:20.722320 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-72a8e5f4-d147-4acf-b7a4-d14cafecf05b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:20.722657 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 784/1577] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:20 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:38:20.723235 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-72a8e5f4-d147-4acf-b7a4-d14cafecf05b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:20.730732 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-72a8e5f4-d147-4acf-b7a4-d14cafecf05b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:20.731183 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-72a8e5f4-d147-4acf-b7a4-d14cafecf05b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:20.731998 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-72a8e5f4-d147-4acf-b7a4-d14cafecf05b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:20.732438 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-72a8e5f4-d147-4acf-b7a4-d14cafecf05b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:20.760649 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-72a8e5f4-d147-4acf-b7a4-d14cafecf05b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042268 Mar 03 02:38:20.761209 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 794/1578] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:20 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:20.901934 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7f272553-1e4d-4f89-ae32-a06c627a0109 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:20.902848 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7f272553-1e4d-4f89-ae32-a06c627a0109 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:20.909003 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7f272553-1e4d-4f89-ae32-a06c627a0109 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:20.909448 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7f272553-1e4d-4f89-ae32-a06c627a0109 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:20.910223 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7f272553-1e4d-4f89-ae32-a06c627a0109 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:20.910686 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7f272553-1e4d-4f89-ae32-a06c627a0109 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:20.937693 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8351ced1-1ce5-485d-bdf5-b5699f418e7a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:20.938258 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7f272553-1e4d-4f89-ae32-a06c627a0109 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040545 Mar 03 02:38:20.939141 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 785/1579] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:20 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:20.939302 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8351ced1-1ce5-485d-bdf5-b5699f418e7a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:20.946112 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8351ced1-1ce5-485d-bdf5-b5699f418e7a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:20.946559 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8351ced1-1ce5-485d-bdf5-b5699f418e7a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:20.947338 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8351ced1-1ce5-485d-bdf5-b5699f418e7a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:20.947799 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8351ced1-1ce5-485d-bdf5-b5699f418e7a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:20.975259 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8351ced1-1ce5-485d-bdf5-b5699f418e7a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041413 Mar 03 02:38:20.976100 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 795/1580] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:20 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:21.699023 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9d73c8b6-c83a-4974-b53e-ab701f594773 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:21.699544 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9d73c8b6-c83a-4974-b53e-ab701f594773 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:21.705456 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9d73c8b6-c83a-4974-b53e-ab701f594773 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:21.705906 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9d73c8b6-c83a-4974-b53e-ab701f594773 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:21.706686 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9d73c8b6-c83a-4974-b53e-ab701f594773 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:21.707122 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9d73c8b6-c83a-4974-b53e-ab701f594773 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:21.739882 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6668ce28-ff0e-4ab4-8891-4df1dc7ac45e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:21.740497 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6668ce28-ff0e-4ab4-8891-4df1dc7ac45e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:21.747860 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6668ce28-ff0e-4ab4-8891-4df1dc7ac45e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:21.748315 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6668ce28-ff0e-4ab4-8891-4df1dc7ac45e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:21.749107 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6668ce28-ff0e-4ab4-8891-4df1dc7ac45e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:21.749548 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6668ce28-ff0e-4ab4-8891-4df1dc7ac45e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:21.811379 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-6668ce28-ff0e-4ab4-8891-4df1dc7ac45e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:21.818978 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6668ce28-ff0e-4ab4-8891-4df1dc7ac45e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.082953 Mar 03 02:38:21.819837 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 796/1581] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:21 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:38:21.824736 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-346510a5-64cf-4aa4-9a64-b23324c94b4d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:21.825708 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-346510a5-64cf-4aa4-9a64-b23324c94b4d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:21.831775 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-346510a5-64cf-4aa4-9a64-b23324c94b4d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:21.832252 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-346510a5-64cf-4aa4-9a64-b23324c94b4d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:21.833109 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-346510a5-64cf-4aa4-9a64-b23324c94b4d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:21.833582 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-346510a5-64cf-4aa4-9a64-b23324c94b4d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:21.843313 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9d73c8b6-c83a-4974-b53e-ab701f594773 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:21.852218 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9d73c8b6-c83a-4974-b53e-ab701f594773 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:21.853706 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9d73c8b6-c83a-4974-b53e-ab701f594773 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:21.855317 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9d73c8b6-c83a-4974-b53e-ab701f594773 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.160233 Mar 03 02:38:21.856094 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 786/1582] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:21 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:38:21.863010 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-346510a5-64cf-4aa4-9a64-b23324c94b4d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042209 Mar 03 02:38:21.863570 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 797/1583] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:21 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:21.948814 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c017061e-2bea-4c4f-95fc-b5da06388979 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:21.949787 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c017061e-2bea-4c4f-95fc-b5da06388979 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:21.955441 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c017061e-2bea-4c4f-95fc-b5da06388979 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:21.955919 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c017061e-2bea-4c4f-95fc-b5da06388979 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:21.956689 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c017061e-2bea-4c4f-95fc-b5da06388979 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:21.957120 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c017061e-2bea-4c4f-95fc-b5da06388979 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:21.985072 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c017061e-2bea-4c4f-95fc-b5da06388979 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040118 Mar 03 02:38:21.985615 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 787/1584] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:21 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:21.986926 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-01cff351-5906-4a92-987c-08d69f846622 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:21.987878 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-01cff351-5906-4a92-987c-08d69f846622 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:21.994682 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-01cff351-5906-4a92-987c-08d69f846622 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:21.995136 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-01cff351-5906-4a92-987c-08d69f846622 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:21.995961 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-01cff351-5906-4a92-987c-08d69f846622 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:21.996406 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-01cff351-5906-4a92-987c-08d69f846622 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:22.024592 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-01cff351-5906-4a92-987c-08d69f846622 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041683 Mar 03 02:38:22.025149 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 798/1585] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:21 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:22.836227 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b6f06484-d634-4bea-81c2-5627cc0677b1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:22.836829 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b6f06484-d634-4bea-81c2-5627cc0677b1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:22.843181 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b6f06484-d634-4bea-81c2-5627cc0677b1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:22.843734 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b6f06484-d634-4bea-81c2-5627cc0677b1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:22.844527 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b6f06484-d634-4bea-81c2-5627cc0677b1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:22.845000 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b6f06484-d634-4bea-81c2-5627cc0677b1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:22.874306 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-201b4f58-3cd0-4940-96b6-fa6ff1f2b0ab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:22.874911 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-201b4f58-3cd0-4940-96b6-fa6ff1f2b0ab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:22.880928 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-201b4f58-3cd0-4940-96b6-fa6ff1f2b0ab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:22.882196 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-201b4f58-3cd0-4940-96b6-fa6ff1f2b0ab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:22.882995 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-201b4f58-3cd0-4940-96b6-fa6ff1f2b0ab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:22.883436 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-201b4f58-3cd0-4940-96b6-fa6ff1f2b0ab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:22.903579 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b6f06484-d634-4bea-81c2-5627cc0677b1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:22.911021 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b6f06484-d634-4bea-81c2-5627cc0677b1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.079167 Mar 03 02:38:22.911700 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 788/1586] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:22 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:38:22.917039 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-cee90e46-d429-446b-a16a-97e703ebeda5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:22.918024 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-cee90e46-d429-446b-a16a-97e703ebeda5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:22.923897 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cee90e46-d429-446b-a16a-97e703ebeda5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:22.924440 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cee90e46-d429-446b-a16a-97e703ebeda5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:22.925298 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cee90e46-d429-446b-a16a-97e703ebeda5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:22.925843 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cee90e46-d429-446b-a16a-97e703ebeda5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:22.956203 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-cee90e46-d429-446b-a16a-97e703ebeda5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043333 Mar 03 02:38:22.956891 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 789/1587] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:22 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:22.996984 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2aa02638-229f-4927-b917-fe8d9b4d6bd2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:22.997923 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2aa02638-229f-4927-b917-fe8d9b4d6bd2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:23.004203 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2aa02638-229f-4927-b917-fe8d9b4d6bd2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:23.004655 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2aa02638-229f-4927-b917-fe8d9b4d6bd2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:23.005441 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2aa02638-229f-4927-b917-fe8d9b4d6bd2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:23.005878 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2aa02638-229f-4927-b917-fe8d9b4d6bd2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:23.018936 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-201b4f58-3cd0-4940-96b6-fa6ff1f2b0ab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:23.027715 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-201b4f58-3cd0-4940-96b6-fa6ff1f2b0ab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:23.029225 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-201b4f58-3cd0-4940-96b6-fa6ff1f2b0ab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:23.030393 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-201b4f58-3cd0-4940-96b6-fa6ff1f2b0ab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.159915 Mar 03 02:38:23.031239 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 799/1588] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:22 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:38:23.035797 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2aa02638-229f-4927-b917-fe8d9b4d6bd2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042892 Mar 03 02:38:23.035949 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9f1da1b3-93a3-4d43-a9db-77c353e13cd4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:23.036355 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 790/1589] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:22 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:23.036856 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9f1da1b3-93a3-4d43-a9db-77c353e13cd4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:23.044824 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9f1da1b3-93a3-4d43-a9db-77c353e13cd4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:23.045570 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9f1da1b3-93a3-4d43-a9db-77c353e13cd4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:23.046579 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9f1da1b3-93a3-4d43-a9db-77c353e13cd4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:23.047230 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9f1da1b3-93a3-4d43-a9db-77c353e13cd4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:23.077922 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9f1da1b3-93a3-4d43-a9db-77c353e13cd4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045502 Mar 03 02:38:23.078475 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 800/1590] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:23 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:23.927543 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6fc97988-2b27-4e9b-86b1-5310e278b781 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:23.928209 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6fc97988-2b27-4e9b-86b1-5310e278b781 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:23.934482 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6fc97988-2b27-4e9b-86b1-5310e278b781 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:23.934928 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6fc97988-2b27-4e9b-86b1-5310e278b781 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:23.935761 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6fc97988-2b27-4e9b-86b1-5310e278b781 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:23.936193 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6fc97988-2b27-4e9b-86b1-5310e278b781 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:23.968542 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4790600d-e4e1-41e2-a1e8-4bc00105e3f4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:23.969538 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4790600d-e4e1-41e2-a1e8-4bc00105e3f4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:23.975475 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4790600d-e4e1-41e2-a1e8-4bc00105e3f4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:23.976180 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4790600d-e4e1-41e2-a1e8-4bc00105e3f4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:23.976982 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4790600d-e4e1-41e2-a1e8-4bc00105e3f4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:23.977423 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4790600d-e4e1-41e2-a1e8-4bc00105e3f4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:23.994016 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6fc97988-2b27-4e9b-86b1-5310e278b781 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:24.001372 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6fc97988-2b27-4e9b-86b1-5310e278b781 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.077625 Mar 03 02:38:24.002310 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 791/1591] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:23 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:38:24.008290 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4790600d-e4e1-41e2-a1e8-4bc00105e3f4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043648 Mar 03 02:38:24.008860 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 801/1592] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:23 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:24.047893 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a796e704-5b49-482c-8140-dbb2b814587c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:24.048806 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a796e704-5b49-482c-8140-dbb2b814587c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:24.048922 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-99662981-640d-4f4f-9bfd-dffaea83fa6a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:24.049542 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-99662981-640d-4f4f-9bfd-dffaea83fa6a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:24.055442 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-99662981-640d-4f4f-9bfd-dffaea83fa6a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:24.055593 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a796e704-5b49-482c-8140-dbb2b814587c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:24.055924 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a796e704-5b49-482c-8140-dbb2b814587c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:24.056038 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-99662981-640d-4f4f-9bfd-dffaea83fa6a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:24.056711 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a796e704-5b49-482c-8140-dbb2b814587c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:24.056825 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-99662981-640d-4f4f-9bfd-dffaea83fa6a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:24.057153 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a796e704-5b49-482c-8140-dbb2b814587c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:24.057262 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-99662981-640d-4f4f-9bfd-dffaea83fa6a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:24.086592 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a796e704-5b49-482c-8140-dbb2b814587c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042542 Mar 03 02:38:24.087154 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 792/1593] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:24 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:24.093081 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-889734ae-2deb-49a9-9794-73ef5facb97a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:24.093976 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-889734ae-2deb-49a9-9794-73ef5facb97a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:24.099555 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-889734ae-2deb-49a9-9794-73ef5facb97a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:24.100080 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-889734ae-2deb-49a9-9794-73ef5facb97a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:24.100880 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-889734ae-2deb-49a9-9794-73ef5facb97a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:24.101320 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-889734ae-2deb-49a9-9794-73ef5facb97a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:24.129314 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-889734ae-2deb-49a9-9794-73ef5facb97a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041117 Mar 03 02:38:24.129872 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 793/1594] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:24 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:24.187473 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-99662981-640d-4f4f-9bfd-dffaea83fa6a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:24.196174 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-99662981-640d-4f4f-9bfd-dffaea83fa6a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:24.197659 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-99662981-640d-4f4f-9bfd-dffaea83fa6a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:24.198801 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-99662981-640d-4f4f-9bfd-dffaea83fa6a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.153754 Mar 03 02:38:24.199359 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 802/1595] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:24 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:38:25.018736 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f5694f94-0785-4a3b-97fb-4dac4f4c7f1c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:25.019489 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f5694f94-0785-4a3b-97fb-4dac4f4c7f1c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:25.019639 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-449bc03c-2dea-4cf2-9164-310e71daf5e5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:25.020475 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-449bc03c-2dea-4cf2-9164-310e71daf5e5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:25.026128 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f5694f94-0785-4a3b-97fb-4dac4f4c7f1c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:25.026513 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-449bc03c-2dea-4cf2-9164-310e71daf5e5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:25.026638 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f5694f94-0785-4a3b-97fb-4dac4f4c7f1c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:25.026958 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-449bc03c-2dea-4cf2-9164-310e71daf5e5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:25.027355 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f5694f94-0785-4a3b-97fb-4dac4f4c7f1c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:25.027830 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-449bc03c-2dea-4cf2-9164-310e71daf5e5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:25.027950 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f5694f94-0785-4a3b-97fb-4dac4f4c7f1c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:25.028267 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-449bc03c-2dea-4cf2-9164-310e71daf5e5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:25.056834 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-449bc03c-2dea-4cf2-9164-310e71daf5e5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041246 Mar 03 02:38:25.057724 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 803/1596] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:25 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:25.090312 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f5694f94-0785-4a3b-97fb-4dac4f4c7f1c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:25.097699 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f5694f94-0785-4a3b-97fb-4dac4f4c7f1c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.083066 Mar 03 02:38:25.098050 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5dae7567-fc5d-4484-84ea-4be967e18dcd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:25.098259 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 794/1597] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:25 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:38:25.098960 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5dae7567-fc5d-4484-84ea-4be967e18dcd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:25.104750 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5dae7567-fc5d-4484-84ea-4be967e18dcd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:25.105193 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5dae7567-fc5d-4484-84ea-4be967e18dcd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:25.105972 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5dae7567-fc5d-4484-84ea-4be967e18dcd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:25.106405 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5dae7567-fc5d-4484-84ea-4be967e18dcd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:25.135124 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5dae7567-fc5d-4484-84ea-4be967e18dcd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040991 Mar 03 02:38:25.135712 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 804/1598] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:25 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:25.141721 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c76206c4-7410-411e-a45c-b67d6b6ff533 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:25.142711 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c76206c4-7410-411e-a45c-b67d6b6ff533 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:25.148648 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c76206c4-7410-411e-a45c-b67d6b6ff533 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:25.149105 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c76206c4-7410-411e-a45c-b67d6b6ff533 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:25.149884 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c76206c4-7410-411e-a45c-b67d6b6ff533 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:25.150320 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c76206c4-7410-411e-a45c-b67d6b6ff533 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:25.176939 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c76206c4-7410-411e-a45c-b67d6b6ff533 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039109 Mar 03 02:38:25.177483 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 795/1599] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:25 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:25.216663 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-83135f0d-7cf7-4038-8382-4b75ae48dbf9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:25.217274 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-83135f0d-7cf7-4038-8382-4b75ae48dbf9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:25.223015 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-83135f0d-7cf7-4038-8382-4b75ae48dbf9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:25.223457 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-83135f0d-7cf7-4038-8382-4b75ae48dbf9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:25.224300 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-83135f0d-7cf7-4038-8382-4b75ae48dbf9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:25.224739 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-83135f0d-7cf7-4038-8382-4b75ae48dbf9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:25.357050 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-83135f0d-7cf7-4038-8382-4b75ae48dbf9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:25.365161 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-83135f0d-7cf7-4038-8382-4b75ae48dbf9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:25.367417 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-83135f0d-7cf7-4038-8382-4b75ae48dbf9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:25.368617 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-83135f0d-7cf7-4038-8382-4b75ae48dbf9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.155972 Mar 03 02:38:25.369448 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 805/1600] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:25 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:38:26.068312 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-66c9d292-4f02-4e6c-9d6d-fe59481563a2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:26.069764 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-66c9d292-4f02-4e6c-9d6d-fe59481563a2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:26.076011 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-66c9d292-4f02-4e6c-9d6d-fe59481563a2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:26.076455 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-66c9d292-4f02-4e6c-9d6d-fe59481563a2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:26.077224 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-66c9d292-4f02-4e6c-9d6d-fe59481563a2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:26.077656 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-66c9d292-4f02-4e6c-9d6d-fe59481563a2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:26.106441 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-66c9d292-4f02-4e6c-9d6d-fe59481563a2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042147 Mar 03 02:38:26.106984 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 796/1601] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:26 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:26.114069 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-792f9ad8-4f8a-417f-b012-b1499610fa9b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:26.114680 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-792f9ad8-4f8a-417f-b012-b1499610fa9b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:26.121940 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-792f9ad8-4f8a-417f-b012-b1499610fa9b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:26.122422 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-792f9ad8-4f8a-417f-b012-b1499610fa9b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:26.123210 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-792f9ad8-4f8a-417f-b012-b1499610fa9b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:26.123678 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-792f9ad8-4f8a-417f-b012-b1499610fa9b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:26.146212 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7c631fc9-bf1a-4465-a97c-c510a8033b62 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:26.148351 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7c631fc9-bf1a-4465-a97c-c510a8033b62 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:26.154074 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c631fc9-bf1a-4465-a97c-c510a8033b62 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:26.154526 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c631fc9-bf1a-4465-a97c-c510a8033b62 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:26.155311 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c631fc9-bf1a-4465-a97c-c510a8033b62 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:26.155774 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c631fc9-bf1a-4465-a97c-c510a8033b62 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:26.183247 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-792f9ad8-4f8a-417f-b012-b1499610fa9b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:26.184504 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7c631fc9-bf1a-4465-a97c-c510a8033b62 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042114 Mar 03 02:38:26.185236 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 797/1602] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:26 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:26.189569 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c0083e0b-16c8-4f26-8277-ceaf2b17149b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:26.190455 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c0083e0b-16c8-4f26-8277-ceaf2b17149b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:26.191058 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-792f9ad8-4f8a-417f-b012-b1499610fa9b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.080692 Mar 03 02:38:26.191645 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 806/1603] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:26 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:38:26.197160 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c0083e0b-16c8-4f26-8277-ceaf2b17149b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:26.197610 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c0083e0b-16c8-4f26-8277-ceaf2b17149b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:26.198390 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c0083e0b-16c8-4f26-8277-ceaf2b17149b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:26.198828 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c0083e0b-16c8-4f26-8277-ceaf2b17149b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:26.227134 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c0083e0b-16c8-4f26-8277-ceaf2b17149b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041066 Mar 03 02:38:26.227700 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 798/1604] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:26 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:26.387223 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-194835d6-eed1-4c9e-be57-851b68c172c7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:26.387844 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-194835d6-eed1-4c9e-be57-851b68c172c7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:26.393560 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-194835d6-eed1-4c9e-be57-851b68c172c7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:26.394006 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-194835d6-eed1-4c9e-be57-851b68c172c7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:26.394773 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-194835d6-eed1-4c9e-be57-851b68c172c7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:26.395204 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-194835d6-eed1-4c9e-be57-851b68c172c7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:26.522715 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-194835d6-eed1-4c9e-be57-851b68c172c7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:26.530802 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-194835d6-eed1-4c9e-be57-851b68c172c7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:26.532366 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-194835d6-eed1-4c9e-be57-851b68c172c7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:26.533512 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-194835d6-eed1-4c9e-be57-851b68c172c7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.150195 Mar 03 02:38:26.534183 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 807/1605] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:26 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:38:27.119330 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-11d4943c-0d3f-426b-adfb-2142e6d9ffc3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:27.120260 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-11d4943c-0d3f-426b-adfb-2142e6d9ffc3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:27.126484 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-11d4943c-0d3f-426b-adfb-2142e6d9ffc3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:27.126934 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-11d4943c-0d3f-426b-adfb-2142e6d9ffc3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:27.127747 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-11d4943c-0d3f-426b-adfb-2142e6d9ffc3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:27.128187 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-11d4943c-0d3f-426b-adfb-2142e6d9ffc3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:27.155935 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-11d4943c-0d3f-426b-adfb-2142e6d9ffc3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041961 Mar 03 02:38:27.156476 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 799/1606] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:27 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:27.195811 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ab33a3c1-7f1a-46d3-b1ea-dcd795334022 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:27.196722 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ab33a3c1-7f1a-46d3-b1ea-dcd795334022 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:27.202921 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ab33a3c1-7f1a-46d3-b1ea-dcd795334022 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:27.203383 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ab33a3c1-7f1a-46d3-b1ea-dcd795334022 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:27.204197 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ab33a3c1-7f1a-46d3-b1ea-dcd795334022 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:27.204636 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ab33a3c1-7f1a-46d3-b1ea-dcd795334022 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:27.207907 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f320576a-aa86-4cc5-9ce0-0b23b811d627 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:27.208509 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f320576a-aa86-4cc5-9ce0-0b23b811d627 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:27.214752 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f320576a-aa86-4cc5-9ce0-0b23b811d627 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:27.215195 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f320576a-aa86-4cc5-9ce0-0b23b811d627 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:27.215990 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f320576a-aa86-4cc5-9ce0-0b23b811d627 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:27.216422 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f320576a-aa86-4cc5-9ce0-0b23b811d627 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:27.233840 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ab33a3c1-7f1a-46d3-b1ea-dcd795334022 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042009 Mar 03 02:38:27.234414 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 808/1607] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:27 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:27.238957 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-cefdb51e-c211-4a2e-9537-f144bf028782 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:27.239884 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-cefdb51e-c211-4a2e-9537-f144bf028782 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:27.245964 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cefdb51e-c211-4a2e-9537-f144bf028782 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:27.246422 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cefdb51e-c211-4a2e-9537-f144bf028782 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:27.247219 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cefdb51e-c211-4a2e-9537-f144bf028782 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:27.247687 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cefdb51e-c211-4a2e-9537-f144bf028782 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:27.277270 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f320576a-aa86-4cc5-9ce0-0b23b811d627 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:27.277616 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-cefdb51e-c211-4a2e-9537-f144bf028782 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042188 Mar 03 02:38:27.278193 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 809/1608] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:27 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:27.284624 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f320576a-aa86-4cc5-9ce0-0b23b811d627 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.080399 Mar 03 02:38:27.285175 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 800/1609] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:27 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:38:27.551790 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c1e76e2b-47fa-4e7b-b4e7-15893f510438 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:27.552395 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c1e76e2b-47fa-4e7b-b4e7-15893f510438 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:27.558312 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c1e76e2b-47fa-4e7b-b4e7-15893f510438 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:27.558758 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c1e76e2b-47fa-4e7b-b4e7-15893f510438 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:27.559535 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c1e76e2b-47fa-4e7b-b4e7-15893f510438 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:27.559997 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c1e76e2b-47fa-4e7b-b4e7-15893f510438 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:27.690439 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c1e76e2b-47fa-4e7b-b4e7-15893f510438 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:27.699110 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c1e76e2b-47fa-4e7b-b4e7-15893f510438 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:27.700640 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c1e76e2b-47fa-4e7b-b4e7-15893f510438 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:27.701776 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c1e76e2b-47fa-4e7b-b4e7-15893f510438 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.153892 Mar 03 02:38:27.702328 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 810/1610] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:27 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:38:28.167205 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7680057d-bde0-4104-a9ea-413f061ba0dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:28.168127 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7680057d-bde0-4104-a9ea-413f061ba0dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:28.174287 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7680057d-bde0-4104-a9ea-413f061ba0dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:28.174743 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7680057d-bde0-4104-a9ea-413f061ba0dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:28.175494 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7680057d-bde0-4104-a9ea-413f061ba0dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:28.175947 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7680057d-bde0-4104-a9ea-413f061ba0dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:28.203869 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7680057d-bde0-4104-a9ea-413f061ba0dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040556 Mar 03 02:38:28.204404 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 801/1611] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:28 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:28.246492 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-eea7b5c4-1563-4e67-bae4-781fe7e9beb7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:28.247405 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-eea7b5c4-1563-4e67-bae4-781fe7e9beb7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:28.253663 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eea7b5c4-1563-4e67-bae4-781fe7e9beb7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:28.254111 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eea7b5c4-1563-4e67-bae4-781fe7e9beb7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:28.254883 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eea7b5c4-1563-4e67-bae4-781fe7e9beb7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:28.255315 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eea7b5c4-1563-4e67-bae4-781fe7e9beb7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:28.283208 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-eea7b5c4-1563-4e67-bae4-781fe7e9beb7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041008 Mar 03 02:38:28.283785 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 811/1612] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:28 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:28.289841 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-18345558-da77-48a6-8975-51d6425d82b2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:28.290767 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-18345558-da77-48a6-8975-51d6425d82b2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:28.296488 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-18345558-da77-48a6-8975-51d6425d82b2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:28.296932 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-18345558-da77-48a6-8975-51d6425d82b2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:28.297699 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-18345558-da77-48a6-8975-51d6425d82b2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:28.298129 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-18345558-da77-48a6-8975-51d6425d82b2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:28.301779 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1796e9af-82d1-4e0c-ac0a-2e66e443460d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:28.302435 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1796e9af-82d1-4e0c-ac0a-2e66e443460d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:28.308662 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1796e9af-82d1-4e0c-ac0a-2e66e443460d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:28.309115 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1796e9af-82d1-4e0c-ac0a-2e66e443460d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:28.309890 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1796e9af-82d1-4e0c-ac0a-2e66e443460d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:28.310322 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1796e9af-82d1-4e0c-ac0a-2e66e443460d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:28.326469 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-18345558-da77-48a6-8975-51d6425d82b2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041149 Mar 03 02:38:28.327027 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 802/1613] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:28 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:28.369181 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1796e9af-82d1-4e0c-ac0a-2e66e443460d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:28.376319 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1796e9af-82d1-4e0c-ac0a-2e66e443460d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078229 Mar 03 02:38:28.376916 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 812/1614] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:28 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:38:28.720768 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ef0cc2d6-894c-4f8b-a39b-a14aa44c9f26 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:28.721380 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ef0cc2d6-894c-4f8b-a39b-a14aa44c9f26 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:28.727849 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ef0cc2d6-894c-4f8b-a39b-a14aa44c9f26 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:28.728307 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ef0cc2d6-894c-4f8b-a39b-a14aa44c9f26 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:28.729098 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ef0cc2d6-894c-4f8b-a39b-a14aa44c9f26 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:28.729541 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ef0cc2d6-894c-4f8b-a39b-a14aa44c9f26 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:28.861773 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ef0cc2d6-894c-4f8b-a39b-a14aa44c9f26 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:28.870109 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ef0cc2d6-894c-4f8b-a39b-a14aa44c9f26 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:28.871615 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ef0cc2d6-894c-4f8b-a39b-a14aa44c9f26 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:28.872759 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ef0cc2d6-894c-4f8b-a39b-a14aa44c9f26 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.155931 Mar 03 02:38:28.873311 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 803/1615] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:28 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:38:29.215922 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-bcdd3849-213d-4367-ae67-588b84931296 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:29.216841 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-bcdd3849-213d-4367-ae67-588b84931296 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:29.222637 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bcdd3849-213d-4367-ae67-588b84931296 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:29.223092 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bcdd3849-213d-4367-ae67-588b84931296 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:29.223895 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bcdd3849-213d-4367-ae67-588b84931296 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:29.224336 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bcdd3849-213d-4367-ae67-588b84931296 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:29.252959 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-bcdd3849-213d-4367-ae67-588b84931296 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040957 Mar 03 02:38:29.253721 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 813/1616] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:29 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:29.294510 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-43ba1ff2-2c38-4811-a5d1-83efd78dd290 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:29.295420 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-43ba1ff2-2c38-4811-a5d1-83efd78dd290 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:29.301746 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-43ba1ff2-2c38-4811-a5d1-83efd78dd290 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:29.302191 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-43ba1ff2-2c38-4811-a5d1-83efd78dd290 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:29.303016 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-43ba1ff2-2c38-4811-a5d1-83efd78dd290 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:29.304022 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-43ba1ff2-2c38-4811-a5d1-83efd78dd290 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:29.332299 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-43ba1ff2-2c38-4811-a5d1-83efd78dd290 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041762 Mar 03 02:38:29.332842 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 804/1617] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:29 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:29.338459 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1b0e2ac1-5346-40a2-a88a-325cb3c34d99 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:29.339361 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1b0e2ac1-5346-40a2-a88a-325cb3c34d99 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:29.345208 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1b0e2ac1-5346-40a2-a88a-325cb3c34d99 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:29.345655 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1b0e2ac1-5346-40a2-a88a-325cb3c34d99 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:29.346430 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1b0e2ac1-5346-40a2-a88a-325cb3c34d99 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:29.346861 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1b0e2ac1-5346-40a2-a88a-325cb3c34d99 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:29.374233 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1b0e2ac1-5346-40a2-a88a-325cb3c34d99 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040375 Mar 03 02:38:29.374770 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 814/1618] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:29 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:29.392661 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-32ae1817-c562-4f28-9e67-5ee97cf7c46b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:29.393260 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-32ae1817-c562-4f28-9e67-5ee97cf7c46b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:29.398982 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-32ae1817-c562-4f28-9e67-5ee97cf7c46b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:29.399429 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-32ae1817-c562-4f28-9e67-5ee97cf7c46b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:29.400239 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-32ae1817-c562-4f28-9e67-5ee97cf7c46b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:29.400674 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-32ae1817-c562-4f28-9e67-5ee97cf7c46b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:29.458047 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-32ae1817-c562-4f28-9e67-5ee97cf7c46b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:29.465273 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-32ae1817-c562-4f28-9e67-5ee97cf7c46b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.076390 Mar 03 02:38:29.465822 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 805/1619] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:29 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:38:29.892146 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a8afb58c-acf2-477d-bfe8-f42981fbff1e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:29.892756 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a8afb58c-acf2-477d-bfe8-f42981fbff1e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:29.898749 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a8afb58c-acf2-477d-bfe8-f42981fbff1e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:29.899204 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a8afb58c-acf2-477d-bfe8-f42981fbff1e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:29.900022 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a8afb58c-acf2-477d-bfe8-f42981fbff1e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:29.900461 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a8afb58c-acf2-477d-bfe8-f42981fbff1e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:30.028678 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a8afb58c-acf2-477d-bfe8-f42981fbff1e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:30.036698 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a8afb58c-acf2-477d-bfe8-f42981fbff1e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:30.038992 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a8afb58c-acf2-477d-bfe8-f42981fbff1e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:30.040194 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a8afb58c-acf2-477d-bfe8-f42981fbff1e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.151952 Mar 03 02:38:30.040754 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 815/1620] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:29 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:38:30.264979 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5f50952b-fbed-4662-9a78-cc475c715f4e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:30.265799 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5f50952b-fbed-4662-9a78-cc475c715f4e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:30.271536 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5f50952b-fbed-4662-9a78-cc475c715f4e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:30.272501 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5f50952b-fbed-4662-9a78-cc475c715f4e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:30.273475 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5f50952b-fbed-4662-9a78-cc475c715f4e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:30.273907 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5f50952b-fbed-4662-9a78-cc475c715f4e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:30.301909 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5f50952b-fbed-4662-9a78-cc475c715f4e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040931 Mar 03 02:38:30.302536 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 806/1621] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:30 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:30.344642 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-05e67c53-1fd1-464f-9dfe-177c23559565 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:30.345551 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-05e67c53-1fd1-464f-9dfe-177c23559565 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:30.352409 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-05e67c53-1fd1-464f-9dfe-177c23559565 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:30.352861 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-05e67c53-1fd1-464f-9dfe-177c23559565 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:30.353637 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-05e67c53-1fd1-464f-9dfe-177c23559565 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:30.354072 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-05e67c53-1fd1-464f-9dfe-177c23559565 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:30.381973 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-05e67c53-1fd1-464f-9dfe-177c23559565 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041255 Mar 03 02:38:30.382528 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 816/1622] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:30 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:30.385581 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-59f1d6ad-8160-4e2a-ae86-5094b717c714 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:30.386480 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-59f1d6ad-8160-4e2a-ae86-5094b717c714 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:30.392264 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-59f1d6ad-8160-4e2a-ae86-5094b717c714 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:30.392710 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-59f1d6ad-8160-4e2a-ae86-5094b717c714 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:30.393475 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-59f1d6ad-8160-4e2a-ae86-5094b717c714 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:30.393909 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-59f1d6ad-8160-4e2a-ae86-5094b717c714 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:30.421388 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-59f1d6ad-8160-4e2a-ae86-5094b717c714 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039685 Mar 03 02:38:30.421918 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 807/1623] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:30 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:30.481961 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c9de1c27-2bfe-4568-8619-8f11648b4145 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:30.482571 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c9de1c27-2bfe-4568-8619-8f11648b4145 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:30.488436 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c9de1c27-2bfe-4568-8619-8f11648b4145 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:30.488888 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c9de1c27-2bfe-4568-8619-8f11648b4145 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:30.489662 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c9de1c27-2bfe-4568-8619-8f11648b4145 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:30.490101 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c9de1c27-2bfe-4568-8619-8f11648b4145 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:30.752723 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c9de1c27-2bfe-4568-8619-8f11648b4145 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:30.761135 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c9de1c27-2bfe-4568-8619-8f11648b4145 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.283012 Mar 03 02:38:30.761701 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 817/1624] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:30 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:38:31.058128 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-dc74d5fa-9995-4d6e-9369-c2aa2b2c1f3d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:31.058737 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-dc74d5fa-9995-4d6e-9369-c2aa2b2c1f3d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:31.064660 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dc74d5fa-9995-4d6e-9369-c2aa2b2c1f3d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:31.065108 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dc74d5fa-9995-4d6e-9369-c2aa2b2c1f3d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:31.065918 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dc74d5fa-9995-4d6e-9369-c2aa2b2c1f3d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:31.066351 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dc74d5fa-9995-4d6e-9369-c2aa2b2c1f3d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:31.198712 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-dc74d5fa-9995-4d6e-9369-c2aa2b2c1f3d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:31.206795 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-dc74d5fa-9995-4d6e-9369-c2aa2b2c1f3d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:31.208321 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-dc74d5fa-9995-4d6e-9369-c2aa2b2c1f3d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:31.210084 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-dc74d5fa-9995-4d6e-9369-c2aa2b2c1f3d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.155283 Mar 03 02:38:31.210668 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 808/1625] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:31 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:38:31.313841 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5ea02346-bf47-4521-b546-39b5b088750b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:31.314710 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5ea02346-bf47-4521-b546-39b5b088750b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:31.321752 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5ea02346-bf47-4521-b546-39b5b088750b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:31.322531 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5ea02346-bf47-4521-b546-39b5b088750b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:31.323720 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5ea02346-bf47-4521-b546-39b5b088750b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:31.324355 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5ea02346-bf47-4521-b546-39b5b088750b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:31.354944 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5ea02346-bf47-4521-b546-39b5b088750b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045224 Mar 03 02:38:31.355522 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 818/1626] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:31 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:31.393292 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-86da3cc8-e6f7-480c-bba5-692030b96faf tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:31.394227 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-86da3cc8-e6f7-480c-bba5-692030b96faf tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:31.401222 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-86da3cc8-e6f7-480c-bba5-692030b96faf tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:31.401669 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-86da3cc8-e6f7-480c-bba5-692030b96faf tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:31.402437 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-86da3cc8-e6f7-480c-bba5-692030b96faf tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:31.402866 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-86da3cc8-e6f7-480c-bba5-692030b96faf tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:31.430962 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-86da3cc8-e6f7-480c-bba5-692030b96faf tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041484 Mar 03 02:38:31.431517 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 809/1627] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:31 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:31.432156 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4d80e22a-d456-4335-b9d8-c3d7cd5fd344 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:31.433059 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4d80e22a-d456-4335-b9d8-c3d7cd5fd344 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:31.438795 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4d80e22a-d456-4335-b9d8-c3d7cd5fd344 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:31.439240 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4d80e22a-d456-4335-b9d8-c3d7cd5fd344 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:31.440058 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4d80e22a-d456-4335-b9d8-c3d7cd5fd344 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:31.440476 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4d80e22a-d456-4335-b9d8-c3d7cd5fd344 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:31.468153 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4d80e22a-d456-4335-b9d8-c3d7cd5fd344 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040113 Mar 03 02:38:31.468694 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 819/1628] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:31 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:31.777752 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a8a046a5-537a-47da-b695-d90974234cb8 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:31.778351 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a8a046a5-537a-47da-b695-d90974234cb8 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:31.784116 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a8a046a5-537a-47da-b695-d90974234cb8 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:31.784559 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a8a046a5-537a-47da-b695-d90974234cb8 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:31.785323 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a8a046a5-537a-47da-b695-d90974234cb8 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:31.785853 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a8a046a5-537a-47da-b695-d90974234cb8 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:31.845602 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a8a046a5-537a-47da-b695-d90974234cb8 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:31.853328 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a8a046a5-537a-47da-b695-d90974234cb8 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.079461 Mar 03 02:38:31.853884 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 810/1629] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:31 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:38:32.228398 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-276a6a19-a514-4f46-9ee5-3f607869188f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:32.229000 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-276a6a19-a514-4f46-9ee5-3f607869188f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:32.234863 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-276a6a19-a514-4f46-9ee5-3f607869188f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:32.235312 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-276a6a19-a514-4f46-9ee5-3f607869188f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:32.236139 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-276a6a19-a514-4f46-9ee5-3f607869188f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:32.236578 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-276a6a19-a514-4f46-9ee5-3f607869188f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:32.366371 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3587d94f-e014-4e7b-8a5b-f73e5ca3dcf4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:32.366946 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-276a6a19-a514-4f46-9ee5-3f607869188f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:32.367418 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3587d94f-e014-4e7b-8a5b-f73e5ca3dcf4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:32.373734 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3587d94f-e014-4e7b-8a5b-f73e5ca3dcf4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:32.374189 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3587d94f-e014-4e7b-8a5b-f73e5ca3dcf4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:32.374977 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3587d94f-e014-4e7b-8a5b-f73e5ca3dcf4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:32.375414 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3587d94f-e014-4e7b-8a5b-f73e5ca3dcf4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:32.375514 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-276a6a19-a514-4f46-9ee5-3f607869188f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:32.377025 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-276a6a19-a514-4f46-9ee5-3f607869188f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:32.378213 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-276a6a19-a514-4f46-9ee5-3f607869188f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.154271 Mar 03 02:38:32.379642 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 820/1630] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:32 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:38:32.405193 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3587d94f-e014-4e7b-8a5b-f73e5ca3dcf4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042714 Mar 03 02:38:32.405738 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 811/1631] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:32 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:32.442624 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4180f899-e6ac-4b8f-8a21-9e8bd12a01ec tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:32.443526 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4180f899-e6ac-4b8f-8a21-9e8bd12a01ec tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:32.449445 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4180f899-e6ac-4b8f-8a21-9e8bd12a01ec tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:32.449898 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4180f899-e6ac-4b8f-8a21-9e8bd12a01ec tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:32.450668 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4180f899-e6ac-4b8f-8a21-9e8bd12a01ec tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:32.451102 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4180f899-e6ac-4b8f-8a21-9e8bd12a01ec tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:32.480033 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4180f899-e6ac-4b8f-8a21-9e8bd12a01ec tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041719 Mar 03 02:38:32.480589 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 821/1632] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:32 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:32.480719 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-79dd007e-315d-4ce5-b9ca-ffaa98fd30bf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:32.481682 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-79dd007e-315d-4ce5-b9ca-ffaa98fd30bf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:32.487384 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-79dd007e-315d-4ce5-b9ca-ffaa98fd30bf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:32.487863 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-79dd007e-315d-4ce5-b9ca-ffaa98fd30bf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:32.488634 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-79dd007e-315d-4ce5-b9ca-ffaa98fd30bf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:32.489067 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-79dd007e-315d-4ce5-b9ca-ffaa98fd30bf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:32.516207 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-79dd007e-315d-4ce5-b9ca-ffaa98fd30bf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039691 Mar 03 02:38:32.516744 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 812/1633] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:32 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:32.871337 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-343658ad-bb47-41fe-b53e-29aa63edecc7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:32.873107 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-343658ad-bb47-41fe-b53e-29aa63edecc7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:32.878416 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-343658ad-bb47-41fe-b53e-29aa63edecc7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:32.878868 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-343658ad-bb47-41fe-b53e-29aa63edecc7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:32.879673 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-343658ad-bb47-41fe-b53e-29aa63edecc7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:32.880116 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-343658ad-bb47-41fe-b53e-29aa63edecc7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:32.940154 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-343658ad-bb47-41fe-b53e-29aa63edecc7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:32.947483 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-343658ad-bb47-41fe-b53e-29aa63edecc7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.081582 Mar 03 02:38:32.948066 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 822/1634] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:32 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:38:33.396044 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-314a64e9-e694-4211-9ffa-96efb66a4224 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:33.396649 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-314a64e9-e694-4211-9ffa-96efb66a4224 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:33.403657 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-314a64e9-e694-4211-9ffa-96efb66a4224 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:33.404112 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-314a64e9-e694-4211-9ffa-96efb66a4224 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:33.404894 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-314a64e9-e694-4211-9ffa-96efb66a4224 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:33.405331 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-314a64e9-e694-4211-9ffa-96efb66a4224 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:33.417529 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-42c02902-ede7-4b23-ba50-b8fa86b83935 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:33.418662 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-42c02902-ede7-4b23-ba50-b8fa86b83935 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:33.424918 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-42c02902-ede7-4b23-ba50-b8fa86b83935 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:33.425490 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-42c02902-ede7-4b23-ba50-b8fa86b83935 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:33.426267 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-42c02902-ede7-4b23-ba50-b8fa86b83935 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:33.426697 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-42c02902-ede7-4b23-ba50-b8fa86b83935 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:33.454895 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-42c02902-ede7-4b23-ba50-b8fa86b83935 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042028 Mar 03 02:38:33.455570 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 823/1635] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:33 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:33.491153 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-70916fd6-ff8c-4fe0-ad88-d9a374856b19 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:33.492098 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-70916fd6-ff8c-4fe0-ad88-d9a374856b19 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:33.498168 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-70916fd6-ff8c-4fe0-ad88-d9a374856b19 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:33.498618 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-70916fd6-ff8c-4fe0-ad88-d9a374856b19 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:33.499406 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-70916fd6-ff8c-4fe0-ad88-d9a374856b19 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:33.499871 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-70916fd6-ff8c-4fe0-ad88-d9a374856b19 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:33.530866 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-70916fd6-ff8c-4fe0-ad88-d9a374856b19 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043677 Mar 03 02:38:33.531631 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 824/1636] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:33 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:33.536067 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e99060a5-a702-47b8-b1c5-720d000d4f48 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:33.536977 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e99060a5-a702-47b8-b1c5-720d000d4f48 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:33.542906 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e99060a5-a702-47b8-b1c5-720d000d4f48 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:33.543398 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e99060a5-a702-47b8-b1c5-720d000d4f48 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:33.544176 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e99060a5-a702-47b8-b1c5-720d000d4f48 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:33.544614 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e99060a5-a702-47b8-b1c5-720d000d4f48 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:33.548684 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-314a64e9-e694-4211-9ffa-96efb66a4224 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:33.556723 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-314a64e9-e694-4211-9ffa-96efb66a4224 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:33.558200 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-314a64e9-e694-4211-9ffa-96efb66a4224 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:33.559347 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-314a64e9-e694-4211-9ffa-96efb66a4224 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.167180 Mar 03 02:38:33.559957 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 813/1637] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:33 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:38:33.574050 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e99060a5-a702-47b8-b1c5-720d000d4f48 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041546 Mar 03 02:38:33.574665 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 825/1638] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:33 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:33.964076 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c060e1ef-0a07-4f34-a3fb-4c5f31483041 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:33.964707 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c060e1ef-0a07-4f34-a3fb-4c5f31483041 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:33.970447 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c060e1ef-0a07-4f34-a3fb-4c5f31483041 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:33.970886 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c060e1ef-0a07-4f34-a3fb-4c5f31483041 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:33.971673 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c060e1ef-0a07-4f34-a3fb-4c5f31483041 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:33.972104 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c060e1ef-0a07-4f34-a3fb-4c5f31483041 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:34.031220 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c060e1ef-0a07-4f34-a3fb-4c5f31483041 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:34.038582 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c060e1ef-0a07-4f34-a3fb-4c5f31483041 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078393 Mar 03 02:38:34.039132 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 814/1639] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:33 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:38:34.466247 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c571c27a-9ea3-45b8-89ed-96ed284918f5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:34.467163 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c571c27a-9ea3-45b8-89ed-96ed284918f5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:34.473481 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c571c27a-9ea3-45b8-89ed-96ed284918f5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:34.473938 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c571c27a-9ea3-45b8-89ed-96ed284918f5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:34.474723 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c571c27a-9ea3-45b8-89ed-96ed284918f5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:34.475673 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c571c27a-9ea3-45b8-89ed-96ed284918f5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:34.504233 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c571c27a-9ea3-45b8-89ed-96ed284918f5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041931 Mar 03 02:38:34.504784 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 826/1640] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:34 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:34.542641 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0387656c-bd3b-4a68-8144-37d125093151 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:34.543554 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0387656c-bd3b-4a68-8144-37d125093151 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:34.549726 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0387656c-bd3b-4a68-8144-37d125093151 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:34.550176 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0387656c-bd3b-4a68-8144-37d125093151 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:34.550946 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0387656c-bd3b-4a68-8144-37d125093151 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:34.551380 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0387656c-bd3b-4a68-8144-37d125093151 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:34.577901 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f710cb9a-40ff-4109-8d14-ba4b0dec0d95 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:34.578505 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f710cb9a-40ff-4109-8d14-ba4b0dec0d95 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:34.580110 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0387656c-bd3b-4a68-8144-37d125093151 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040385 Mar 03 02:38:34.580683 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 815/1641] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:34 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:34.585424 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f710cb9a-40ff-4109-8d14-ba4b0dec0d95 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:34.585890 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f710cb9a-40ff-4109-8d14-ba4b0dec0d95 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:34.586306 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-64a32c42-3b56-4487-b917-7530487c492a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:34.586676 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f710cb9a-40ff-4109-8d14-ba4b0dec0d95 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:34.587119 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f710cb9a-40ff-4109-8d14-ba4b0dec0d95 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:34.587236 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-64a32c42-3b56-4487-b917-7530487c492a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:34.592813 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-64a32c42-3b56-4487-b917-7530487c492a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:34.593256 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-64a32c42-3b56-4487-b917-7530487c492a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:34.594026 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-64a32c42-3b56-4487-b917-7530487c492a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:34.594455 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-64a32c42-3b56-4487-b917-7530487c492a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:34.621930 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-64a32c42-3b56-4487-b917-7530487c492a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040231 Mar 03 02:38:34.622491 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 816/1642] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:34 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:34.717441 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f710cb9a-40ff-4109-8d14-ba4b0dec0d95 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:34.725342 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f710cb9a-40ff-4109-8d14-ba4b0dec0d95 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:34.726830 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f710cb9a-40ff-4109-8d14-ba4b0dec0d95 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:34.728004 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f710cb9a-40ff-4109-8d14-ba4b0dec0d95 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.153981 Mar 03 02:38:34.728582 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 827/1643] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:34 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:38:35.056055 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-cbd451a0-1373-40f3-81e7-f75648d97ace tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:35.056677 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-cbd451a0-1373-40f3-81e7-f75648d97ace tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:35.062543 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cbd451a0-1373-40f3-81e7-f75648d97ace tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:35.062996 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cbd451a0-1373-40f3-81e7-f75648d97ace tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:35.063812 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cbd451a0-1373-40f3-81e7-f75648d97ace tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:35.064258 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cbd451a0-1373-40f3-81e7-f75648d97ace tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:35.121882 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-cbd451a0-1373-40f3-81e7-f75648d97ace tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:35.129060 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-cbd451a0-1373-40f3-81e7-f75648d97ace tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.077786 Mar 03 02:38:35.129620 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 817/1644] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:35 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:38:35.515691 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7914e5b8-abbf-485e-a738-be7e1b2af2a8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:35.516631 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7914e5b8-abbf-485e-a738-be7e1b2af2a8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:35.523415 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7914e5b8-abbf-485e-a738-be7e1b2af2a8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:35.523875 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7914e5b8-abbf-485e-a738-be7e1b2af2a8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:35.524647 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7914e5b8-abbf-485e-a738-be7e1b2af2a8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:35.525081 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7914e5b8-abbf-485e-a738-be7e1b2af2a8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:35.552888 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7914e5b8-abbf-485e-a738-be7e1b2af2a8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041131 Mar 03 02:38:35.553427 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 828/1645] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:35 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:35.591986 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-fab88a41-b3e2-4fa3-b03b-70dd60b7c384 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:35.592899 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-fab88a41-b3e2-4fa3-b03b-70dd60b7c384 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:35.599049 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fab88a41-b3e2-4fa3-b03b-70dd60b7c384 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:35.599499 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fab88a41-b3e2-4fa3-b03b-70dd60b7c384 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:35.600957 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fab88a41-b3e2-4fa3-b03b-70dd60b7c384 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:35.601398 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fab88a41-b3e2-4fa3-b03b-70dd60b7c384 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:35.628770 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-fab88a41-b3e2-4fa3-b03b-70dd60b7c384 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040770 Mar 03 02:38:35.629323 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 818/1646] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:35 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:35.633459 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-30ee6686-5205-4ea5-bbed-ef7b5b64589e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:35.634368 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-30ee6686-5205-4ea5-bbed-ef7b5b64589e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:35.640156 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-30ee6686-5205-4ea5-bbed-ef7b5b64589e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:35.640611 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-30ee6686-5205-4ea5-bbed-ef7b5b64589e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:35.641390 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-30ee6686-5205-4ea5-bbed-ef7b5b64589e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:35.641829 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-30ee6686-5205-4ea5-bbed-ef7b5b64589e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:35.670186 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-30ee6686-5205-4ea5-bbed-ef7b5b64589e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040607 Mar 03 02:38:35.670658 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 829/1647] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:35 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:35.746038 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b988b1b3-c37f-4d8d-b192-dae57a318856 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:35.746640 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b988b1b3-c37f-4d8d-b192-dae57a318856 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:35.752422 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b988b1b3-c37f-4d8d-b192-dae57a318856 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:35.752878 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b988b1b3-c37f-4d8d-b192-dae57a318856 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:35.753650 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b988b1b3-c37f-4d8d-b192-dae57a318856 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:35.754083 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b988b1b3-c37f-4d8d-b192-dae57a318856 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:35.888233 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b988b1b3-c37f-4d8d-b192-dae57a318856 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:35.896436 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b988b1b3-c37f-4d8d-b192-dae57a318856 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:35.898612 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b988b1b3-c37f-4d8d-b192-dae57a318856 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:35.899858 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b988b1b3-c37f-4d8d-b192-dae57a318856 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.157917 Mar 03 02:38:35.900416 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 819/1648] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:35 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:38:36.146286 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c5ccea5a-fb88-4b16-aa1b-bccff507e81b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:36.146959 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c5ccea5a-fb88-4b16-aa1b-bccff507e81b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:36.153065 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c5ccea5a-fb88-4b16-aa1b-bccff507e81b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:36.153516 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c5ccea5a-fb88-4b16-aa1b-bccff507e81b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:36.154299 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c5ccea5a-fb88-4b16-aa1b-bccff507e81b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:36.154733 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c5ccea5a-fb88-4b16-aa1b-bccff507e81b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:36.214330 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c5ccea5a-fb88-4b16-aa1b-bccff507e81b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:36.221602 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c5ccea5a-fb88-4b16-aa1b-bccff507e81b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.079178 Mar 03 02:38:36.222171 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 830/1649] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:36 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:38:36.564378 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b5959fc4-d013-40c4-a05c-2ed030468ff5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:36.565210 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b5959fc4-d013-40c4-a05c-2ed030468ff5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:36.570939 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b5959fc4-d013-40c4-a05c-2ed030468ff5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:36.571391 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b5959fc4-d013-40c4-a05c-2ed030468ff5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:36.572207 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b5959fc4-d013-40c4-a05c-2ed030468ff5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:36.572649 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b5959fc4-d013-40c4-a05c-2ed030468ff5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:36.599961 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b5959fc4-d013-40c4-a05c-2ed030468ff5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039590 Mar 03 02:38:36.601068 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 820/1650] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:36 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:36.640205 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-bff421dd-e94a-4fa1-9c11-176c962c3758 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:36.641127 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-bff421dd-e94a-4fa1-9c11-176c962c3758 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:36.647533 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bff421dd-e94a-4fa1-9c11-176c962c3758 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:36.648010 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bff421dd-e94a-4fa1-9c11-176c962c3758 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:36.648795 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bff421dd-e94a-4fa1-9c11-176c962c3758 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:36.649234 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bff421dd-e94a-4fa1-9c11-176c962c3758 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:36.677054 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-bff421dd-e94a-4fa1-9c11-176c962c3758 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040777 Mar 03 02:38:36.677606 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 831/1651] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:36 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:36.682588 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a744d932-1153-4a61-a0e7-2c0e8c19ba40 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:36.683389 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a744d932-1153-4a61-a0e7-2c0e8c19ba40 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:36.690752 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a744d932-1153-4a61-a0e7-2c0e8c19ba40 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:36.691203 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a744d932-1153-4a61-a0e7-2c0e8c19ba40 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:36.692023 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a744d932-1153-4a61-a0e7-2c0e8c19ba40 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:36.692460 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a744d932-1153-4a61-a0e7-2c0e8c19ba40 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:36.719465 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a744d932-1153-4a61-a0e7-2c0e8c19ba40 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041672 Mar 03 02:38:36.720045 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 821/1652] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:36 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:36.918539 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b893b6c4-819c-4a3a-bfa1-b52fac9021d6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:36.919176 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b893b6c4-819c-4a3a-bfa1-b52fac9021d6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:36.925075 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b893b6c4-819c-4a3a-bfa1-b52fac9021d6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:36.925534 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b893b6c4-819c-4a3a-bfa1-b52fac9021d6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:36.926309 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b893b6c4-819c-4a3a-bfa1-b52fac9021d6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:36.926782 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b893b6c4-819c-4a3a-bfa1-b52fac9021d6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:37.054902 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b893b6c4-819c-4a3a-bfa1-b52fac9021d6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:37.062966 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b893b6c4-819c-4a3a-bfa1-b52fac9021d6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:37.064468 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b893b6c4-819c-4a3a-bfa1-b52fac9021d6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:37.065613 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b893b6c4-819c-4a3a-bfa1-b52fac9021d6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.151032 Mar 03 02:38:37.066165 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 832/1653] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:36 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:38:37.238149 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e143f615-37e4-477e-b0b7-e10545efbea0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:37.238685 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e143f615-37e4-477e-b0b7-e10545efbea0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:37.244781 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e143f615-37e4-477e-b0b7-e10545efbea0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:37.245262 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e143f615-37e4-477e-b0b7-e10545efbea0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:37.246040 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e143f615-37e4-477e-b0b7-e10545efbea0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:37.246477 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e143f615-37e4-477e-b0b7-e10545efbea0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:37.307475 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e143f615-37e4-477e-b0b7-e10545efbea0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:37.314726 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e143f615-37e4-477e-b0b7-e10545efbea0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.080453 Mar 03 02:38:37.315287 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 822/1654] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:37 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:38:37.612237 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d2dfb4cf-5756-4b0e-8321-73adffa12c8c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:37.613141 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d2dfb4cf-5756-4b0e-8321-73adffa12c8c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:37.619720 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d2dfb4cf-5756-4b0e-8321-73adffa12c8c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:37.620167 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d2dfb4cf-5756-4b0e-8321-73adffa12c8c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:37.620939 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d2dfb4cf-5756-4b0e-8321-73adffa12c8c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:37.621372 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d2dfb4cf-5756-4b0e-8321-73adffa12c8c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:37.649503 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d2dfb4cf-5756-4b0e-8321-73adffa12c8c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041239 Mar 03 02:38:37.650116 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 833/1655] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:37 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:37.688841 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2b998a55-a5ca-4369-a8ba-b3c1ee754dcb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:37.689758 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2b998a55-a5ca-4369-a8ba-b3c1ee754dcb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:37.696902 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2b998a55-a5ca-4369-a8ba-b3c1ee754dcb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:37.697358 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2b998a55-a5ca-4369-a8ba-b3c1ee754dcb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:37.698148 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2b998a55-a5ca-4369-a8ba-b3c1ee754dcb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:37.698587 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2b998a55-a5ca-4369-a8ba-b3c1ee754dcb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:37.727540 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2b998a55-a5ca-4369-a8ba-b3c1ee754dcb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042594 Mar 03 02:38:37.728203 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 823/1656] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:37 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:37.730398 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-bb799749-08d1-4ba4-a0b5-d813fb7c10e2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:37.731319 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-bb799749-08d1-4ba4-a0b5-d813fb7c10e2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:37.737063 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bb799749-08d1-4ba4-a0b5-d813fb7c10e2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:37.737504 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bb799749-08d1-4ba4-a0b5-d813fb7c10e2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:37.738275 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bb799749-08d1-4ba4-a0b5-d813fb7c10e2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:37.738705 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bb799749-08d1-4ba4-a0b5-d813fb7c10e2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:37.771741 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-bb799749-08d1-4ba4-a0b5-d813fb7c10e2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045203 Mar 03 02:38:37.772340 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 834/1657] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:37 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:38.084170 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f0acbec1-7270-4dcd-99fa-73d7ff46749f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:38.084897 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f0acbec1-7270-4dcd-99fa-73d7ff46749f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:38.090713 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f0acbec1-7270-4dcd-99fa-73d7ff46749f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:38.091155 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f0acbec1-7270-4dcd-99fa-73d7ff46749f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:38.092077 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f0acbec1-7270-4dcd-99fa-73d7ff46749f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:38.092507 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f0acbec1-7270-4dcd-99fa-73d7ff46749f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:38.220946 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f0acbec1-7270-4dcd-99fa-73d7ff46749f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:38.229523 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f0acbec1-7270-4dcd-99fa-73d7ff46749f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:38.231011 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f0acbec1-7270-4dcd-99fa-73d7ff46749f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:38.232172 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f0acbec1-7270-4dcd-99fa-73d7ff46749f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.151903 Mar 03 02:38:38.232723 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 824/1658] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:38 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:38:38.330961 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-99cf1218-ee3f-439c-a7a5-2c7270e8eab1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:38.331624 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-99cf1218-ee3f-439c-a7a5-2c7270e8eab1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:38.338437 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-99cf1218-ee3f-439c-a7a5-2c7270e8eab1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:38.338886 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-99cf1218-ee3f-439c-a7a5-2c7270e8eab1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:38.339692 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-99cf1218-ee3f-439c-a7a5-2c7270e8eab1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:38.340133 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-99cf1218-ee3f-439c-a7a5-2c7270e8eab1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:38.402060 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-99cf1218-ee3f-439c-a7a5-2c7270e8eab1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:38.409342 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-99cf1218-ee3f-439c-a7a5-2c7270e8eab1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.082196 Mar 03 02:38:38.409903 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 835/1659] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:38 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:38:38.661208 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c55a1975-db7c-425d-b117-1c689d8b9071 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:38.662239 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c55a1975-db7c-425d-b117-1c689d8b9071 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:38.668995 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c55a1975-db7c-425d-b117-1c689d8b9071 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:38.669441 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c55a1975-db7c-425d-b117-1c689d8b9071 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:38.670213 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c55a1975-db7c-425d-b117-1c689d8b9071 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:38.670646 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c55a1975-db7c-425d-b117-1c689d8b9071 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:38.697758 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c55a1975-db7c-425d-b117-1c689d8b9071 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040795 Mar 03 02:38:38.698368 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 825/1660] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:38 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:38.739846 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-819c9172-d38e-4915-bfaf-633d63f0e7d2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:38.741101 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-819c9172-d38e-4915-bfaf-633d63f0e7d2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:38.747573 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-819c9172-d38e-4915-bfaf-633d63f0e7d2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:38.748050 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-819c9172-d38e-4915-bfaf-633d63f0e7d2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:38.748827 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-819c9172-d38e-4915-bfaf-633d63f0e7d2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:38.749262 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-819c9172-d38e-4915-bfaf-633d63f0e7d2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:38.779022 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-819c9172-d38e-4915-bfaf-633d63f0e7d2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043142 Mar 03 02:38:38.779577 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 836/1661] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:38 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:38.782319 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-84056cd2-23e8-4fd6-88a8-c3bee34b2a91 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:38.783269 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-84056cd2-23e8-4fd6-88a8-c3bee34b2a91 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:38.789700 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-84056cd2-23e8-4fd6-88a8-c3bee34b2a91 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:38.790146 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-84056cd2-23e8-4fd6-88a8-c3bee34b2a91 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:38.790957 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-84056cd2-23e8-4fd6-88a8-c3bee34b2a91 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:38.791391 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-84056cd2-23e8-4fd6-88a8-c3bee34b2a91 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:38.818474 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-84056cd2-23e8-4fd6-88a8-c3bee34b2a91 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040039 Mar 03 02:38:38.822615 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 826/1662] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:38 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:39.250863 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2d2682f9-d668-48ac-8c50-142eb7f77923 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:39.251918 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2d2682f9-d668-48ac-8c50-142eb7f77923 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:39.258839 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2d2682f9-d668-48ac-8c50-142eb7f77923 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:39.259292 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2d2682f9-d668-48ac-8c50-142eb7f77923 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:39.260104 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2d2682f9-d668-48ac-8c50-142eb7f77923 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:39.260540 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2d2682f9-d668-48ac-8c50-142eb7f77923 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:39.390408 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2d2682f9-d668-48ac-8c50-142eb7f77923 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:39.399030 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2d2682f9-d668-48ac-8c50-142eb7f77923 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:39.400578 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2d2682f9-d668-48ac-8c50-142eb7f77923 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:39.401739 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2d2682f9-d668-48ac-8c50-142eb7f77923 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.155124 Mar 03 02:38:39.402301 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 837/1663] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:39 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:38:39.426184 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ae18ad01-d4a5-4169-829a-f501fb5bd3c9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:39.426796 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ae18ad01-d4a5-4169-829a-f501fb5bd3c9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:39.432670 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ae18ad01-d4a5-4169-829a-f501fb5bd3c9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:39.433149 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ae18ad01-d4a5-4169-829a-f501fb5bd3c9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:39.433923 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ae18ad01-d4a5-4169-829a-f501fb5bd3c9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:39.434360 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ae18ad01-d4a5-4169-829a-f501fb5bd3c9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:39.491640 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ae18ad01-d4a5-4169-829a-f501fb5bd3c9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:39.499013 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ae18ad01-d4a5-4169-829a-f501fb5bd3c9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.076754 Mar 03 02:38:39.499580 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 827/1664] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:39 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:38:39.709297 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2ba11733-ca56-45bc-9ae1-8a4821dbacfb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:39.711041 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2ba11733-ca56-45bc-9ae1-8a4821dbacfb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:39.716843 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2ba11733-ca56-45bc-9ae1-8a4821dbacfb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:39.717292 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2ba11733-ca56-45bc-9ae1-8a4821dbacfb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:39.718065 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2ba11733-ca56-45bc-9ae1-8a4821dbacfb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:39.718497 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2ba11733-ca56-45bc-9ae1-8a4821dbacfb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:39.746116 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2ba11733-ca56-45bc-9ae1-8a4821dbacfb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040827 Mar 03 02:38:39.746736 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 838/1665] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:39 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:39.790286 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-dddb8b99-acd7-4645-ae7c-b765ce2d9804 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:39.791184 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-dddb8b99-acd7-4645-ae7c-b765ce2d9804 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:39.797357 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dddb8b99-acd7-4645-ae7c-b765ce2d9804 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:39.797796 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dddb8b99-acd7-4645-ae7c-b765ce2d9804 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:39.798572 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dddb8b99-acd7-4645-ae7c-b765ce2d9804 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:39.799007 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dddb8b99-acd7-4645-ae7c-b765ce2d9804 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:39.826670 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-dddb8b99-acd7-4645-ae7c-b765ce2d9804 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040398 Mar 03 02:38:39.827249 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 828/1666] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:39 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:39.833729 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0c7e449b-11b7-41d1-95c3-8cf394d79357 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:39.835492 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0c7e449b-11b7-41d1-95c3-8cf394d79357 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:39.841292 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0c7e449b-11b7-41d1-95c3-8cf394d79357 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:39.841775 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0c7e449b-11b7-41d1-95c3-8cf394d79357 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:39.842557 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0c7e449b-11b7-41d1-95c3-8cf394d79357 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:39.842992 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0c7e449b-11b7-41d1-95c3-8cf394d79357 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:39.870630 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0c7e449b-11b7-41d1-95c3-8cf394d79357 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040900 Mar 03 02:38:39.871181 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 839/1667] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:39 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:40.419495 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-91d9f916-25aa-4dff-9fb6-7842b111a792 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:40.420162 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-91d9f916-25aa-4dff-9fb6-7842b111a792 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:40.425967 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-91d9f916-25aa-4dff-9fb6-7842b111a792 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:40.426420 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-91d9f916-25aa-4dff-9fb6-7842b111a792 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:40.427191 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-91d9f916-25aa-4dff-9fb6-7842b111a792 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:40.427649 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-91d9f916-25aa-4dff-9fb6-7842b111a792 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:40.516055 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5d281394-17b2-4e1a-b667-09d9dd49db08 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:40.516671 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5d281394-17b2-4e1a-b667-09d9dd49db08 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:40.522579 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5d281394-17b2-4e1a-b667-09d9dd49db08 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:40.523037 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5d281394-17b2-4e1a-b667-09d9dd49db08 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:40.523867 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5d281394-17b2-4e1a-b667-09d9dd49db08 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:40.524312 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5d281394-17b2-4e1a-b667-09d9dd49db08 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:40.560261 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-91d9f916-25aa-4dff-9fb6-7842b111a792 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:40.568536 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-91d9f916-25aa-4dff-9fb6-7842b111a792 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:40.570136 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-91d9f916-25aa-4dff-9fb6-7842b111a792 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:40.571303 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-91d9f916-25aa-4dff-9fb6-7842b111a792 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.155727 Mar 03 02:38:40.571899 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 829/1668] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:40 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:38:40.582406 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5d281394-17b2-4e1a-b667-09d9dd49db08 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:40.590218 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5d281394-17b2-4e1a-b667-09d9dd49db08 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.077962 Mar 03 02:38:40.590776 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 840/1669] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:40 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:38:40.757620 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-54b72594-c742-4100-8803-97e57c212dca tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:40.758446 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-54b72594-c742-4100-8803-97e57c212dca tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:40.764374 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-54b72594-c742-4100-8803-97e57c212dca tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:40.764822 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-54b72594-c742-4100-8803-97e57c212dca tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:40.765593 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-54b72594-c742-4100-8803-97e57c212dca tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:40.766025 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-54b72594-c742-4100-8803-97e57c212dca tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:40.795648 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-54b72594-c742-4100-8803-97e57c212dca tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041998 Mar 03 02:38:40.796293 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 830/1670] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:40 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:40.838500 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e9a4c443-54e1-40d0-88df-5f1752fe6ef6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:40.839432 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e9a4c443-54e1-40d0-88df-5f1752fe6ef6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:40.845684 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e9a4c443-54e1-40d0-88df-5f1752fe6ef6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:40.846127 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e9a4c443-54e1-40d0-88df-5f1752fe6ef6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:40.846896 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e9a4c443-54e1-40d0-88df-5f1752fe6ef6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:40.847329 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e9a4c443-54e1-40d0-88df-5f1752fe6ef6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:40.875074 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e9a4c443-54e1-40d0-88df-5f1752fe6ef6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041004 Mar 03 02:38:40.875632 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 841/1671] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:40 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:40.882192 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f5b30c16-0298-457d-8f84-aa4e0df70570 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:40.883083 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f5b30c16-0298-457d-8f84-aa4e0df70570 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:40.888923 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f5b30c16-0298-457d-8f84-aa4e0df70570 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:40.889370 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f5b30c16-0298-457d-8f84-aa4e0df70570 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:40.890138 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f5b30c16-0298-457d-8f84-aa4e0df70570 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:40.890566 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f5b30c16-0298-457d-8f84-aa4e0df70570 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:40.918744 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f5b30c16-0298-457d-8f84-aa4e0df70570 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040519 Mar 03 02:38:40.919526 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 831/1672] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:40 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:41.588823 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-784e259c-4520-4162-a0c5-7d897ba8b77e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:41.589426 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-784e259c-4520-4162-a0c5-7d897ba8b77e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:41.595296 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-784e259c-4520-4162-a0c5-7d897ba8b77e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:41.595776 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-784e259c-4520-4162-a0c5-7d897ba8b77e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:41.596551 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-784e259c-4520-4162-a0c5-7d897ba8b77e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:41.596980 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-784e259c-4520-4162-a0c5-7d897ba8b77e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:41.606617 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-966be9f2-f49e-4e6b-8f47-80d2cb74455c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:41.607223 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-966be9f2-f49e-4e6b-8f47-80d2cb74455c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:41.612896 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-966be9f2-f49e-4e6b-8f47-80d2cb74455c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:41.613348 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-966be9f2-f49e-4e6b-8f47-80d2cb74455c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:41.614125 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-966be9f2-f49e-4e6b-8f47-80d2cb74455c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:41.614562 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-966be9f2-f49e-4e6b-8f47-80d2cb74455c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:41.673401 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-966be9f2-f49e-4e6b-8f47-80d2cb74455c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:41.681342 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-966be9f2-f49e-4e6b-8f47-80d2cb74455c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078488 Mar 03 02:38:41.682132 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 832/1673] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:41 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:38:41.730526 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-784e259c-4520-4162-a0c5-7d897ba8b77e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:41.738509 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-784e259c-4520-4162-a0c5-7d897ba8b77e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:41.740019 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-784e259c-4520-4162-a0c5-7d897ba8b77e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:41.741806 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-784e259c-4520-4162-a0c5-7d897ba8b77e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.156992 Mar 03 02:38:41.742364 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 842/1674] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:41 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:38:41.807116 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-11d60c59-7889-4b17-ba05-2154c1f4dd97 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:41.808052 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-11d60c59-7889-4b17-ba05-2154c1f4dd97 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:41.814326 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-11d60c59-7889-4b17-ba05-2154c1f4dd97 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:41.814789 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-11d60c59-7889-4b17-ba05-2154c1f4dd97 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:41.815570 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-11d60c59-7889-4b17-ba05-2154c1f4dd97 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:41.816039 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-11d60c59-7889-4b17-ba05-2154c1f4dd97 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:41.845129 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-11d60c59-7889-4b17-ba05-2154c1f4dd97 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042761 Mar 03 02:38:41.845694 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 833/1675] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:41 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:41.886439 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-fad14398-3deb-405c-bd49-53116a8ba7f2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:41.887347 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-fad14398-3deb-405c-bd49-53116a8ba7f2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:41.893614 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fad14398-3deb-405c-bd49-53116a8ba7f2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:41.894059 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fad14398-3deb-405c-bd49-53116a8ba7f2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:41.894824 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fad14398-3deb-405c-bd49-53116a8ba7f2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:41.895257 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fad14398-3deb-405c-bd49-53116a8ba7f2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:41.923502 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-fad14398-3deb-405c-bd49-53116a8ba7f2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040908 Mar 03 02:38:41.924024 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 843/1676] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:41 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:41.931056 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a01d7d7b-d273-4245-b56b-7444ca2cf49c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:41.931989 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a01d7d7b-d273-4245-b56b-7444ca2cf49c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:41.937706 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a01d7d7b-d273-4245-b56b-7444ca2cf49c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:41.938148 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a01d7d7b-d273-4245-b56b-7444ca2cf49c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:41.938914 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a01d7d7b-d273-4245-b56b-7444ca2cf49c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:41.939348 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a01d7d7b-d273-4245-b56b-7444ca2cf49c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:41.966096 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a01d7d7b-d273-4245-b56b-7444ca2cf49c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039810 Mar 03 02:38:41.966634 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 834/1677] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:41 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:42.698444 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d351c757-1463-433d-b1cd-8a17a23fd003 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:42.699076 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d351c757-1463-433d-b1cd-8a17a23fd003 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:42.704930 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d351c757-1463-433d-b1cd-8a17a23fd003 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:42.705376 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d351c757-1463-433d-b1cd-8a17a23fd003 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:42.706148 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d351c757-1463-433d-b1cd-8a17a23fd003 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:42.706583 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d351c757-1463-433d-b1cd-8a17a23fd003 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:42.760597 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3aa3430f-c6f2-4199-a5b0-7c093d7c7761 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:42.761201 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3aa3430f-c6f2-4199-a5b0-7c093d7c7761 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:42.766480 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d351c757-1463-433d-b1cd-8a17a23fd003 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:42.766899 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3aa3430f-c6f2-4199-a5b0-7c093d7c7761 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:42.767349 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3aa3430f-c6f2-4199-a5b0-7c093d7c7761 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:42.768149 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3aa3430f-c6f2-4199-a5b0-7c093d7c7761 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:42.768586 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3aa3430f-c6f2-4199-a5b0-7c093d7c7761 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:42.775265 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d351c757-1463-433d-b1cd-8a17a23fd003 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.081229 Mar 03 02:38:42.775863 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 844/1678] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:42 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:38:42.856696 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-edb35b6b-52de-49c4-9bcb-dd93f3ff969f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:42.857604 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-edb35b6b-52de-49c4-9bcb-dd93f3ff969f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:42.863374 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-edb35b6b-52de-49c4-9bcb-dd93f3ff969f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:42.863864 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-edb35b6b-52de-49c4-9bcb-dd93f3ff969f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:42.864643 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-edb35b6b-52de-49c4-9bcb-dd93f3ff969f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:42.865073 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-edb35b6b-52de-49c4-9bcb-dd93f3ff969f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:42.894524 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-edb35b6b-52de-49c4-9bcb-dd93f3ff969f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041690 Mar 03 02:38:42.895189 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 845/1679] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:42 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:42.902199 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-3aa3430f-c6f2-4199-a5b0-7c093d7c7761 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:42.910339 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-3aa3430f-c6f2-4199-a5b0-7c093d7c7761 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:42.911860 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-3aa3430f-c6f2-4199-a5b0-7c093d7c7761 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:42.913390 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3aa3430f-c6f2-4199-a5b0-7c093d7c7761 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.157464 Mar 03 02:38:42.913935 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 835/1680] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:42 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:38:42.934667 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9e6288c0-b6e6-4f39-90d4-17bd4c88ea4d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:42.935566 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9e6288c0-b6e6-4f39-90d4-17bd4c88ea4d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:42.941312 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9e6288c0-b6e6-4f39-90d4-17bd4c88ea4d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:42.941759 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9e6288c0-b6e6-4f39-90d4-17bd4c88ea4d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:42.942577 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9e6288c0-b6e6-4f39-90d4-17bd4c88ea4d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:42.943038 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9e6288c0-b6e6-4f39-90d4-17bd4c88ea4d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:42.970823 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9e6288c0-b6e6-4f39-90d4-17bd4c88ea4d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039956 Mar 03 02:38:42.971712 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 846/1681] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:42 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:42.976553 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-43708b62-b81f-44e4-8a2a-03c384f8e61d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:42.977503 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-43708b62-b81f-44e4-8a2a-03c384f8e61d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:42.983144 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-43708b62-b81f-44e4-8a2a-03c384f8e61d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:42.983607 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-43708b62-b81f-44e4-8a2a-03c384f8e61d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:42.984405 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-43708b62-b81f-44e4-8a2a-03c384f8e61d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:42.984847 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-43708b62-b81f-44e4-8a2a-03c384f8e61d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:43.013892 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-43708b62-b81f-44e4-8a2a-03c384f8e61d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041228 Mar 03 02:38:43.014441 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 836/1682] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:42 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:43.792659 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c3c43353-5d7a-48a6-b0f1-95ae4c002f4a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:43.793358 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c3c43353-5d7a-48a6-b0f1-95ae4c002f4a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:43.799197 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c3c43353-5d7a-48a6-b0f1-95ae4c002f4a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:43.799766 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c3c43353-5d7a-48a6-b0f1-95ae4c002f4a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:43.800563 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c3c43353-5d7a-48a6-b0f1-95ae4c002f4a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:43.801011 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c3c43353-5d7a-48a6-b0f1-95ae4c002f4a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:43.862684 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c3c43353-5d7a-48a6-b0f1-95ae4c002f4a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:43.870582 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c3c43353-5d7a-48a6-b0f1-95ae4c002f4a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.082017 Mar 03 02:38:43.871481 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 847/1683] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:43 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:38:43.906567 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-12df047d-00c9-4db9-bdc7-27aa0bab226a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:43.907390 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-12df047d-00c9-4db9-bdc7-27aa0bab226a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:43.914050 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-12df047d-00c9-4db9-bdc7-27aa0bab226a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:43.914497 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-12df047d-00c9-4db9-bdc7-27aa0bab226a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:43.915267 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-12df047d-00c9-4db9-bdc7-27aa0bab226a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:43.915744 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-12df047d-00c9-4db9-bdc7-27aa0bab226a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:43.930194 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2f77cf5f-1bdf-424a-b89c-86f253984b7a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:43.930795 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2f77cf5f-1bdf-424a-b89c-86f253984b7a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:43.937150 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f77cf5f-1bdf-424a-b89c-86f253984b7a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:43.937602 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f77cf5f-1bdf-424a-b89c-86f253984b7a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:43.938385 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f77cf5f-1bdf-424a-b89c-86f253984b7a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:43.938820 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f77cf5f-1bdf-424a-b89c-86f253984b7a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:43.944934 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-12df047d-00c9-4db9-bdc7-27aa0bab226a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042533 Mar 03 02:38:43.945494 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 837/1684] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:43 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:43.982182 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b43504ce-f151-4958-87d8-24a1c5edb018 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:43.983113 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b43504ce-f151-4958-87d8-24a1c5edb018 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:43.988925 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b43504ce-f151-4958-87d8-24a1c5edb018 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:43.989381 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b43504ce-f151-4958-87d8-24a1c5edb018 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:43.990169 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b43504ce-f151-4958-87d8-24a1c5edb018 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:43.990783 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b43504ce-f151-4958-87d8-24a1c5edb018 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:44.019952 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b43504ce-f151-4958-87d8-24a1c5edb018 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041628 Mar 03 02:38:44.020520 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 838/1685] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:43 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:44.025715 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9f355f39-98d6-47e0-8abe-632dcf1b849b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:44.026618 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9f355f39-98d6-47e0-8abe-632dcf1b849b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:44.032435 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9f355f39-98d6-47e0-8abe-632dcf1b849b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:44.032912 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9f355f39-98d6-47e0-8abe-632dcf1b849b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:44.033689 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9f355f39-98d6-47e0-8abe-632dcf1b849b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:44.034121 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9f355f39-98d6-47e0-8abe-632dcf1b849b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:44.062170 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9f355f39-98d6-47e0-8abe-632dcf1b849b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040610 Mar 03 02:38:44.062897 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 839/1686] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:44 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:44.078458 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2f77cf5f-1bdf-424a-b89c-86f253984b7a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:44.087040 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2f77cf5f-1bdf-424a-b89c-86f253984b7a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:44.088554 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2f77cf5f-1bdf-424a-b89c-86f253984b7a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:44.089700 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2f77cf5f-1bdf-424a-b89c-86f253984b7a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.163499 Mar 03 02:38:44.090251 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 848/1687] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:43 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:38:44.886552 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7e766d74-d24a-48a7-ace9-64632461cae9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:44.887163 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7e766d74-d24a-48a7-ace9-64632461cae9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:44.893125 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7e766d74-d24a-48a7-ace9-64632461cae9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:44.893553 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7e766d74-d24a-48a7-ace9-64632461cae9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:44.894326 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7e766d74-d24a-48a7-ace9-64632461cae9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:44.894767 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7e766d74-d24a-48a7-ace9-64632461cae9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:44.956186 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-7e766d74-d24a-48a7-ace9-64632461cae9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:44.956717 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0a757991-d1c1-4ee3-9bf5-f7f8e2ad36d6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:44.957630 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0a757991-d1c1-4ee3-9bf5-f7f8e2ad36d6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:44.963563 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7e766d74-d24a-48a7-ace9-64632461cae9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.080866 Mar 03 02:38:44.964026 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0a757991-d1c1-4ee3-9bf5-f7f8e2ad36d6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:44.967771 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 840/1688] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:44 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:38:44.967923 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0a757991-d1c1-4ee3-9bf5-f7f8e2ad36d6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:44.967923 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0a757991-d1c1-4ee3-9bf5-f7f8e2ad36d6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:44.967923 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0a757991-d1c1-4ee3-9bf5-f7f8e2ad36d6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:44.994107 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0a757991-d1c1-4ee3-9bf5-f7f8e2ad36d6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041033 Mar 03 02:38:44.994654 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 849/1689] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:44 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:45.032044 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-197e0547-a1f0-4a41-b7c7-82e150e1cb62 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:45.032977 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-197e0547-a1f0-4a41-b7c7-82e150e1cb62 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:45.039511 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-197e0547-a1f0-4a41-b7c7-82e150e1cb62 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:45.039980 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-197e0547-a1f0-4a41-b7c7-82e150e1cb62 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:45.040754 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-197e0547-a1f0-4a41-b7c7-82e150e1cb62 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:45.041182 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-197e0547-a1f0-4a41-b7c7-82e150e1cb62 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:45.069238 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-197e0547-a1f0-4a41-b7c7-82e150e1cb62 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041180 Mar 03 02:38:45.069783 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 841/1690] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:45 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:45.073804 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-908f1037-de3a-458c-a71a-4d76260d3c9c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:45.074711 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-908f1037-de3a-458c-a71a-4d76260d3c9c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:45.080419 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-908f1037-de3a-458c-a71a-4d76260d3c9c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:45.080861 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-908f1037-de3a-458c-a71a-4d76260d3c9c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:45.081628 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-908f1037-de3a-458c-a71a-4d76260d3c9c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:45.082056 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-908f1037-de3a-458c-a71a-4d76260d3c9c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:45.107323 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-750f553c-ade0-4eb4-bce1-a50d3aa5311e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:45.107947 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-750f553c-ade0-4eb4-bce1-a50d3aa5311e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:45.110000 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-908f1037-de3a-458c-a71a-4d76260d3c9c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040180 Mar 03 02:38:45.110557 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 850/1691] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:45 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:45.113709 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-750f553c-ade0-4eb4-bce1-a50d3aa5311e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:45.114151 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-750f553c-ade0-4eb4-bce1-a50d3aa5311e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:45.114922 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-750f553c-ade0-4eb4-bce1-a50d3aa5311e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:45.115349 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-750f553c-ade0-4eb4-bce1-a50d3aa5311e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:45.246743 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-750f553c-ade0-4eb4-bce1-a50d3aa5311e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:45.254696 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-750f553c-ade0-4eb4-bce1-a50d3aa5311e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:45.256469 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-750f553c-ade0-4eb4-bce1-a50d3aa5311e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:45.257617 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-750f553c-ade0-4eb4-bce1-a50d3aa5311e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.154064 Mar 03 02:38:45.258166 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 842/1692] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:45 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:38:45.980575 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-27c5c373-caf7-45e3-8d1e-a44c2cb693f5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:45.981189 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-27c5c373-caf7-45e3-8d1e-a44c2cb693f5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:45.987360 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-27c5c373-caf7-45e3-8d1e-a44c2cb693f5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:45.987844 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-27c5c373-caf7-45e3-8d1e-a44c2cb693f5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:45.988626 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-27c5c373-caf7-45e3-8d1e-a44c2cb693f5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:45.989063 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-27c5c373-caf7-45e3-8d1e-a44c2cb693f5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:46.005807 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c4843d01-c3ba-443a-8294-37af590abbe0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:46.007664 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c4843d01-c3ba-443a-8294-37af590abbe0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:46.013562 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c4843d01-c3ba-443a-8294-37af590abbe0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:46.014037 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c4843d01-c3ba-443a-8294-37af590abbe0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:46.014813 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c4843d01-c3ba-443a-8294-37af590abbe0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:46.015245 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c4843d01-c3ba-443a-8294-37af590abbe0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:46.043943 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c4843d01-c3ba-443a-8294-37af590abbe0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041965 Mar 03 02:38:46.044857 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 843/1693] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:46 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:46.050748 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-27c5c373-caf7-45e3-8d1e-a44c2cb693f5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:46.058512 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-27c5c373-caf7-45e3-8d1e-a44c2cb693f5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.082005 Mar 03 02:38:46.059074 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 851/1694] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:45 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:38:46.080534 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c5142fe7-9071-4765-9d80-41c440fa9fcd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:46.081431 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c5142fe7-9071-4765-9d80-41c440fa9fcd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:46.087163 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c5142fe7-9071-4765-9d80-41c440fa9fcd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:46.087637 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c5142fe7-9071-4765-9d80-41c440fa9fcd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:46.088408 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c5142fe7-9071-4765-9d80-41c440fa9fcd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:46.088835 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c5142fe7-9071-4765-9d80-41c440fa9fcd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:46.116319 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c5142fe7-9071-4765-9d80-41c440fa9fcd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039049 Mar 03 02:38:46.116905 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 844/1695] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:46 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:46.121725 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3688b7bc-388d-4baa-a2cf-8e934dcdaa0d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:46.122633 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3688b7bc-388d-4baa-a2cf-8e934dcdaa0d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:46.128428 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3688b7bc-388d-4baa-a2cf-8e934dcdaa0d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:46.128877 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3688b7bc-388d-4baa-a2cf-8e934dcdaa0d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:46.129654 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3688b7bc-388d-4baa-a2cf-8e934dcdaa0d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:46.130095 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3688b7bc-388d-4baa-a2cf-8e934dcdaa0d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:46.157467 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3688b7bc-388d-4baa-a2cf-8e934dcdaa0d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040051 Mar 03 02:38:46.158047 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 852/1696] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:46 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:46.275477 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5dc63edd-6c41-47df-8bd9-27fb0bcd7e4e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:46.276021 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5dc63edd-6c41-47df-8bd9-27fb0bcd7e4e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:46.282064 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5dc63edd-6c41-47df-8bd9-27fb0bcd7e4e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:46.282453 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5dc63edd-6c41-47df-8bd9-27fb0bcd7e4e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:46.283227 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5dc63edd-6c41-47df-8bd9-27fb0bcd7e4e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:46.283813 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5dc63edd-6c41-47df-8bd9-27fb0bcd7e4e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:46.410033 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5dc63edd-6c41-47df-8bd9-27fb0bcd7e4e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:46.418763 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5dc63edd-6c41-47df-8bd9-27fb0bcd7e4e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:46.420306 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5dc63edd-6c41-47df-8bd9-27fb0bcd7e4e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:46.421444 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5dc63edd-6c41-47df-8bd9-27fb0bcd7e4e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.149932 Mar 03 02:38:46.421989 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 845/1697] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:46 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:38:47.055526 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-44f44104-c473-4474-92d2-7ad40ac94718 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:47.056450 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-44f44104-c473-4474-92d2-7ad40ac94718 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:47.062583 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-44f44104-c473-4474-92d2-7ad40ac94718 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:47.063028 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-44f44104-c473-4474-92d2-7ad40ac94718 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:47.063830 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-44f44104-c473-4474-92d2-7ad40ac94718 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:47.064261 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-44f44104-c473-4474-92d2-7ad40ac94718 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:47.075141 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5dab9bd5-38e3-44c2-9403-409c1c282cf7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:47.075787 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5dab9bd5-38e3-44c2-9403-409c1c282cf7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:47.081924 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5dab9bd5-38e3-44c2-9403-409c1c282cf7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:47.082365 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5dab9bd5-38e3-44c2-9403-409c1c282cf7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:47.083139 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5dab9bd5-38e3-44c2-9403-409c1c282cf7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:47.083568 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5dab9bd5-38e3-44c2-9403-409c1c282cf7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:47.093403 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-44f44104-c473-4474-92d2-7ad40ac94718 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041909 Mar 03 02:38:47.093975 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 853/1698] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:47 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:47.127166 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b3c9728a-a2e0-4770-86b3-aa217ac78dfe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:47.128197 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b3c9728a-a2e0-4770-86b3-aa217ac78dfe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:47.134631 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b3c9728a-a2e0-4770-86b3-aa217ac78dfe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:47.135079 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b3c9728a-a2e0-4770-86b3-aa217ac78dfe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:47.135882 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b3c9728a-a2e0-4770-86b3-aa217ac78dfe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:47.136314 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b3c9728a-a2e0-4770-86b3-aa217ac78dfe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:47.145355 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5dab9bd5-38e3-44c2-9403-409c1c282cf7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:47.153436 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5dab9bd5-38e3-44c2-9403-409c1c282cf7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.082126 Mar 03 02:38:47.153995 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 846/1699] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:47 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:38:47.164828 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b3c9728a-a2e0-4770-86b3-aa217ac78dfe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041577 Mar 03 02:38:47.165519 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 854/1700] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:47 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:47.169191 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2d3a8aac-2629-45b7-9836-0c38520b8188 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:47.170143 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2d3a8aac-2629-45b7-9836-0c38520b8188 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:47.175747 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2d3a8aac-2629-45b7-9836-0c38520b8188 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:47.176191 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2d3a8aac-2629-45b7-9836-0c38520b8188 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:47.176956 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2d3a8aac-2629-45b7-9836-0c38520b8188 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:47.177387 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2d3a8aac-2629-45b7-9836-0c38520b8188 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:47.204581 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2d3a8aac-2629-45b7-9836-0c38520b8188 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039324 Mar 03 02:38:47.205116 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 847/1701] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:47 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:47.439693 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-34a04803-d309-4fcf-88f9-dfab49b13281 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:47.440303 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-34a04803-d309-4fcf-88f9-dfab49b13281 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:47.447404 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-34a04803-d309-4fcf-88f9-dfab49b13281 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:47.447890 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-34a04803-d309-4fcf-88f9-dfab49b13281 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:47.448668 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-34a04803-d309-4fcf-88f9-dfab49b13281 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:47.449106 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-34a04803-d309-4fcf-88f9-dfab49b13281 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:47.580190 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-34a04803-d309-4fcf-88f9-dfab49b13281 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:47.588536 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-34a04803-d309-4fcf-88f9-dfab49b13281 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:47.590056 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-34a04803-d309-4fcf-88f9-dfab49b13281 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:47.591211 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-34a04803-d309-4fcf-88f9-dfab49b13281 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.155452 Mar 03 02:38:47.591805 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 855/1702] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:47 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:38:48.105515 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2fd5f2d4-4714-47d1-bcd3-ad71030a6c3b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:48.106428 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2fd5f2d4-4714-47d1-bcd3-ad71030a6c3b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:48.112656 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2fd5f2d4-4714-47d1-bcd3-ad71030a6c3b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:48.113110 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2fd5f2d4-4714-47d1-bcd3-ad71030a6c3b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:48.113891 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2fd5f2d4-4714-47d1-bcd3-ad71030a6c3b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:48.114338 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2fd5f2d4-4714-47d1-bcd3-ad71030a6c3b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:48.141799 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2fd5f2d4-4714-47d1-bcd3-ad71030a6c3b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040219 Mar 03 02:38:48.142339 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 848/1703] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:48 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:48.170138 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c8ebb769-7bf0-4705-b1be-f07d439a15b7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:48.170849 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c8ebb769-7bf0-4705-b1be-f07d439a15b7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:48.175907 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1dc61835-c8c5-4ef2-a63c-137e382a2e35 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:48.176799 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1dc61835-c8c5-4ef2-a63c-137e382a2e35 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:48.177096 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c8ebb769-7bf0-4705-b1be-f07d439a15b7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:48.177548 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c8ebb769-7bf0-4705-b1be-f07d439a15b7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:48.178396 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c8ebb769-7bf0-4705-b1be-f07d439a15b7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:48.178838 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c8ebb769-7bf0-4705-b1be-f07d439a15b7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:48.182707 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1dc61835-c8c5-4ef2-a63c-137e382a2e35 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:48.183151 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1dc61835-c8c5-4ef2-a63c-137e382a2e35 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:48.183953 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1dc61835-c8c5-4ef2-a63c-137e382a2e35 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:48.184384 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1dc61835-c8c5-4ef2-a63c-137e382a2e35 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:48.212678 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1dc61835-c8c5-4ef2-a63c-137e382a2e35 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040501 Mar 03 02:38:48.213244 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 849/1704] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:48 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:48.217809 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2725b63e-d65b-4b32-92a1-f4c70f19cb54 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:48.218694 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2725b63e-d65b-4b32-92a1-f4c70f19cb54 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:48.224315 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2725b63e-d65b-4b32-92a1-f4c70f19cb54 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:48.224783 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2725b63e-d65b-4b32-92a1-f4c70f19cb54 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:48.226390 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2725b63e-d65b-4b32-92a1-f4c70f19cb54 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:48.226822 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2725b63e-d65b-4b32-92a1-f4c70f19cb54 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:48.241904 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c8ebb769-7bf0-4705-b1be-f07d439a15b7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:48.249609 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c8ebb769-7bf0-4705-b1be-f07d439a15b7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.083345 Mar 03 02:38:48.250181 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 856/1705] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:48 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:38:48.254173 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2725b63e-d65b-4b32-92a1-f4c70f19cb54 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039935 Mar 03 02:38:48.254723 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 850/1706] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:48 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:48.609116 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8a453a3b-df54-4cf5-8de2-be1c1f03a23b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:48.609711 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8a453a3b-df54-4cf5-8de2-be1c1f03a23b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:48.615376 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8a453a3b-df54-4cf5-8de2-be1c1f03a23b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:48.616205 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8a453a3b-df54-4cf5-8de2-be1c1f03a23b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:48.617083 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8a453a3b-df54-4cf5-8de2-be1c1f03a23b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:48.617520 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8a453a3b-df54-4cf5-8de2-be1c1f03a23b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:48.747338 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8a453a3b-df54-4cf5-8de2-be1c1f03a23b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:48.755468 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8a453a3b-df54-4cf5-8de2-be1c1f03a23b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:48.757486 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8a453a3b-df54-4cf5-8de2-be1c1f03a23b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:48.758641 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8a453a3b-df54-4cf5-8de2-be1c1f03a23b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.153423 Mar 03 02:38:48.759208 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 857/1707] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:48 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:38:49.153094 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f8f786ad-48e3-4d58-b76a-b19a365a91c4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:49.154030 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f8f786ad-48e3-4d58-b76a-b19a365a91c4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:49.160229 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f8f786ad-48e3-4d58-b76a-b19a365a91c4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:49.160682 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f8f786ad-48e3-4d58-b76a-b19a365a91c4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:49.161458 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f8f786ad-48e3-4d58-b76a-b19a365a91c4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:49.161896 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f8f786ad-48e3-4d58-b76a-b19a365a91c4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:49.190585 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f8f786ad-48e3-4d58-b76a-b19a365a91c4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041490 Mar 03 02:38:49.191128 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 851/1708] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:49 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:49.223920 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-63857747-682c-44f7-9bfa-1e3bf7163b81 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:49.225324 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-63857747-682c-44f7-9bfa-1e3bf7163b81 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:49.231578 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-63857747-682c-44f7-9bfa-1e3bf7163b81 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:49.232050 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-63857747-682c-44f7-9bfa-1e3bf7163b81 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:49.232823 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-63857747-682c-44f7-9bfa-1e3bf7163b81 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:49.233254 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-63857747-682c-44f7-9bfa-1e3bf7163b81 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:49.263470 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-63857747-682c-44f7-9bfa-1e3bf7163b81 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043403 Mar 03 02:38:49.264080 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 858/1709] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:49 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:49.264993 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5998ecf6-1493-4173-b9d4-0b1bef22ef78 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:49.265901 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5998ecf6-1493-4173-b9d4-0b1bef22ef78 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:49.270592 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6090545c-e5fc-43b5-9329-74dc3de8c5fc tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:49.271197 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6090545c-e5fc-43b5-9329-74dc3de8c5fc tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:49.271953 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5998ecf6-1493-4173-b9d4-0b1bef22ef78 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:49.272441 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5998ecf6-1493-4173-b9d4-0b1bef22ef78 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:49.273370 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5998ecf6-1493-4173-b9d4-0b1bef22ef78 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:49.273813 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5998ecf6-1493-4173-b9d4-0b1bef22ef78 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:49.277633 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6090545c-e5fc-43b5-9329-74dc3de8c5fc tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:49.278090 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6090545c-e5fc-43b5-9329-74dc3de8c5fc tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:49.278963 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6090545c-e5fc-43b5-9329-74dc3de8c5fc tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:49.279445 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6090545c-e5fc-43b5-9329-74dc3de8c5fc tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:49.303641 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5998ecf6-1493-4173-b9d4-0b1bef22ef78 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041870 Mar 03 02:38:49.304128 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 852/1710] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:49 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:49.341251 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-6090545c-e5fc-43b5-9329-74dc3de8c5fc tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:49.348513 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6090545c-e5fc-43b5-9329-74dc3de8c5fc tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.083517 Mar 03 02:38:49.349074 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 859/1711] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:49 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:38:49.777044 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f5d46d6d-af34-419a-bd33-5dc2b1d5323e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:49.777681 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f5d46d6d-af34-419a-bd33-5dc2b1d5323e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:49.783467 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f5d46d6d-af34-419a-bd33-5dc2b1d5323e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:49.783949 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f5d46d6d-af34-419a-bd33-5dc2b1d5323e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:49.784726 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f5d46d6d-af34-419a-bd33-5dc2b1d5323e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:49.785162 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f5d46d6d-af34-419a-bd33-5dc2b1d5323e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:49.912185 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f5d46d6d-af34-419a-bd33-5dc2b1d5323e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:49.921084 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f5d46d6d-af34-419a-bd33-5dc2b1d5323e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:49.922585 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f5d46d6d-af34-419a-bd33-5dc2b1d5323e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:49.923793 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f5d46d6d-af34-419a-bd33-5dc2b1d5323e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.150610 Mar 03 02:38:49.924359 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 853/1712] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:49 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:38:50.202797 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-41245483-7ccc-4e9b-82e6-87a3b4edc032 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:50.203689 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-41245483-7ccc-4e9b-82e6-87a3b4edc032 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:50.210063 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-41245483-7ccc-4e9b-82e6-87a3b4edc032 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:50.210519 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-41245483-7ccc-4e9b-82e6-87a3b4edc032 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:50.211301 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-41245483-7ccc-4e9b-82e6-87a3b4edc032 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:50.211764 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-41245483-7ccc-4e9b-82e6-87a3b4edc032 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:50.239405 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-41245483-7ccc-4e9b-82e6-87a3b4edc032 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040735 Mar 03 02:38:50.240066 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 860/1713] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:50 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:50.275933 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8144639f-df25-40de-85b9-ddffcf203074 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:50.276874 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8144639f-df25-40de-85b9-ddffcf203074 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:50.283042 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8144639f-df25-40de-85b9-ddffcf203074 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:50.283491 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8144639f-df25-40de-85b9-ddffcf203074 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:50.284301 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8144639f-df25-40de-85b9-ddffcf203074 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:50.284739 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8144639f-df25-40de-85b9-ddffcf203074 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:50.312979 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8144639f-df25-40de-85b9-ddffcf203074 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042143 Mar 03 02:38:50.313529 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 854/1714] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:50 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:50.314186 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d1baf6b0-8813-4daa-8367-749778209845 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:50.315114 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d1baf6b0-8813-4daa-8367-749778209845 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:50.321821 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d1baf6b0-8813-4daa-8367-749778209845 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:50.322273 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d1baf6b0-8813-4daa-8367-749778209845 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:50.323052 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d1baf6b0-8813-4daa-8367-749778209845 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:50.323484 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d1baf6b0-8813-4daa-8367-749778209845 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:50.351066 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d1baf6b0-8813-4daa-8367-749778209845 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040756 Mar 03 02:38:50.351627 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 861/1715] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:50 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:50.366298 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-29b030fe-f57f-4bbd-82a5-1dcd14d7ca22 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:50.366904 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-29b030fe-f57f-4bbd-82a5-1dcd14d7ca22 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:50.372916 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-29b030fe-f57f-4bbd-82a5-1dcd14d7ca22 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:50.373367 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-29b030fe-f57f-4bbd-82a5-1dcd14d7ca22 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:50.374143 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-29b030fe-f57f-4bbd-82a5-1dcd14d7ca22 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:50.374577 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-29b030fe-f57f-4bbd-82a5-1dcd14d7ca22 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:50.431904 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-29b030fe-f57f-4bbd-82a5-1dcd14d7ca22 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:50.439077 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-29b030fe-f57f-4bbd-82a5-1dcd14d7ca22 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.077114 Mar 03 02:38:50.439655 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 855/1716] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:50 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:38:50.940916 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-45d219ee-0f5d-4f02-922e-77507f11119d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:50.941516 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-45d219ee-0f5d-4f02-922e-77507f11119d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:50.947701 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-45d219ee-0f5d-4f02-922e-77507f11119d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:50.948147 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-45d219ee-0f5d-4f02-922e-77507f11119d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:50.948916 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-45d219ee-0f5d-4f02-922e-77507f11119d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:50.949349 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-45d219ee-0f5d-4f02-922e-77507f11119d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:51.080175 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-45d219ee-0f5d-4f02-922e-77507f11119d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:51.088848 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-45d219ee-0f5d-4f02-922e-77507f11119d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:51.090336 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-45d219ee-0f5d-4f02-922e-77507f11119d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:51.091473 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-45d219ee-0f5d-4f02-922e-77507f11119d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.154516 Mar 03 02:38:51.092062 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 862/1717] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:50 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:38:51.251509 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-081d074d-fb4c-4429-b2f3-f287ceaadb27 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:51.252361 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-081d074d-fb4c-4429-b2f3-f287ceaadb27 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:51.258466 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-081d074d-fb4c-4429-b2f3-f287ceaadb27 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:51.258940 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-081d074d-fb4c-4429-b2f3-f287ceaadb27 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:51.259947 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-081d074d-fb4c-4429-b2f3-f287ceaadb27 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:51.260386 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-081d074d-fb4c-4429-b2f3-f287ceaadb27 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:51.291732 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-081d074d-fb4c-4429-b2f3-f287ceaadb27 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044274 Mar 03 02:38:51.292377 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 856/1718] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:51 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:51.324473 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-911010b4-2c92-49fd-a92c-02acf738de8b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:51.325436 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-911010b4-2c92-49fd-a92c-02acf738de8b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:51.331578 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-911010b4-2c92-49fd-a92c-02acf738de8b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:51.332055 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-911010b4-2c92-49fd-a92c-02acf738de8b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:51.332822 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-911010b4-2c92-49fd-a92c-02acf738de8b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:51.333262 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-911010b4-2c92-49fd-a92c-02acf738de8b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:51.362267 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f4239e9f-3c7d-4c3e-b85a-6677a535fb9a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:51.362635 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-911010b4-2c92-49fd-a92c-02acf738de8b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042097 Mar 03 02:38:51.363174 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f4239e9f-3c7d-4c3e-b85a-6677a535fb9a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:51.363310 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 863/1719] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:51 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:51.369465 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f4239e9f-3c7d-4c3e-b85a-6677a535fb9a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:51.369910 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f4239e9f-3c7d-4c3e-b85a-6677a535fb9a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:51.370687 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f4239e9f-3c7d-4c3e-b85a-6677a535fb9a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:51.371120 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f4239e9f-3c7d-4c3e-b85a-6677a535fb9a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:51.398643 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f4239e9f-3c7d-4c3e-b85a-6677a535fb9a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040262 Mar 03 02:38:51.399185 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 857/1720] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:51 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:51.456552 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f22ea59f-3186-4e9d-aab4-3334df2074f5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:51.457163 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f22ea59f-3186-4e9d-aab4-3334df2074f5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:51.464073 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f22ea59f-3186-4e9d-aab4-3334df2074f5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:51.464526 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f22ea59f-3186-4e9d-aab4-3334df2074f5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:51.465305 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f22ea59f-3186-4e9d-aab4-3334df2074f5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:51.465744 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f22ea59f-3186-4e9d-aab4-3334df2074f5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:51.525638 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f22ea59f-3186-4e9d-aab4-3334df2074f5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:51.532763 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f22ea59f-3186-4e9d-aab4-3334df2074f5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.080148 Mar 03 02:38:51.533339 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 864/1721] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:51 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:38:52.110292 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-68142a54-fa09-45fa-951e-e331cad4528c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:52.110885 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-68142a54-fa09-45fa-951e-e331cad4528c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:52.116841 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-68142a54-fa09-45fa-951e-e331cad4528c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:52.117282 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-68142a54-fa09-45fa-951e-e331cad4528c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:52.118044 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-68142a54-fa09-45fa-951e-e331cad4528c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:52.118474 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-68142a54-fa09-45fa-951e-e331cad4528c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:52.248483 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-68142a54-fa09-45fa-951e-e331cad4528c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:52.256506 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-68142a54-fa09-45fa-951e-e331cad4528c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:52.258767 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-68142a54-fa09-45fa-951e-e331cad4528c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:52.259942 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-68142a54-fa09-45fa-951e-e331cad4528c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.153506 Mar 03 02:38:52.260496 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 858/1722] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:52 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:38:52.302365 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-cdb5f5d4-c1b7-4fc4-9673-24bbd732a2df tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:52.303246 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-cdb5f5d4-c1b7-4fc4-9673-24bbd732a2df tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:52.309160 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cdb5f5d4-c1b7-4fc4-9673-24bbd732a2df tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:52.309613 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cdb5f5d4-c1b7-4fc4-9673-24bbd732a2df tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:52.310424 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cdb5f5d4-c1b7-4fc4-9673-24bbd732a2df tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:52.310861 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cdb5f5d4-c1b7-4fc4-9673-24bbd732a2df tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:52.339691 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-cdb5f5d4-c1b7-4fc4-9673-24bbd732a2df tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041287 Mar 03 02:38:52.340315 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 865/1723] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:52 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:52.374106 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-66c16d27-860b-4759-b0eb-2eb189c86c5c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:52.375141 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-66c16d27-860b-4759-b0eb-2eb189c86c5c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:52.380940 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-66c16d27-860b-4759-b0eb-2eb189c86c5c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:52.381384 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-66c16d27-860b-4759-b0eb-2eb189c86c5c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:52.382153 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-66c16d27-860b-4759-b0eb-2eb189c86c5c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:52.383167 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-66c16d27-860b-4759-b0eb-2eb189c86c5c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:52.409991 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-977ff36a-63e2-4481-8ee0-cd7a8f978f4f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:52.410901 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-977ff36a-63e2-4481-8ee0-cd7a8f978f4f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:52.411176 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-66c16d27-860b-4759-b0eb-2eb189c86c5c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040946 Mar 03 02:38:52.411752 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 859/1724] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:52 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:52.417181 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-977ff36a-63e2-4481-8ee0-cd7a8f978f4f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:52.417628 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-977ff36a-63e2-4481-8ee0-cd7a8f978f4f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:52.418414 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-977ff36a-63e2-4481-8ee0-cd7a8f978f4f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:52.418851 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-977ff36a-63e2-4481-8ee0-cd7a8f978f4f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:52.447176 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-977ff36a-63e2-4481-8ee0-cd7a8f978f4f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041077 Mar 03 02:38:52.447750 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 866/1725] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:52 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:52.549628 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-68aa9403-ae43-4d58-ba21-3f79686e8502 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:52.550232 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-68aa9403-ae43-4d58-ba21-3f79686e8502 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:52.556506 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-68aa9403-ae43-4d58-ba21-3f79686e8502 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:52.556892 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-68aa9403-ae43-4d58-ba21-3f79686e8502 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:52.557655 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-68aa9403-ae43-4d58-ba21-3f79686e8502 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:52.558083 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-68aa9403-ae43-4d58-ba21-3f79686e8502 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:52.614676 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-68aa9403-ae43-4d58-ba21-3f79686e8502 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:52.622704 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-68aa9403-ae43-4d58-ba21-3f79686e8502 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.076939 Mar 03 02:38:52.623263 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 860/1726] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:52 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:38:53.278083 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-61ab88e8-eee3-43bc-a576-dff6097fdb62 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:53.278610 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-61ab88e8-eee3-43bc-a576-dff6097fdb62 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:53.284547 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-61ab88e8-eee3-43bc-a576-dff6097fdb62 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:53.285015 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-61ab88e8-eee3-43bc-a576-dff6097fdb62 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:53.285822 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-61ab88e8-eee3-43bc-a576-dff6097fdb62 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:53.286261 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-61ab88e8-eee3-43bc-a576-dff6097fdb62 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:53.351894 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-770a22c0-7b98-45fd-a091-21337daf81c4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:53.352993 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-770a22c0-7b98-45fd-a091-21337daf81c4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:53.359182 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-770a22c0-7b98-45fd-a091-21337daf81c4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:53.359657 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-770a22c0-7b98-45fd-a091-21337daf81c4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:53.360453 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-770a22c0-7b98-45fd-a091-21337daf81c4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:53.360891 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-770a22c0-7b98-45fd-a091-21337daf81c4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:53.390207 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-770a22c0-7b98-45fd-a091-21337daf81c4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042886 Mar 03 02:38:53.390842 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 861/1727] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:53 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:53.420175 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-61ab88e8-eee3-43bc-a576-dff6097fdb62 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:53.422492 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9d9da314-3091-4042-96a6-17afdae3d797 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:53.423396 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9d9da314-3091-4042-96a6-17afdae3d797 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:53.428500 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-61ab88e8-eee3-43bc-a576-dff6097fdb62 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:53.429063 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9d9da314-3091-4042-96a6-17afdae3d797 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:53.429570 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9d9da314-3091-4042-96a6-17afdae3d797 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:53.430030 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-61ab88e8-eee3-43bc-a576-dff6097fdb62 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:53.430350 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9d9da314-3091-4042-96a6-17afdae3d797 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:53.430927 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9d9da314-3091-4042-96a6-17afdae3d797 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:53.431432 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-61ab88e8-eee3-43bc-a576-dff6097fdb62 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.157434 Mar 03 02:38:53.432295 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 867/1728] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:53 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:38:53.458150 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8dbe82ad-3c19-4798-a3b4-74c328ff23f9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:53.458626 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9d9da314-3091-4042-96a6-17afdae3d797 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040012 Mar 03 02:38:53.459065 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8dbe82ad-3c19-4798-a3b4-74c328ff23f9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:53.459187 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 862/1729] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:53 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:53.465472 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8dbe82ad-3c19-4798-a3b4-74c328ff23f9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:53.465929 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8dbe82ad-3c19-4798-a3b4-74c328ff23f9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:53.466718 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8dbe82ad-3c19-4798-a3b4-74c328ff23f9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:53.467158 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8dbe82ad-3c19-4798-a3b4-74c328ff23f9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:53.495201 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8dbe82ad-3c19-4798-a3b4-74c328ff23f9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040895 Mar 03 02:38:53.495782 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 868/1730] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:53 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:53.638752 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2e707bd2-3137-4de7-95e8-a081e6ea1c07 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:53.639355 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2e707bd2-3137-4de7-95e8-a081e6ea1c07 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:53.645145 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2e707bd2-3137-4de7-95e8-a081e6ea1c07 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:53.645587 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2e707bd2-3137-4de7-95e8-a081e6ea1c07 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:53.646354 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2e707bd2-3137-4de7-95e8-a081e6ea1c07 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:53.646807 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2e707bd2-3137-4de7-95e8-a081e6ea1c07 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:53.704279 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2e707bd2-3137-4de7-95e8-a081e6ea1c07 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:53.712210 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2e707bd2-3137-4de7-95e8-a081e6ea1c07 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.076988 Mar 03 02:38:53.712772 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 863/1731] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:53 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:38:54.401719 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2d6a29e1-ef1d-4fe0-8a6a-17dace500f8c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:54.402628 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2d6a29e1-ef1d-4fe0-8a6a-17dace500f8c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:54.408826 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2d6a29e1-ef1d-4fe0-8a6a-17dace500f8c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:54.409269 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2d6a29e1-ef1d-4fe0-8a6a-17dace500f8c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:54.410038 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2d6a29e1-ef1d-4fe0-8a6a-17dace500f8c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:54.410474 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2d6a29e1-ef1d-4fe0-8a6a-17dace500f8c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:54.437989 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2d6a29e1-ef1d-4fe0-8a6a-17dace500f8c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040318 Mar 03 02:38:54.438565 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 869/1732] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:54 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:54.450345 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c0f5a083-0dd7-45d8-a457-4abbe5ab5f9b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:54.450961 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c0f5a083-0dd7-45d8-a457-4abbe5ab5f9b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:54.457166 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c0f5a083-0dd7-45d8-a457-4abbe5ab5f9b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:54.457618 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c0f5a083-0dd7-45d8-a457-4abbe5ab5f9b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:54.458398 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c0f5a083-0dd7-45d8-a457-4abbe5ab5f9b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:54.458836 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c0f5a083-0dd7-45d8-a457-4abbe5ab5f9b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:54.470136 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-602a18ba-b8b7-4b4c-8333-56cf11459748 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:54.471063 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-602a18ba-b8b7-4b4c-8333-56cf11459748 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:54.477513 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-602a18ba-b8b7-4b4c-8333-56cf11459748 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:54.477954 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-602a18ba-b8b7-4b4c-8333-56cf11459748 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:54.478726 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-602a18ba-b8b7-4b4c-8333-56cf11459748 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:54.479154 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-602a18ba-b8b7-4b4c-8333-56cf11459748 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:54.507702 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-602a18ba-b8b7-4b4c-8333-56cf11459748 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041210 Mar 03 02:38:54.508272 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 870/1733] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:54 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:54.512740 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f6155225-6d40-4225-8151-dc7b2c09173a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:54.513633 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f6155225-6d40-4225-8151-dc7b2c09173a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:54.519116 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f6155225-6d40-4225-8151-dc7b2c09173a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:54.519560 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f6155225-6d40-4225-8151-dc7b2c09173a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:54.520371 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f6155225-6d40-4225-8151-dc7b2c09173a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:54.520799 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f6155225-6d40-4225-8151-dc7b2c09173a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:54.548271 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f6155225-6d40-4225-8151-dc7b2c09173a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038995 Mar 03 02:38:54.548830 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 871/1734] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:54 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:54.592003 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c0f5a083-0dd7-45d8-a457-4abbe5ab5f9b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:54.600200 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c0f5a083-0dd7-45d8-a457-4abbe5ab5f9b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:54.602362 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c0f5a083-0dd7-45d8-a457-4abbe5ab5f9b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:54.603512 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c0f5a083-0dd7-45d8-a457-4abbe5ab5f9b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.157367 Mar 03 02:38:54.604092 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 864/1735] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:54 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:38:54.729943 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-411b567e-2910-4714-8955-09dae454aaf1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:54.730482 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-411b567e-2910-4714-8955-09dae454aaf1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:54.736294 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-411b567e-2910-4714-8955-09dae454aaf1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:54.736748 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-411b567e-2910-4714-8955-09dae454aaf1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:54.737525 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-411b567e-2910-4714-8955-09dae454aaf1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:54.737962 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-411b567e-2910-4714-8955-09dae454aaf1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:54.796886 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-411b567e-2910-4714-8955-09dae454aaf1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:54.804235 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-411b567e-2910-4714-8955-09dae454aaf1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.079092 Mar 03 02:38:54.805881 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 872/1736] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:54 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:38:55.450143 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f4971748-972a-4092-a9f2-09bfb4e0e64f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:55.451393 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f4971748-972a-4092-a9f2-09bfb4e0e64f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:55.457669 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f4971748-972a-4092-a9f2-09bfb4e0e64f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:55.458125 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f4971748-972a-4092-a9f2-09bfb4e0e64f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:55.458905 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f4971748-972a-4092-a9f2-09bfb4e0e64f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:55.459350 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f4971748-972a-4092-a9f2-09bfb4e0e64f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:55.486875 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f4971748-972a-4092-a9f2-09bfb4e0e64f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040771 Mar 03 02:38:55.487415 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 865/1737] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:55 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:55.518914 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f1a65720-4157-4664-9431-7f3b382d6aca tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:55.519843 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f1a65720-4157-4664-9431-7f3b382d6aca tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:55.526829 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f1a65720-4157-4664-9431-7f3b382d6aca tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:55.527276 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f1a65720-4157-4664-9431-7f3b382d6aca tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:55.528087 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f1a65720-4157-4664-9431-7f3b382d6aca tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:55.528525 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f1a65720-4157-4664-9431-7f3b382d6aca tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:55.556699 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f1a65720-4157-4664-9431-7f3b382d6aca tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041761 Mar 03 02:38:55.557258 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 873/1738] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:55 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:55.559965 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d621c603-d3bd-44f1-a756-2669d41c0980 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:55.560876 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d621c603-d3bd-44f1-a756-2669d41c0980 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:55.566608 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d621c603-d3bd-44f1-a756-2669d41c0980 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:55.567078 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d621c603-d3bd-44f1-a756-2669d41c0980 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:55.567876 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d621c603-d3bd-44f1-a756-2669d41c0980 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:55.568317 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d621c603-d3bd-44f1-a756-2669d41c0980 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:55.598781 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d621c603-d3bd-44f1-a756-2669d41c0980 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042713 Mar 03 02:38:55.599331 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 866/1739] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:55 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:55.622466 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1b23463f-2bc1-470d-add0-328a3ad13691 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:55.623072 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1b23463f-2bc1-470d-add0-328a3ad13691 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:55.628874 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1b23463f-2bc1-470d-add0-328a3ad13691 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:55.629326 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1b23463f-2bc1-470d-add0-328a3ad13691 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:55.630102 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1b23463f-2bc1-470d-add0-328a3ad13691 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:55.630543 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1b23463f-2bc1-470d-add0-328a3ad13691 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:55.763851 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1b23463f-2bc1-470d-add0-328a3ad13691 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:55.771977 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1b23463f-2bc1-470d-add0-328a3ad13691 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:55.773589 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1b23463f-2bc1-470d-add0-328a3ad13691 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:55.774771 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1b23463f-2bc1-470d-add0-328a3ad13691 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.156395 Mar 03 02:38:55.775333 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 874/1740] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:55 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:38:55.822251 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-740dd307-ce5c-4f8d-88a3-bee6a4ff5e81 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:55.822863 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-740dd307-ce5c-4f8d-88a3-bee6a4ff5e81 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:55.828702 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-740dd307-ce5c-4f8d-88a3-bee6a4ff5e81 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:55.829159 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-740dd307-ce5c-4f8d-88a3-bee6a4ff5e81 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:55.829941 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-740dd307-ce5c-4f8d-88a3-bee6a4ff5e81 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:55.830415 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-740dd307-ce5c-4f8d-88a3-bee6a4ff5e81 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:55.888483 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-740dd307-ce5c-4f8d-88a3-bee6a4ff5e81 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:55.895524 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-740dd307-ce5c-4f8d-88a3-bee6a4ff5e81 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.077832 Mar 03 02:38:55.896186 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 867/1741] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:55 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:38:56.498629 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4d0d373e-4681-4c48-ac6e-935a02934943 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:56.499544 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4d0d373e-4681-4c48-ac6e-935a02934943 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:56.505417 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4d0d373e-4681-4c48-ac6e-935a02934943 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:56.505866 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4d0d373e-4681-4c48-ac6e-935a02934943 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:56.506639 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4d0d373e-4681-4c48-ac6e-935a02934943 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:56.507080 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4d0d373e-4681-4c48-ac6e-935a02934943 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:56.534925 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4d0d373e-4681-4c48-ac6e-935a02934943 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040315 Mar 03 02:38:56.535516 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 875/1742] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:56 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:56.567124 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-bc4e5576-e385-43df-93c0-583b5ccea9fc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:56.568069 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-bc4e5576-e385-43df-93c0-583b5ccea9fc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:56.574332 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bc4e5576-e385-43df-93c0-583b5ccea9fc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:56.574777 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bc4e5576-e385-43df-93c0-583b5ccea9fc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:56.575548 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bc4e5576-e385-43df-93c0-583b5ccea9fc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:56.576007 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bc4e5576-e385-43df-93c0-583b5ccea9fc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:56.603976 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-bc4e5576-e385-43df-93c0-583b5ccea9fc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040791 Mar 03 02:38:56.604706 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 868/1743] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:56 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:56.610147 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d7624d88-5431-47ce-9c20-26e6ea33c1f5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:56.611119 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d7624d88-5431-47ce-9c20-26e6ea33c1f5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:56.616876 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d7624d88-5431-47ce-9c20-26e6ea33c1f5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:56.617960 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d7624d88-5431-47ce-9c20-26e6ea33c1f5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:56.619007 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d7624d88-5431-47ce-9c20-26e6ea33c1f5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:56.619446 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d7624d88-5431-47ce-9c20-26e6ea33c1f5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:56.646626 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d7624d88-5431-47ce-9c20-26e6ea33c1f5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040419 Mar 03 02:38:56.647175 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 876/1744] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:56 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:56.792515 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f8eed858-b071-4128-9774-d1f7002c24c2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:56.793046 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f8eed858-b071-4128-9774-d1f7002c24c2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:56.798988 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f8eed858-b071-4128-9774-d1f7002c24c2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:56.799470 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f8eed858-b071-4128-9774-d1f7002c24c2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:56.800294 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f8eed858-b071-4128-9774-d1f7002c24c2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:56.800736 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f8eed858-b071-4128-9774-d1f7002c24c2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:56.912401 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3363e3ca-90fa-4d60-b9da-46b85ff351fd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:56.913014 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3363e3ca-90fa-4d60-b9da-46b85ff351fd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:56.918888 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3363e3ca-90fa-4d60-b9da-46b85ff351fd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:56.919345 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3363e3ca-90fa-4d60-b9da-46b85ff351fd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:56.920226 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3363e3ca-90fa-4d60-b9da-46b85ff351fd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:56.920671 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3363e3ca-90fa-4d60-b9da-46b85ff351fd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:56.930867 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f8eed858-b071-4128-9774-d1f7002c24c2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:56.939103 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f8eed858-b071-4128-9774-d1f7002c24c2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:56.940713 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f8eed858-b071-4128-9774-d1f7002c24c2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:56.941973 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f8eed858-b071-4128-9774-d1f7002c24c2 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.153454 Mar 03 02:38:56.942600 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 869/1745] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:56 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:38:56.979760 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3363e3ca-90fa-4d60-b9da-46b85ff351fd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:56.986924 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3363e3ca-90fa-4d60-b9da-46b85ff351fd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078357 Mar 03 02:38:56.987491 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 877/1746] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:56 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:38:57.546368 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-46e301a2-da1a-4f48-aeba-a54da4fa4dca tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:57.547271 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-46e301a2-da1a-4f48-aeba-a54da4fa4dca tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:57.553056 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-46e301a2-da1a-4f48-aeba-a54da4fa4dca tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:57.553503 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-46e301a2-da1a-4f48-aeba-a54da4fa4dca tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:57.554270 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-46e301a2-da1a-4f48-aeba-a54da4fa4dca tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:57.555577 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-46e301a2-da1a-4f48-aeba-a54da4fa4dca tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:57.582921 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-46e301a2-da1a-4f48-aeba-a54da4fa4dca tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040483 Mar 03 02:38:57.583527 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 870/1747] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:57 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:57.615504 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1d98c0e1-1aaf-441a-8620-29547f7950da tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:57.616447 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1d98c0e1-1aaf-441a-8620-29547f7950da tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:57.623412 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1d98c0e1-1aaf-441a-8620-29547f7950da tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:57.623923 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1d98c0e1-1aaf-441a-8620-29547f7950da tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:57.624714 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1d98c0e1-1aaf-441a-8620-29547f7950da tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:57.625186 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1d98c0e1-1aaf-441a-8620-29547f7950da tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:57.654585 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1d98c0e1-1aaf-441a-8620-29547f7950da tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042983 Mar 03 02:38:57.655183 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 878/1748] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:57 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:57.658372 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5a00147e-8c98-4b51-bfbe-dfdceb880843 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:57.659273 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5a00147e-8c98-4b51-bfbe-dfdceb880843 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:57.665192 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5a00147e-8c98-4b51-bfbe-dfdceb880843 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:57.665633 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5a00147e-8c98-4b51-bfbe-dfdceb880843 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:57.666404 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5a00147e-8c98-4b51-bfbe-dfdceb880843 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:57.666838 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5a00147e-8c98-4b51-bfbe-dfdceb880843 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:57.693754 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5a00147e-8c98-4b51-bfbe-dfdceb880843 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039186 Mar 03 02:38:57.694245 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 871/1749] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:57 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:57.961291 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c72978e1-190f-44de-8f22-6e5f33fc91bf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:57.961487 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c72978e1-190f-44de-8f22-6e5f33fc91bf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:57.967185 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c72978e1-190f-44de-8f22-6e5f33fc91bf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:57.967653 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c72978e1-190f-44de-8f22-6e5f33fc91bf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:57.968423 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c72978e1-190f-44de-8f22-6e5f33fc91bf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:57.968856 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c72978e1-190f-44de-8f22-6e5f33fc91bf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:58.003823 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0ed337b3-128c-4c58-9ae6-c30d81b3ce3d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:58.004462 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0ed337b3-128c-4c58-9ae6-c30d81b3ce3d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:58.011765 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0ed337b3-128c-4c58-9ae6-c30d81b3ce3d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:58.012222 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0ed337b3-128c-4c58-9ae6-c30d81b3ce3d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:58.013013 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0ed337b3-128c-4c58-9ae6-c30d81b3ce3d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:58.013449 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0ed337b3-128c-4c58-9ae6-c30d81b3ce3d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:58.075173 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0ed337b3-128c-4c58-9ae6-c30d81b3ce3d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:58.082410 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0ed337b3-128c-4c58-9ae6-c30d81b3ce3d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.082394 Mar 03 02:38:58.083187 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 872/1750] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:57 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:38:58.108409 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c72978e1-190f-44de-8f22-6e5f33fc91bf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:58.116566 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c72978e1-190f-44de-8f22-6e5f33fc91bf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:58.118897 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c72978e1-190f-44de-8f22-6e5f33fc91bf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:58.120091 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c72978e1-190f-44de-8f22-6e5f33fc91bf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.163264 Mar 03 02:38:58.120655 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 879/1751] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:57 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:38:58.594373 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c964aae5-37fb-4ad3-b66d-b945a7d1cae0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:58.595273 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c964aae5-37fb-4ad3-b66d-b945a7d1cae0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:58.601542 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c964aae5-37fb-4ad3-b66d-b945a7d1cae0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:58.602483 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c964aae5-37fb-4ad3-b66d-b945a7d1cae0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:58.603250 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c964aae5-37fb-4ad3-b66d-b945a7d1cae0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:58.603677 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c964aae5-37fb-4ad3-b66d-b945a7d1cae0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:58.631080 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c964aae5-37fb-4ad3-b66d-b945a7d1cae0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040700 Mar 03 02:38:58.631643 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 873/1752] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:58 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:58.666634 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2c68393d-9ced-495c-9382-218a944d2fc9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:58.667568 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2c68393d-9ced-495c-9382-218a944d2fc9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:58.674812 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2c68393d-9ced-495c-9382-218a944d2fc9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:58.675261 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2c68393d-9ced-495c-9382-218a944d2fc9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:58.676089 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2c68393d-9ced-495c-9382-218a944d2fc9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:58.676512 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2c68393d-9ced-495c-9382-218a944d2fc9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:58.704667 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2c68393d-9ced-495c-9382-218a944d2fc9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042552 Mar 03 02:38:58.705366 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 880/1753] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:58 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:58.705865 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-571cef6f-2235-499a-a8e6-d456ec36c884 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:58.706763 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-571cef6f-2235-499a-a8e6-d456ec36c884 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:58.713447 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-571cef6f-2235-499a-a8e6-d456ec36c884 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:58.713886 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-571cef6f-2235-499a-a8e6-d456ec36c884 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:58.714658 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-571cef6f-2235-499a-a8e6-d456ec36c884 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:58.715095 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-571cef6f-2235-499a-a8e6-d456ec36c884 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:58.742932 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-571cef6f-2235-499a-a8e6-d456ec36c884 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040788 Mar 03 02:38:58.743475 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 874/1754] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:58 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:38:59.100129 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-062a9d4c-9ecd-4e93-bff1-599588ad38cb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:59.100739 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-062a9d4c-9ecd-4e93-bff1-599588ad38cb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:59.107070 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-062a9d4c-9ecd-4e93-bff1-599588ad38cb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:59.107530 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-062a9d4c-9ecd-4e93-bff1-599588ad38cb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:59.108345 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-062a9d4c-9ecd-4e93-bff1-599588ad38cb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:59.108780 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-062a9d4c-9ecd-4e93-bff1-599588ad38cb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:59.138689 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-101f4755-7602-4aaa-8b5c-b94e2b8c131b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:59.139286 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-101f4755-7602-4aaa-8b5c-b94e2b8c131b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:59.145018 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-101f4755-7602-4aaa-8b5c-b94e2b8c131b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:59.145458 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-101f4755-7602-4aaa-8b5c-b94e2b8c131b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:59.146230 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-101f4755-7602-4aaa-8b5c-b94e2b8c131b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:59.146731 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-101f4755-7602-4aaa-8b5c-b94e2b8c131b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:59.167762 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-062a9d4c-9ecd-4e93-bff1-599588ad38cb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:59.175083 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-062a9d4c-9ecd-4e93-bff1-599588ad38cb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078866 Mar 03 02:38:59.175669 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 881/1755] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:38:59 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:38:59.282871 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-101f4755-7602-4aaa-8b5c-b94e2b8c131b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:59.291192 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-101f4755-7602-4aaa-8b5c-b94e2b8c131b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:59.293038 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-101f4755-7602-4aaa-8b5c-b94e2b8c131b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:38:59.294184 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-101f4755-7602-4aaa-8b5c-b94e2b8c131b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.159402 Mar 03 02:38:59.294855 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 875/1756] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:38:59 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:38:59.642395 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7449f717-dbe7-45fb-a4b2-0320282a94b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:59.643307 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7449f717-dbe7-45fb-a4b2-0320282a94b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:59.649823 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7449f717-dbe7-45fb-a4b2-0320282a94b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:59.650271 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7449f717-dbe7-45fb-a4b2-0320282a94b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:59.651049 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7449f717-dbe7-45fb-a4b2-0320282a94b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:59.651487 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7449f717-dbe7-45fb-a4b2-0320282a94b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:59.679558 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7449f717-dbe7-45fb-a4b2-0320282a94b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041150 Mar 03 02:38:59.680354 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 882/1757] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:59 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:59.716853 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-435dd8dd-9bc7-4aea-bda3-7e680fe1eb6a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:59.717768 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-435dd8dd-9bc7-4aea-bda3-7e680fe1eb6a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:59.723996 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-435dd8dd-9bc7-4aea-bda3-7e680fe1eb6a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:59.724446 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-435dd8dd-9bc7-4aea-bda3-7e680fe1eb6a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:59.725226 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-435dd8dd-9bc7-4aea-bda3-7e680fe1eb6a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:59.725726 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-435dd8dd-9bc7-4aea-bda3-7e680fe1eb6a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:59.753756 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-435dd8dd-9bc7-4aea-bda3-7e680fe1eb6a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040850 Mar 03 02:38:59.754465 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3b969dcd-8ee7-4b9f-b527-a9f4447fc57b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:38:59.754589 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 876/1758] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:59 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:38:59.755416 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3b969dcd-8ee7-4b9f-b527-a9f4447fc57b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:38:59.761822 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3b969dcd-8ee7-4b9f-b527-a9f4447fc57b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:59.762271 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3b969dcd-8ee7-4b9f-b527-a9f4447fc57b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:59.763054 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3b969dcd-8ee7-4b9f-b527-a9f4447fc57b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:38:59.763488 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3b969dcd-8ee7-4b9f-b527-a9f4447fc57b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:38:59.791309 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3b969dcd-8ee7-4b9f-b527-a9f4447fc57b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040905 Mar 03 02:38:59.791901 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 883/1759] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:38:59 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:39:00.191488 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3980461b-e4f8-42fc-8147-a3eb12d19be7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:00.192125 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3980461b-e4f8-42fc-8147-a3eb12d19be7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:00.198599 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3980461b-e4f8-42fc-8147-a3eb12d19be7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:00.199044 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3980461b-e4f8-42fc-8147-a3eb12d19be7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:00.199843 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3980461b-e4f8-42fc-8147-a3eb12d19be7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:00.200276 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3980461b-e4f8-42fc-8147-a3eb12d19be7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:00.258799 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-3980461b-e4f8-42fc-8147-a3eb12d19be7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:00.266014 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3980461b-e4f8-42fc-8147-a3eb12d19be7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078419 Mar 03 02:39:00.266569 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 877/1760] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:00 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:00.313084 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d1a78259-5f43-4986-8bfb-fa91040fd3c7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:00.313623 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d1a78259-5f43-4986-8bfb-fa91040fd3c7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:00.319400 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d1a78259-5f43-4986-8bfb-fa91040fd3c7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:00.320004 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d1a78259-5f43-4986-8bfb-fa91040fd3c7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:00.321376 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d1a78259-5f43-4986-8bfb-fa91040fd3c7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:00.321836 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d1a78259-5f43-4986-8bfb-fa91040fd3c7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:00.451145 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d1a78259-5f43-4986-8bfb-fa91040fd3c7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:00.459333 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d1a78259-5f43-4986-8bfb-fa91040fd3c7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:00.461189 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d1a78259-5f43-4986-8bfb-fa91040fd3c7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:00.462428 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d1a78259-5f43-4986-8bfb-fa91040fd3c7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.153176 Mar 03 02:39:00.463018 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 884/1761] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:39:00 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:39:00.690902 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f901cb38-3772-42de-ae3e-3cf93ae9fd90 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:00.691844 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f901cb38-3772-42de-ae3e-3cf93ae9fd90 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:00.697648 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f901cb38-3772-42de-ae3e-3cf93ae9fd90 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:00.698097 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f901cb38-3772-42de-ae3e-3cf93ae9fd90 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:00.698870 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f901cb38-3772-42de-ae3e-3cf93ae9fd90 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:00.699298 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f901cb38-3772-42de-ae3e-3cf93ae9fd90 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:00.726971 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f901cb38-3772-42de-ae3e-3cf93ae9fd90 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039437 Mar 03 02:39:00.727677 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 878/1762] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:00 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:00.766064 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1d87bf3a-2606-47ff-8b68-0c23ac38f468 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:00.766962 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1d87bf3a-2606-47ff-8b68-0c23ac38f468 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:00.773203 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1d87bf3a-2606-47ff-8b68-0c23ac38f468 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:00.773655 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1d87bf3a-2606-47ff-8b68-0c23ac38f468 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:00.774420 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1d87bf3a-2606-47ff-8b68-0c23ac38f468 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:00.774850 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1d87bf3a-2606-47ff-8b68-0c23ac38f468 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:00.802291 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8c42c164-f093-4388-8703-fe6701d384c1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:00.803204 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8c42c164-f093-4388-8703-fe6701d384c1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:00.803313 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1d87bf3a-2606-47ff-8b68-0c23ac38f468 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041156 Mar 03 02:39:00.803839 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 885/1763] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:00 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:00.810047 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8c42c164-f093-4388-8703-fe6701d384c1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:00.810504 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8c42c164-f093-4388-8703-fe6701d384c1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:00.811294 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8c42c164-f093-4388-8703-fe6701d384c1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:00.811768 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8c42c164-f093-4388-8703-fe6701d384c1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:00.840406 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8c42c164-f093-4388-8703-fe6701d384c1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042017 Mar 03 02:39:00.840953 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 879/1764] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:00 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:39:01.282437 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e4c4ade5-c9db-4407-9202-7b4c99a1555c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:01.283041 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e4c4ade5-c9db-4407-9202-7b4c99a1555c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:01.288992 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e4c4ade5-c9db-4407-9202-7b4c99a1555c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:01.289547 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e4c4ade5-c9db-4407-9202-7b4c99a1555c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:01.290334 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e4c4ade5-c9db-4407-9202-7b4c99a1555c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:01.290776 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e4c4ade5-c9db-4407-9202-7b4c99a1555c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:01.350614 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e4c4ade5-c9db-4407-9202-7b4c99a1555c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:01.359121 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e4c4ade5-c9db-4407-9202-7b4c99a1555c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.080705 Mar 03 02:39:01.359712 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 886/1765] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:01 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:01.480994 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-108fdd09-add4-438b-8d03-081181059cb0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:01.481594 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-108fdd09-add4-438b-8d03-081181059cb0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:01.487310 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-108fdd09-add4-438b-8d03-081181059cb0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:01.487788 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-108fdd09-add4-438b-8d03-081181059cb0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:01.488557 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-108fdd09-add4-438b-8d03-081181059cb0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:01.488993 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-108fdd09-add4-438b-8d03-081181059cb0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:01.621050 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-108fdd09-add4-438b-8d03-081181059cb0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:01.629079 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-108fdd09-add4-438b-8d03-081181059cb0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:01.630561 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-108fdd09-add4-438b-8d03-081181059cb0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:01.631732 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-108fdd09-add4-438b-8d03-081181059cb0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.155231 Mar 03 02:39:01.632281 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 880/1766] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:39:01 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:39:01.738232 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4864fcd3-0712-4063-a0d2-afcdfa0ea161 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:01.739136 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4864fcd3-0712-4063-a0d2-afcdfa0ea161 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:01.745272 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4864fcd3-0712-4063-a0d2-afcdfa0ea161 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:01.745715 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4864fcd3-0712-4063-a0d2-afcdfa0ea161 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:01.746487 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4864fcd3-0712-4063-a0d2-afcdfa0ea161 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:01.746924 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4864fcd3-0712-4063-a0d2-afcdfa0ea161 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:01.775705 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4864fcd3-0712-4063-a0d2-afcdfa0ea161 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041314 Mar 03 02:39:01.776363 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 887/1767] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:01 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:01.814233 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1ed325b7-53a1-4990-981f-aa4fde0ac401 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:01.815163 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1ed325b7-53a1-4990-981f-aa4fde0ac401 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:01.821454 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1ed325b7-53a1-4990-981f-aa4fde0ac401 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:01.821900 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1ed325b7-53a1-4990-981f-aa4fde0ac401 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:01.822675 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1ed325b7-53a1-4990-981f-aa4fde0ac401 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:01.823101 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1ed325b7-53a1-4990-981f-aa4fde0ac401 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:01.853146 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e836edb5-a8e6-4794-8d5d-d9311776faba tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:01.853394 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1ed325b7-53a1-4990-981f-aa4fde0ac401 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042991 Mar 03 02:39:01.853921 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 881/1768] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:01 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:01.854108 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e836edb5-a8e6-4794-8d5d-d9311776faba tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:01.860086 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e836edb5-a8e6-4794-8d5d-d9311776faba tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:01.860528 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e836edb5-a8e6-4794-8d5d-d9311776faba tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:01.861310 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e836edb5-a8e6-4794-8d5d-d9311776faba tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:01.861742 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e836edb5-a8e6-4794-8d5d-d9311776faba tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:01.891039 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e836edb5-a8e6-4794-8d5d-d9311776faba tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043228 Mar 03 02:39:01.891516 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 888/1769] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:01 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:39:02.376638 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-747f36e0-8652-430c-84f2-d5a6a666423c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:02.377246 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-747f36e0-8652-430c-84f2-d5a6a666423c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:02.383184 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-747f36e0-8652-430c-84f2-d5a6a666423c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:02.383732 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-747f36e0-8652-430c-84f2-d5a6a666423c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:02.384505 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-747f36e0-8652-430c-84f2-d5a6a666423c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:02.384937 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-747f36e0-8652-430c-84f2-d5a6a666423c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:02.441723 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-747f36e0-8652-430c-84f2-d5a6a666423c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:02.449141 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-747f36e0-8652-430c-84f2-d5a6a666423c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.076397 Mar 03 02:39:02.449697 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 882/1770] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:02 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:39:02.649612 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9c2333b1-479c-45df-8ad8-4ab98fe17888 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:02.650138 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9c2333b1-479c-45df-8ad8-4ab98fe17888 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:02.656364 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9c2333b1-479c-45df-8ad8-4ab98fe17888 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:02.656810 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9c2333b1-479c-45df-8ad8-4ab98fe17888 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:02.657578 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9c2333b1-479c-45df-8ad8-4ab98fe17888 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:02.658010 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9c2333b1-479c-45df-8ad8-4ab98fe17888 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:02.786479 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7576edf7-8b4b-4885-a8d7-dac71336511e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:02.787383 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7576edf7-8b4b-4885-a8d7-dac71336511e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:02.791370 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9c2333b1-479c-45df-8ad8-4ab98fe17888 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:02.793995 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7576edf7-8b4b-4885-a8d7-dac71336511e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:02.794442 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7576edf7-8b4b-4885-a8d7-dac71336511e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:02.795226 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7576edf7-8b4b-4885-a8d7-dac71336511e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:02.795679 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7576edf7-8b4b-4885-a8d7-dac71336511e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:02.800285 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9c2333b1-479c-45df-8ad8-4ab98fe17888 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:02.802041 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9c2333b1-479c-45df-8ad8-4ab98fe17888 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:02.803201 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9c2333b1-479c-45df-8ad8-4ab98fe17888 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.157591 Mar 03 02:39:02.803800 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 889/1771] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:39:02 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:39:02.824616 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7576edf7-8b4b-4885-a8d7-dac71336511e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042125 Mar 03 02:39:02.825316 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 883/1772] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:02 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:39:02.865184 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c9bad6c8-fff6-4f30-95bf-7e03adaf25e3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:02.866109 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c9bad6c8-fff6-4f30-95bf-7e03adaf25e3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:02.872814 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c9bad6c8-fff6-4f30-95bf-7e03adaf25e3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:02.873269 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c9bad6c8-fff6-4f30-95bf-7e03adaf25e3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:02.874054 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c9bad6c8-fff6-4f30-95bf-7e03adaf25e3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:02.874496 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c9bad6c8-fff6-4f30-95bf-7e03adaf25e3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:02.902093 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c9bad6c8-fff6-4f30-95bf-7e03adaf25e3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041067 Mar 03 02:39:02.902298 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9444fddc-c9a9-44bf-9c06-995065d3b8ed tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:02.902578 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 890/1773] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:02 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:39:02.903325 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9444fddc-c9a9-44bf-9c06-995065d3b8ed tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:02.909154 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9444fddc-c9a9-44bf-9c06-995065d3b8ed tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:02.909590 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9444fddc-c9a9-44bf-9c06-995065d3b8ed tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:02.910363 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9444fddc-c9a9-44bf-9c06-995065d3b8ed tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:02.910794 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9444fddc-c9a9-44bf-9c06-995065d3b8ed tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:02.938967 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9444fddc-c9a9-44bf-9c06-995065d3b8ed tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040562 Mar 03 02:39:02.939509 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 884/1774] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:02 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:39:02.956931 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 02:39:02.957107 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: Thu Mar 3 02:39:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 03 02:39:03.466320 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-938bbf11-1840-4d12-b1d1-032dded996ff tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:03.466928 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-938bbf11-1840-4d12-b1d1-032dded996ff tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:03.472747 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-938bbf11-1840-4d12-b1d1-032dded996ff tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:03.473190 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-938bbf11-1840-4d12-b1d1-032dded996ff tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:03.473954 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-938bbf11-1840-4d12-b1d1-032dded996ff tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:03.474388 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-938bbf11-1840-4d12-b1d1-032dded996ff tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:03.534858 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-938bbf11-1840-4d12-b1d1-032dded996ff tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:03.543220 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-938bbf11-1840-4d12-b1d1-032dded996ff tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.080467 Mar 03 02:39:03.543959 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 891/1775] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:03 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:03.822573 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7ea892a3-5cca-4714-9975-5a5d2885e3e4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:03.823189 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7ea892a3-5cca-4714-9975-5a5d2885e3e4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:03.829428 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7ea892a3-5cca-4714-9975-5a5d2885e3e4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:03.830049 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7ea892a3-5cca-4714-9975-5a5d2885e3e4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:03.830636 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7ea892a3-5cca-4714-9975-5a5d2885e3e4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:03.831078 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7ea892a3-5cca-4714-9975-5a5d2885e3e4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:03.837837 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1a2d09ee-4ee9-4557-a214-f947bafbc864 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:03.838778 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1a2d09ee-4ee9-4557-a214-f947bafbc864 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:03.845210 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1a2d09ee-4ee9-4557-a214-f947bafbc864 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:03.845657 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1a2d09ee-4ee9-4557-a214-f947bafbc864 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:03.846467 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1a2d09ee-4ee9-4557-a214-f947bafbc864 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:03.846899 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1a2d09ee-4ee9-4557-a214-f947bafbc864 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:03.878811 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1a2d09ee-4ee9-4557-a214-f947bafbc864 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044964 Mar 03 02:39:03.879379 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 892/1776] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:03 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:39:03.913803 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8305a0e4-c2a3-4bc1-a1f3-42452b1e54a8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:03.914731 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8305a0e4-c2a3-4bc1-a1f3-42452b1e54a8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:03.921213 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8305a0e4-c2a3-4bc1-a1f3-42452b1e54a8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:03.921661 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8305a0e4-c2a3-4bc1-a1f3-42452b1e54a8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:03.922449 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8305a0e4-c2a3-4bc1-a1f3-42452b1e54a8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:03.922884 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8305a0e4-c2a3-4bc1-a1f3-42452b1e54a8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:03.951931 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8305a0e4-c2a3-4bc1-a1f3-42452b1e54a8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042394 Mar 03 02:39:03.952494 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 893/1777] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:03 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:39:03.956986 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-da71a277-5e1f-4b55-a6d3-46a64f8acf5f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:03.957870 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-da71a277-5e1f-4b55-a6d3-46a64f8acf5f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:03.963927 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-da71a277-5e1f-4b55-a6d3-46a64f8acf5f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:03.964373 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-da71a277-5e1f-4b55-a6d3-46a64f8acf5f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:03.965147 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-da71a277-5e1f-4b55-a6d3-46a64f8acf5f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:03.965580 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-da71a277-5e1f-4b55-a6d3-46a64f8acf5f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:03.973681 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-7ea892a3-5cca-4714-9975-5a5d2885e3e4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:03.982282 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-7ea892a3-5cca-4714-9975-5a5d2885e3e4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:03.983796 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-7ea892a3-5cca-4714-9975-5a5d2885e3e4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:03.984936 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7ea892a3-5cca-4714-9975-5a5d2885e3e4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.167027 Mar 03 02:39:03.985487 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 885/1778] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:39:03 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:39:03.996669 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-da71a277-5e1f-4b55-a6d3-46a64f8acf5f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043151 Mar 03 02:39:03.997230 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 894/1779] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:03 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:04.132329 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 02:39:04.133120 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: Thu Mar 3 02:39:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 03 02:39:04.561461 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-659b47a1-6ee1-4dad-96d0-6043d19400bd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:04.562065 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-659b47a1-6ee1-4dad-96d0-6043d19400bd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:04.568004 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-659b47a1-6ee1-4dad-96d0-6043d19400bd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:04.568454 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-659b47a1-6ee1-4dad-96d0-6043d19400bd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:04.569236 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-659b47a1-6ee1-4dad-96d0-6043d19400bd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:04.569669 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-659b47a1-6ee1-4dad-96d0-6043d19400bd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:04.641691 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-659b47a1-6ee1-4dad-96d0-6043d19400bd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:04.650353 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-659b47a1-6ee1-4dad-96d0-6043d19400bd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.092807 Mar 03 02:39:04.650918 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 886/1780] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:04 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:04.890572 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b2eb80cc-fb39-4e08-ac97-dde655569f48 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:04.891502 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b2eb80cc-fb39-4e08-ac97-dde655569f48 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:04.897769 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b2eb80cc-fb39-4e08-ac97-dde655569f48 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:04.898821 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b2eb80cc-fb39-4e08-ac97-dde655569f48 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:04.899535 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b2eb80cc-fb39-4e08-ac97-dde655569f48 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:04.900004 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b2eb80cc-fb39-4e08-ac97-dde655569f48 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:04.928884 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b2eb80cc-fb39-4e08-ac97-dde655569f48 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042293 Mar 03 02:39:04.929521 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 895/1781] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:04 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:04.962840 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-41a5efd1-9bbb-440c-85a2-1c31ac1177cc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:04.963787 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-41a5efd1-9bbb-440c-85a2-1c31ac1177cc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:04.970476 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-41a5efd1-9bbb-440c-85a2-1c31ac1177cc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:04.970927 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-41a5efd1-9bbb-440c-85a2-1c31ac1177cc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:04.971738 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-41a5efd1-9bbb-440c-85a2-1c31ac1177cc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:04.972179 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-41a5efd1-9bbb-440c-85a2-1c31ac1177cc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:05.000526 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-41a5efd1-9bbb-440c-85a2-1c31ac1177cc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042134 Mar 03 02:39:05.001233 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 887/1782] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:04 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:05.003888 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c0742782-9c65-4e29-881a-f8e046a6704a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:05.004662 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c0742782-9c65-4e29-881a-f8e046a6704a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:05.008803 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-057db8ff-ec22-47c5-a60a-5247ec8727bc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:05.009671 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-057db8ff-ec22-47c5-a60a-5247ec8727bc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:05.011100 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c0742782-9c65-4e29-881a-f8e046a6704a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:05.011566 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c0742782-9c65-4e29-881a-f8e046a6704a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:05.012391 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c0742782-9c65-4e29-881a-f8e046a6704a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:05.012831 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c0742782-9c65-4e29-881a-f8e046a6704a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:05.016010 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-057db8ff-ec22-47c5-a60a-5247ec8727bc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:05.016460 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-057db8ff-ec22-47c5-a60a-5247ec8727bc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:05.017247 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-057db8ff-ec22-47c5-a60a-5247ec8727bc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:05.017682 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-057db8ff-ec22-47c5-a60a-5247ec8727bc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:05.046617 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-057db8ff-ec22-47c5-a60a-5247ec8727bc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042090 Mar 03 02:39:05.047383 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 888/1783] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:05 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:39:05.147235 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c0742782-9c65-4e29-881a-f8e046a6704a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:05.156108 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c0742782-9c65-4e29-881a-f8e046a6704a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:05.157627 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c0742782-9c65-4e29-881a-f8e046a6704a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:05.158788 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c0742782-9c65-4e29-881a-f8e046a6704a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.158846 Mar 03 02:39:05.159349 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 896/1784] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:39:04 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:39:05.666669 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-93b9b0a8-4803-431d-8264-4dc01b321232 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:05.667278 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-93b9b0a8-4803-431d-8264-4dc01b321232 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:05.673103 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-93b9b0a8-4803-431d-8264-4dc01b321232 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:05.673560 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-93b9b0a8-4803-431d-8264-4dc01b321232 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:05.674342 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-93b9b0a8-4803-431d-8264-4dc01b321232 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:05.674784 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-93b9b0a8-4803-431d-8264-4dc01b321232 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:05.735385 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-93b9b0a8-4803-431d-8264-4dc01b321232 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:05.743843 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-93b9b0a8-4803-431d-8264-4dc01b321232 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.081188 Mar 03 02:39:05.744398 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 889/1785] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:05 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:05.940796 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8386ad4d-7a8c-41a4-b736-8eb7234a9e53 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:05.941698 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8386ad4d-7a8c-41a4-b736-8eb7234a9e53 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:05.948114 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8386ad4d-7a8c-41a4-b736-8eb7234a9e53 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:05.948561 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8386ad4d-7a8c-41a4-b736-8eb7234a9e53 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:05.949337 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8386ad4d-7a8c-41a4-b736-8eb7234a9e53 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:05.949768 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8386ad4d-7a8c-41a4-b736-8eb7234a9e53 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:05.977385 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8386ad4d-7a8c-41a4-b736-8eb7234a9e53 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040464 Mar 03 02:39:05.977931 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 897/1786] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:05 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:39:06.012019 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-cdc16aeb-8d17-4e42-93b7-81bcdb5337c0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:06.012914 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-cdc16aeb-8d17-4e42-93b7-81bcdb5337c0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:06.019062 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cdc16aeb-8d17-4e42-93b7-81bcdb5337c0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:06.019506 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cdc16aeb-8d17-4e42-93b7-81bcdb5337c0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:06.020308 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cdc16aeb-8d17-4e42-93b7-81bcdb5337c0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:06.020741 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cdc16aeb-8d17-4e42-93b7-81bcdb5337c0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:06.048838 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-cdc16aeb-8d17-4e42-93b7-81bcdb5337c0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040897 Mar 03 02:39:06.049390 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 890/1787] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:06 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:06.058734 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3120cb94-63c4-44ba-9088-96bb515c2590 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:06.059681 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3120cb94-63c4-44ba-9088-96bb515c2590 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:06.065579 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3120cb94-63c4-44ba-9088-96bb515c2590 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:06.066032 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3120cb94-63c4-44ba-9088-96bb515c2590 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:06.066819 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3120cb94-63c4-44ba-9088-96bb515c2590 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:06.067262 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3120cb94-63c4-44ba-9088-96bb515c2590 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:06.094498 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3120cb94-63c4-44ba-9088-96bb515c2590 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040365 Mar 03 02:39:06.095036 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 898/1788] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:06 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:06.176505 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2c97132b-90e3-4647-a137-037d9f5e8538 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:06.177107 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2c97132b-90e3-4647-a137-037d9f5e8538 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:06.183378 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2c97132b-90e3-4647-a137-037d9f5e8538 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:06.183853 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2c97132b-90e3-4647-a137-037d9f5e8538 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:06.184625 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2c97132b-90e3-4647-a137-037d9f5e8538 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:06.185059 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2c97132b-90e3-4647-a137-037d9f5e8538 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:06.313772 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2c97132b-90e3-4647-a137-037d9f5e8538 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:06.322803 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2c97132b-90e3-4647-a137-037d9f5e8538 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:06.324336 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2c97132b-90e3-4647-a137-037d9f5e8538 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:06.325497 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2c97132b-90e3-4647-a137-037d9f5e8538 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.152855 Mar 03 02:39:06.326158 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 891/1789] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:39:06 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:39:06.760901 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-89412dd2-2eba-449b-98df-33f54dd0adcd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:06.761517 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-89412dd2-2eba-449b-98df-33f54dd0adcd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:06.767393 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-89412dd2-2eba-449b-98df-33f54dd0adcd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:06.767875 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-89412dd2-2eba-449b-98df-33f54dd0adcd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:06.768660 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-89412dd2-2eba-449b-98df-33f54dd0adcd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:06.769099 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-89412dd2-2eba-449b-98df-33f54dd0adcd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:06.829639 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-89412dd2-2eba-449b-98df-33f54dd0adcd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:06.837030 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-89412dd2-2eba-449b-98df-33f54dd0adcd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.080640 Mar 03 02:39:06.837787 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 899/1790] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:06 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:06.988256 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9427ceb7-e7a5-42eb-b1a1-3c6e24d8292b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:06.989166 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9427ceb7-e7a5-42eb-b1a1-3c6e24d8292b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:06.995950 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9427ceb7-e7a5-42eb-b1a1-3c6e24d8292b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:06.996409 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9427ceb7-e7a5-42eb-b1a1-3c6e24d8292b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:06.997200 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9427ceb7-e7a5-42eb-b1a1-3c6e24d8292b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:06.997639 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9427ceb7-e7a5-42eb-b1a1-3c6e24d8292b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:07.026148 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9427ceb7-e7a5-42eb-b1a1-3c6e24d8292b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041811 Mar 03 02:39:07.026751 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 892/1791] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:06 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:07.061134 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c51d4b5c-080c-4b81-89b2-344e4cdf4e0c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:07.062046 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c51d4b5c-080c-4b81-89b2-344e4cdf4e0c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:07.068225 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c51d4b5c-080c-4b81-89b2-344e4cdf4e0c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:07.068672 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c51d4b5c-080c-4b81-89b2-344e4cdf4e0c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:07.069447 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c51d4b5c-080c-4b81-89b2-344e4cdf4e0c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:07.069912 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c51d4b5c-080c-4b81-89b2-344e4cdf4e0c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:07.097547 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c51d4b5c-080c-4b81-89b2-344e4cdf4e0c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040464 Mar 03 02:39:07.098091 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 900/1792] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:07 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:39:07.105794 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5cdb1ba6-9b10-4391-a24f-ebe85905f11f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:07.106686 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5cdb1ba6-9b10-4391-a24f-ebe85905f11f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:07.112461 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5cdb1ba6-9b10-4391-a24f-ebe85905f11f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:07.112905 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5cdb1ba6-9b10-4391-a24f-ebe85905f11f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:07.113674 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5cdb1ba6-9b10-4391-a24f-ebe85905f11f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:07.114103 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5cdb1ba6-9b10-4391-a24f-ebe85905f11f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:07.142193 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5cdb1ba6-9b10-4391-a24f-ebe85905f11f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040310 Mar 03 02:39:07.142729 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 893/1793] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:07 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:07.343869 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5523efd3-7467-4da5-83c5-64edb2315ebb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:07.344475 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5523efd3-7467-4da5-83c5-64edb2315ebb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:07.350234 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5523efd3-7467-4da5-83c5-64edb2315ebb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:07.350678 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5523efd3-7467-4da5-83c5-64edb2315ebb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:07.352007 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5523efd3-7467-4da5-83c5-64edb2315ebb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:07.352525 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5523efd3-7467-4da5-83c5-64edb2315ebb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:07.485816 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5523efd3-7467-4da5-83c5-64edb2315ebb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:07.494724 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5523efd3-7467-4da5-83c5-64edb2315ebb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:07.496247 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5523efd3-7467-4da5-83c5-64edb2315ebb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:07.497388 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5523efd3-7467-4da5-83c5-64edb2315ebb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.157467 Mar 03 02:39:07.497944 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 901/1794] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:39:07 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:39:07.854591 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3eaea788-de5d-4cdf-ae20-a41933560b5f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:07.855192 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3eaea788-de5d-4cdf-ae20-a41933560b5f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:07.860984 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3eaea788-de5d-4cdf-ae20-a41933560b5f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:07.861431 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3eaea788-de5d-4cdf-ae20-a41933560b5f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:07.862201 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3eaea788-de5d-4cdf-ae20-a41933560b5f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:07.862630 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3eaea788-de5d-4cdf-ae20-a41933560b5f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:07.921728 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-3eaea788-de5d-4cdf-ae20-a41933560b5f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:07.929024 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3eaea788-de5d-4cdf-ae20-a41933560b5f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.079241 Mar 03 02:39:07.929604 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 894/1795] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:07 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:39:08.038049 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-84040fba-97b2-49b2-aa9d-dac9b3cbc06e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:08.039166 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-84040fba-97b2-49b2-aa9d-dac9b3cbc06e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:08.045044 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-84040fba-97b2-49b2-aa9d-dac9b3cbc06e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:08.045491 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-84040fba-97b2-49b2-aa9d-dac9b3cbc06e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:08.046269 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-84040fba-97b2-49b2-aa9d-dac9b3cbc06e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:08.046703 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-84040fba-97b2-49b2-aa9d-dac9b3cbc06e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:08.075454 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-84040fba-97b2-49b2-aa9d-dac9b3cbc06e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041344 Mar 03 02:39:08.076095 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 902/1796] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:08 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:08.108922 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f5b0b0d3-e556-4ff8-a888-724574c43c34 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:08.110383 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f5b0b0d3-e556-4ff8-a888-724574c43c34 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:08.116618 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f5b0b0d3-e556-4ff8-a888-724574c43c34 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:08.117129 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f5b0b0d3-e556-4ff8-a888-724574c43c34 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:08.117911 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f5b0b0d3-e556-4ff8-a888-724574c43c34 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:08.118348 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f5b0b0d3-e556-4ff8-a888-724574c43c34 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:08.148020 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f5b0b0d3-e556-4ff8-a888-724574c43c34 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042987 Mar 03 02:39:08.149347 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 895/1797] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:08 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:08.155095 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-685ea1e9-9aff-4714-ab00-35677cdca3e3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:08.156033 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-685ea1e9-9aff-4714-ab00-35677cdca3e3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:08.161890 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-685ea1e9-9aff-4714-ab00-35677cdca3e3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:08.162337 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-685ea1e9-9aff-4714-ab00-35677cdca3e3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:08.163115 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-685ea1e9-9aff-4714-ab00-35677cdca3e3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:08.163555 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-685ea1e9-9aff-4714-ab00-35677cdca3e3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:08.190768 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-685ea1e9-9aff-4714-ab00-35677cdca3e3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039595 Mar 03 02:39:08.191303 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 903/1798] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:08 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:39:08.514638 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-32b5cf86-4467-4db2-b8e9-05a33b0ab6e0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:08.515233 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-32b5cf86-4467-4db2-b8e9-05a33b0ab6e0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:08.521106 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-32b5cf86-4467-4db2-b8e9-05a33b0ab6e0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:08.521551 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-32b5cf86-4467-4db2-b8e9-05a33b0ab6e0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:08.522315 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-32b5cf86-4467-4db2-b8e9-05a33b0ab6e0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:08.522747 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-32b5cf86-4467-4db2-b8e9-05a33b0ab6e0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:08.653164 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-32b5cf86-4467-4db2-b8e9-05a33b0ab6e0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:08.661170 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-32b5cf86-4467-4db2-b8e9-05a33b0ab6e0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:08.662657 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-32b5cf86-4467-4db2-b8e9-05a33b0ab6e0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:08.664472 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-32b5cf86-4467-4db2-b8e9-05a33b0ab6e0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.153102 Mar 03 02:39:08.665029 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 896/1799] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:39:08 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:39:08.945537 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4e89eec4-0326-4c63-9883-a98bfeb7bd41 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:08.946163 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4e89eec4-0326-4c63-9883-a98bfeb7bd41 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:08.951976 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4e89eec4-0326-4c63-9883-a98bfeb7bd41 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:08.952429 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4e89eec4-0326-4c63-9883-a98bfeb7bd41 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:08.953212 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4e89eec4-0326-4c63-9883-a98bfeb7bd41 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:08.953648 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4e89eec4-0326-4c63-9883-a98bfeb7bd41 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:09.011948 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4e89eec4-0326-4c63-9883-a98bfeb7bd41 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:09.019248 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4e89eec4-0326-4c63-9883-a98bfeb7bd41 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.077709 Mar 03 02:39:09.019830 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 904/1800] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:08 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:09.087443 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-dd00ff7c-4b54-4980-97b4-85f70564cad3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:09.088376 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-dd00ff7c-4b54-4980-97b4-85f70564cad3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:09.094169 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dd00ff7c-4b54-4980-97b4-85f70564cad3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:09.094618 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dd00ff7c-4b54-4980-97b4-85f70564cad3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:09.095399 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dd00ff7c-4b54-4980-97b4-85f70564cad3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:09.095867 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dd00ff7c-4b54-4980-97b4-85f70564cad3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:09.125033 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-dd00ff7c-4b54-4980-97b4-85f70564cad3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042580 Mar 03 02:39:09.125653 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 897/1801] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:09 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:09.160020 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-29c9a05b-612b-481f-abb4-6337a843dca8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:09.160965 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-29c9a05b-612b-481f-abb4-6337a843dca8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:09.168076 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-29c9a05b-612b-481f-abb4-6337a843dca8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:09.168588 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-29c9a05b-612b-481f-abb4-6337a843dca8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:09.169454 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-29c9a05b-612b-481f-abb4-6337a843dca8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:09.169916 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-29c9a05b-612b-481f-abb4-6337a843dca8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:09.198602 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-29c9a05b-612b-481f-abb4-6337a843dca8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042513 Mar 03 02:39:09.199101 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 905/1802] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:09 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:09.202239 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-52471217-1d75-4a92-a59d-43c7b6001055 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:09.203150 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-52471217-1d75-4a92-a59d-43c7b6001055 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:09.208944 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-52471217-1d75-4a92-a59d-43c7b6001055 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:09.209392 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-52471217-1d75-4a92-a59d-43c7b6001055 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:09.210168 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-52471217-1d75-4a92-a59d-43c7b6001055 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:09.211142 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-52471217-1d75-4a92-a59d-43c7b6001055 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:09.239392 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-52471217-1d75-4a92-a59d-43c7b6001055 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041199 Mar 03 02:39:09.239968 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 898/1803] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:09 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:39:09.682334 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e2905176-72fd-49f9-a7aa-4b4bfba23a9b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:09.682948 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e2905176-72fd-49f9-a7aa-4b4bfba23a9b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:09.688837 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e2905176-72fd-49f9-a7aa-4b4bfba23a9b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:09.689293 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e2905176-72fd-49f9-a7aa-4b4bfba23a9b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:09.690078 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e2905176-72fd-49f9-a7aa-4b4bfba23a9b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:09.690522 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e2905176-72fd-49f9-a7aa-4b4bfba23a9b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:09.825102 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e2905176-72fd-49f9-a7aa-4b4bfba23a9b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:09.833289 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e2905176-72fd-49f9-a7aa-4b4bfba23a9b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:09.834794 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e2905176-72fd-49f9-a7aa-4b4bfba23a9b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:09.836093 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e2905176-72fd-49f9-a7aa-4b4bfba23a9b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.157724 Mar 03 02:39:09.836700 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 906/1804] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:39:09 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:39:10.035700 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ebdcea58-a2e7-4727-9250-22ec45be2117 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:10.036249 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ebdcea58-a2e7-4727-9250-22ec45be2117 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:10.042378 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ebdcea58-a2e7-4727-9250-22ec45be2117 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:10.042831 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ebdcea58-a2e7-4727-9250-22ec45be2117 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:10.043594 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ebdcea58-a2e7-4727-9250-22ec45be2117 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:10.044051 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ebdcea58-a2e7-4727-9250-22ec45be2117 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:10.102333 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ebdcea58-a2e7-4727-9250-22ec45be2117 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:10.109479 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ebdcea58-a2e7-4727-9250-22ec45be2117 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.077683 Mar 03 02:39:10.110096 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 899/1805] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:10 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:10.136947 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a8892bd9-10ad-4f55-a7d1-97d7d3e3e4e2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:10.137928 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a8892bd9-10ad-4f55-a7d1-97d7d3e3e4e2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:10.143670 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a8892bd9-10ad-4f55-a7d1-97d7d3e3e4e2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:10.144113 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a8892bd9-10ad-4f55-a7d1-97d7d3e3e4e2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:10.144881 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a8892bd9-10ad-4f55-a7d1-97d7d3e3e4e2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:10.145311 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a8892bd9-10ad-4f55-a7d1-97d7d3e3e4e2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:10.173538 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a8892bd9-10ad-4f55-a7d1-97d7d3e3e4e2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041066 Mar 03 02:39:10.174165 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 907/1806] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:10 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:10.210025 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9d555a24-679c-4a49-9712-90f7ce4e59c2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:10.211308 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9d555a24-679c-4a49-9712-90f7ce4e59c2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:10.217664 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9d555a24-679c-4a49-9712-90f7ce4e59c2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:10.218116 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9d555a24-679c-4a49-9712-90f7ce4e59c2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:10.218902 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9d555a24-679c-4a49-9712-90f7ce4e59c2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:10.219341 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9d555a24-679c-4a49-9712-90f7ce4e59c2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:10.249257 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9d555a24-679c-4a49-9712-90f7ce4e59c2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043298 Mar 03 02:39:10.249822 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 900/1807] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:10 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:10.251664 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-dd1b838d-6c48-4b65-96b5-6d2c3d6b8c24 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:10.252574 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-dd1b838d-6c48-4b65-96b5-6d2c3d6b8c24 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:10.258729 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dd1b838d-6c48-4b65-96b5-6d2c3d6b8c24 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:10.259173 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dd1b838d-6c48-4b65-96b5-6d2c3d6b8c24 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:10.259977 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dd1b838d-6c48-4b65-96b5-6d2c3d6b8c24 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:10.260407 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dd1b838d-6c48-4b65-96b5-6d2c3d6b8c24 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:10.287527 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-dd1b838d-6c48-4b65-96b5-6d2c3d6b8c24 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039715 Mar 03 02:39:10.288051 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 908/1808] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:10 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:39:10.854860 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6c08252f-bb0a-4448-a1a9-0d2a657c868f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:10.855454 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6c08252f-bb0a-4448-a1a9-0d2a657c868f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:10.861315 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6c08252f-bb0a-4448-a1a9-0d2a657c868f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:10.861760 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6c08252f-bb0a-4448-a1a9-0d2a657c868f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:10.862569 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6c08252f-bb0a-4448-a1a9-0d2a657c868f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:10.863022 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6c08252f-bb0a-4448-a1a9-0d2a657c868f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:10.991175 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6c08252f-bb0a-4448-a1a9-0d2a657c868f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:10.999766 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6c08252f-bb0a-4448-a1a9-0d2a657c868f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:11.001253 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6c08252f-bb0a-4448-a1a9-0d2a657c868f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:11.002393 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6c08252f-bb0a-4448-a1a9-0d2a657c868f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.152143 Mar 03 02:39:11.002937 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 901/1809] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:39:10 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:39:11.126246 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-49300105-299b-40e6-91e1-8d8a45279268 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:11.126788 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-49300105-299b-40e6-91e1-8d8a45279268 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:11.133283 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-49300105-299b-40e6-91e1-8d8a45279268 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:11.133728 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-49300105-299b-40e6-91e1-8d8a45279268 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:11.134499 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-49300105-299b-40e6-91e1-8d8a45279268 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:11.134936 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-49300105-299b-40e6-91e1-8d8a45279268 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:11.184937 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f9848d81-e226-417c-b9a7-3d4d01421bc7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:11.185885 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f9848d81-e226-417c-b9a7-3d4d01421bc7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:11.192309 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f9848d81-e226-417c-b9a7-3d4d01421bc7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:11.192831 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f9848d81-e226-417c-b9a7-3d4d01421bc7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:11.192965 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-49300105-299b-40e6-91e1-8d8a45279268 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:11.193775 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f9848d81-e226-417c-b9a7-3d4d01421bc7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:11.194283 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f9848d81-e226-417c-b9a7-3d4d01421bc7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:11.201142 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-49300105-299b-40e6-91e1-8d8a45279268 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078805 Mar 03 02:39:11.201717 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 909/1810] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:11 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:11.223671 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f9848d81-e226-417c-b9a7-3d4d01421bc7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042667 Mar 03 02:39:11.224225 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 902/1811] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:11 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:39:11.261517 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a174554c-b17d-4d5c-9dcf-ec0b8ad2c962 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:11.262413 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a174554c-b17d-4d5c-9dcf-ec0b8ad2c962 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:11.268278 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a174554c-b17d-4d5c-9dcf-ec0b8ad2c962 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:11.268724 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a174554c-b17d-4d5c-9dcf-ec0b8ad2c962 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:11.269497 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a174554c-b17d-4d5c-9dcf-ec0b8ad2c962 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:11.269925 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a174554c-b17d-4d5c-9dcf-ec0b8ad2c962 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:11.298849 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a174554c-b17d-4d5c-9dcf-ec0b8ad2c962 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041900 Mar 03 02:39:11.299398 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 910/1812] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:11 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:11.300512 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4a6bb1cd-5c34-43c2-99a8-7086e0392155 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:11.301439 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4a6bb1cd-5c34-43c2-99a8-7086e0392155 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:11.307803 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4a6bb1cd-5c34-43c2-99a8-7086e0392155 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:11.308254 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4a6bb1cd-5c34-43c2-99a8-7086e0392155 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:11.309041 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4a6bb1cd-5c34-43c2-99a8-7086e0392155 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:11.309485 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4a6bb1cd-5c34-43c2-99a8-7086e0392155 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:11.337029 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4a6bb1cd-5c34-43c2-99a8-7086e0392155 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040545 Mar 03 02:39:11.337578 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 903/1813] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:11 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:39:12.021213 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-68226fc2-db62-44c6-8700-dceb59351680 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:12.021817 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-68226fc2-db62-44c6-8700-dceb59351680 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:12.027680 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-68226fc2-db62-44c6-8700-dceb59351680 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:12.028133 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-68226fc2-db62-44c6-8700-dceb59351680 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:12.028907 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-68226fc2-db62-44c6-8700-dceb59351680 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:12.029345 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-68226fc2-db62-44c6-8700-dceb59351680 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:12.159948 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-68226fc2-db62-44c6-8700-dceb59351680 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:12.169019 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-68226fc2-db62-44c6-8700-dceb59351680 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:12.170505 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-68226fc2-db62-44c6-8700-dceb59351680 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:12.171666 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-68226fc2-db62-44c6-8700-dceb59351680 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.154315 Mar 03 02:39:12.172212 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 911/1814] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:39:12 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:39:12.217531 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5c457ada-34a5-4bf3-a696-44703e2748c0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:12.218145 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5c457ada-34a5-4bf3-a696-44703e2748c0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:12.224372 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5c457ada-34a5-4bf3-a696-44703e2748c0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:12.224928 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5c457ada-34a5-4bf3-a696-44703e2748c0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:12.225596 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5c457ada-34a5-4bf3-a696-44703e2748c0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:12.226038 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5c457ada-34a5-4bf3-a696-44703e2748c0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:12.234075 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-36e757c1-962b-473f-a5da-ba482c75f5d9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:12.235058 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-36e757c1-962b-473f-a5da-ba482c75f5d9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:12.240753 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-36e757c1-962b-473f-a5da-ba482c75f5d9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:12.241204 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-36e757c1-962b-473f-a5da-ba482c75f5d9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:12.242254 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-36e757c1-962b-473f-a5da-ba482c75f5d9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:12.242700 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-36e757c1-962b-473f-a5da-ba482c75f5d9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:12.271836 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-36e757c1-962b-473f-a5da-ba482c75f5d9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041425 Mar 03 02:39:12.272320 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 912/1815] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:12 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:39:12.284790 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5c457ada-34a5-4bf3-a696-44703e2748c0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:12.292697 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5c457ada-34a5-4bf3-a696-44703e2748c0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078976 Mar 03 02:39:12.293256 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 904/1816] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:12 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:12.309988 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4aa590d7-bfce-4c00-ba2f-b40e49813c73 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:12.310896 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4aa590d7-bfce-4c00-ba2f-b40e49813c73 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:12.316688 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4aa590d7-bfce-4c00-ba2f-b40e49813c73 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:12.317135 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4aa590d7-bfce-4c00-ba2f-b40e49813c73 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:12.317913 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4aa590d7-bfce-4c00-ba2f-b40e49813c73 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:12.318346 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4aa590d7-bfce-4c00-ba2f-b40e49813c73 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:12.345986 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4aa590d7-bfce-4c00-ba2f-b40e49813c73 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039831 Mar 03 02:39:12.346545 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 913/1817] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:12 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:12.348374 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1e6a9e77-2e2f-49c3-b0e7-bbba8135aaee tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:12.349283 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1e6a9e77-2e2f-49c3-b0e7-bbba8135aaee tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:12.356030 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1e6a9e77-2e2f-49c3-b0e7-bbba8135aaee tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:12.356482 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1e6a9e77-2e2f-49c3-b0e7-bbba8135aaee tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:12.357265 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1e6a9e77-2e2f-49c3-b0e7-bbba8135aaee tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:12.357701 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1e6a9e77-2e2f-49c3-b0e7-bbba8135aaee tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:12.385024 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1e6a9e77-2e2f-49c3-b0e7-bbba8135aaee tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040568 Mar 03 02:39:12.385567 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 905/1818] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:12 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:39:13.189987 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-654ab4fe-f3ac-4fab-8f6d-0f5f0a773a2e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:13.190587 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-654ab4fe-f3ac-4fab-8f6d-0f5f0a773a2e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:13.197250 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-654ab4fe-f3ac-4fab-8f6d-0f5f0a773a2e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:13.197701 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-654ab4fe-f3ac-4fab-8f6d-0f5f0a773a2e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:13.198477 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-654ab4fe-f3ac-4fab-8f6d-0f5f0a773a2e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:13.198909 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-654ab4fe-f3ac-4fab-8f6d-0f5f0a773a2e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:13.284487 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5ab1cfaa-6720-423e-bae0-63085149b08a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:13.285398 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5ab1cfaa-6720-423e-bae0-63085149b08a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:13.292234 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5ab1cfaa-6720-423e-bae0-63085149b08a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:13.292687 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5ab1cfaa-6720-423e-bae0-63085149b08a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:13.293473 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5ab1cfaa-6720-423e-bae0-63085149b08a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:13.293913 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5ab1cfaa-6720-423e-bae0-63085149b08a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:13.322286 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5ab1cfaa-6720-423e-bae0-63085149b08a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041664 Mar 03 02:39:13.322768 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 906/1819] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:13 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:39:13.327160 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c021092e-f61b-4087-ac7d-5ee70be55458 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:13.327798 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c021092e-f61b-4087-ac7d-5ee70be55458 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:13.333259 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c021092e-f61b-4087-ac7d-5ee70be55458 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:13.333715 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c021092e-f61b-4087-ac7d-5ee70be55458 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:13.333840 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-654ab4fe-f3ac-4fab-8f6d-0f5f0a773a2e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:13.334503 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c021092e-f61b-4087-ac7d-5ee70be55458 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:13.334943 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c021092e-f61b-4087-ac7d-5ee70be55458 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:13.342679 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-654ab4fe-f3ac-4fab-8f6d-0f5f0a773a2e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:13.344288 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-654ab4fe-f3ac-4fab-8f6d-0f5f0a773a2e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:13.345454 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-654ab4fe-f3ac-4fab-8f6d-0f5f0a773a2e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.159416 Mar 03 02:39:13.346012 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 914/1820] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:39:13 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:39:13.358288 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-30586558-57e4-45b5-be48-5cca94d281aa tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:13.359226 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-30586558-57e4-45b5-be48-5cca94d281aa tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:13.364930 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-30586558-57e4-45b5-be48-5cca94d281aa tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:13.365377 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-30586558-57e4-45b5-be48-5cca94d281aa tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:13.366160 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-30586558-57e4-45b5-be48-5cca94d281aa tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:13.366656 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-30586558-57e4-45b5-be48-5cca94d281aa tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:13.396995 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-30586558-57e4-45b5-be48-5cca94d281aa tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042381 Mar 03 02:39:13.397568 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 915/1821] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:13 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:39:13.398046 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c021092e-f61b-4087-ac7d-5ee70be55458 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:13.404340 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-108634d0-a4f8-4874-b42c-06306df85d55 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:13.405238 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-108634d0-a4f8-4874-b42c-06306df85d55 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:13.405552 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c021092e-f61b-4087-ac7d-5ee70be55458 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.081838 Mar 03 02:39:13.406114 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 907/1822] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:13 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:13.411098 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-108634d0-a4f8-4874-b42c-06306df85d55 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:13.411547 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-108634d0-a4f8-4874-b42c-06306df85d55 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:13.412356 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-108634d0-a4f8-4874-b42c-06306df85d55 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:13.412796 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-108634d0-a4f8-4874-b42c-06306df85d55 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:13.441529 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-108634d0-a4f8-4874-b42c-06306df85d55 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042938 Mar 03 02:39:13.442075 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 916/1823] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:13 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:14.064324 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 02:39:14.064507 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: Thu Mar 3 02:39:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 03 02:39:14.333720 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-17d128a9-9b5f-4849-ab4a-34f20741969f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:14.334904 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-17d128a9-9b5f-4849-ab4a-34f20741969f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:14.341760 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-17d128a9-9b5f-4849-ab4a-34f20741969f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:14.342204 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-17d128a9-9b5f-4849-ab4a-34f20741969f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:14.342989 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-17d128a9-9b5f-4849-ab4a-34f20741969f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:14.343420 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-17d128a9-9b5f-4849-ab4a-34f20741969f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:14.364578 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f96fa3f9-e25f-4910-ac2c-1fe7bf72bb4c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:14.365294 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f96fa3f9-e25f-4910-ac2c-1fe7bf72bb4c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:14.372379 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f96fa3f9-e25f-4910-ac2c-1fe7bf72bb4c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:14.372839 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f96fa3f9-e25f-4910-ac2c-1fe7bf72bb4c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:14.373384 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-17d128a9-9b5f-4849-ab4a-34f20741969f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043773 Mar 03 02:39:14.373635 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f96fa3f9-e25f-4910-ac2c-1fe7bf72bb4c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:14.373940 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 908/1824] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:14 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:14.374071 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f96fa3f9-e25f-4910-ac2c-1fe7bf72bb4c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:14.408341 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f4401755-bbf3-4e66-a5f3-793884df0acc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:14.409240 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f4401755-bbf3-4e66-a5f3-793884df0acc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:14.415281 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f4401755-bbf3-4e66-a5f3-793884df0acc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:14.415754 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f4401755-bbf3-4e66-a5f3-793884df0acc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:14.416543 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f4401755-bbf3-4e66-a5f3-793884df0acc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:14.417084 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f4401755-bbf3-4e66-a5f3-793884df0acc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:14.445661 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f4401755-bbf3-4e66-a5f3-793884df0acc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040518 Mar 03 02:39:14.449560 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 909/1825] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:14 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:39:14.452385 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3b47fa63-477f-4fc1-bbbd-d0ac29adf766 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:14.452984 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3b47fa63-477f-4fc1-bbbd-d0ac29adf766 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:14.458514 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3b47fa63-477f-4fc1-bbbd-d0ac29adf766 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:14.458955 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3b47fa63-477f-4fc1-bbbd-d0ac29adf766 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:14.459758 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3b47fa63-477f-4fc1-bbbd-d0ac29adf766 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:14.460195 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3b47fa63-477f-4fc1-bbbd-d0ac29adf766 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:14.508367 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f96fa3f9-e25f-4910-ac2c-1fe7bf72bb4c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:14.516823 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f96fa3f9-e25f-4910-ac2c-1fe7bf72bb4c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:14.518314 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f96fa3f9-e25f-4910-ac2c-1fe7bf72bb4c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:14.519246 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-3b47fa63-477f-4fc1-bbbd-d0ac29adf766 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:14.519488 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f96fa3f9-e25f-4910-ac2c-1fe7bf72bb4c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.158872 Mar 03 02:39:14.520190 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 917/1826] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:39:14 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:39:14.525202 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-54841436-302b-4346-abd9-a4c23b760484 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:14.526100 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-54841436-302b-4346-abd9-a4c23b760484 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:14.527080 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3b47fa63-477f-4fc1-bbbd-d0ac29adf766 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078255 Mar 03 02:39:14.527766 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 910/1827] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:14 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:14.531890 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-54841436-302b-4346-abd9-a4c23b760484 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:14.532350 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-54841436-302b-4346-abd9-a4c23b760484 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:14.533136 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-54841436-302b-4346-abd9-a4c23b760484 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:14.533597 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-54841436-302b-4346-abd9-a4c23b760484 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:14.560771 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-54841436-302b-4346-abd9-a4c23b760484 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039605 Mar 03 02:39:14.561318 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 918/1828] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:14 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:15.384986 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-343b7f5a-4664-495e-a05d-721fe4790ee8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:15.385885 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-343b7f5a-4664-495e-a05d-721fe4790ee8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:15.392097 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-343b7f5a-4664-495e-a05d-721fe4790ee8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:15.392543 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-343b7f5a-4664-495e-a05d-721fe4790ee8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:15.393316 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-343b7f5a-4664-495e-a05d-721fe4790ee8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:15.393750 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-343b7f5a-4664-495e-a05d-721fe4790ee8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:15.422501 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-343b7f5a-4664-495e-a05d-721fe4790ee8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041635 Mar 03 02:39:15.423053 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 911/1829] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:15 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:15.456939 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8e76ebc7-a236-4214-af8a-2f24b8054aea tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:15.457847 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8e76ebc7-a236-4214-af8a-2f24b8054aea tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:15.464975 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8e76ebc7-a236-4214-af8a-2f24b8054aea tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:15.465446 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8e76ebc7-a236-4214-af8a-2f24b8054aea tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:15.466209 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8e76ebc7-a236-4214-af8a-2f24b8054aea tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:15.466673 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8e76ebc7-a236-4214-af8a-2f24b8054aea tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:15.495026 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8e76ebc7-a236-4214-af8a-2f24b8054aea tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042032 Mar 03 02:39:15.495581 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 919/1830] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:15 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:15.537252 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a974eb01-fdfc-43c5-b7bb-f60962c7a8f9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:15.537848 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a974eb01-fdfc-43c5-b7bb-f60962c7a8f9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:15.543433 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ad58ef02-1115-49c3-94ca-70bf6fe67e60 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:15.543775 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a974eb01-fdfc-43c5-b7bb-f60962c7a8f9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:15.544074 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ad58ef02-1115-49c3-94ca-70bf6fe67e60 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:15.544207 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a974eb01-fdfc-43c5-b7bb-f60962c7a8f9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:15.545042 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a974eb01-fdfc-43c5-b7bb-f60962c7a8f9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:15.545475 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a974eb01-fdfc-43c5-b7bb-f60962c7a8f9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:15.549682 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ad58ef02-1115-49c3-94ca-70bf6fe67e60 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:15.550137 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ad58ef02-1115-49c3-94ca-70bf6fe67e60 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:15.550921 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ad58ef02-1115-49c3-94ca-70bf6fe67e60 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:15.551363 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ad58ef02-1115-49c3-94ca-70bf6fe67e60 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:15.614271 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ad58ef02-1115-49c3-94ca-70bf6fe67e60 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:15.622482 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ad58ef02-1115-49c3-94ca-70bf6fe67e60 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.082677 Mar 03 02:39:15.623054 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 920/1831] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:15 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:39:15.627593 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-88eb3477-74a3-4577-a5a6-6798982f407b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:15.628669 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-88eb3477-74a3-4577-a5a6-6798982f407b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:15.635678 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-88eb3477-74a3-4577-a5a6-6798982f407b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:15.636072 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-88eb3477-74a3-4577-a5a6-6798982f407b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:15.636864 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-88eb3477-74a3-4577-a5a6-6798982f407b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:15.637305 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-88eb3477-74a3-4577-a5a6-6798982f407b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:15.667480 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-88eb3477-74a3-4577-a5a6-6798982f407b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043398 Mar 03 02:39:15.668084 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 921/1832] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:15 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:15.677646 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a974eb01-fdfc-43c5-b7bb-f60962c7a8f9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:15.686229 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a974eb01-fdfc-43c5-b7bb-f60962c7a8f9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:15.687751 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a974eb01-fdfc-43c5-b7bb-f60962c7a8f9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:15.688887 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a974eb01-fdfc-43c5-b7bb-f60962c7a8f9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.155530 Mar 03 02:39:15.689433 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 912/1833] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:39:15 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:39:16.433864 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f1f151b0-2e6c-440b-8b48-6932182bbf87 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:16.434773 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f1f151b0-2e6c-440b-8b48-6932182bbf87 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:16.440497 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f1f151b0-2e6c-440b-8b48-6932182bbf87 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:16.440949 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f1f151b0-2e6c-440b-8b48-6932182bbf87 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:16.441762 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f1f151b0-2e6c-440b-8b48-6932182bbf87 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:16.442197 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f1f151b0-2e6c-440b-8b48-6932182bbf87 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:16.470503 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f1f151b0-2e6c-440b-8b48-6932182bbf87 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041156 Mar 03 02:39:16.471207 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 922/1834] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:16 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:16.506366 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4d79f619-16ad-413d-89b5-62ea8a63ed68 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:16.507451 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4d79f619-16ad-413d-89b5-62ea8a63ed68 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:16.513634 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4d79f619-16ad-413d-89b5-62ea8a63ed68 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:16.514085 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4d79f619-16ad-413d-89b5-62ea8a63ed68 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:16.514863 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4d79f619-16ad-413d-89b5-62ea8a63ed68 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:16.515304 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4d79f619-16ad-413d-89b5-62ea8a63ed68 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:16.543167 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4d79f619-16ad-413d-89b5-62ea8a63ed68 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040801 Mar 03 02:39:16.543738 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 913/1835] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:16 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:16.638802 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1577681b-3c1d-4b23-9982-0b36a1c4b64d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:16.639408 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1577681b-3c1d-4b23-9982-0b36a1c4b64d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:16.645302 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1577681b-3c1d-4b23-9982-0b36a1c4b64d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:16.645756 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1577681b-3c1d-4b23-9982-0b36a1c4b64d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:16.646534 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1577681b-3c1d-4b23-9982-0b36a1c4b64d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:16.646971 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1577681b-3c1d-4b23-9982-0b36a1c4b64d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:16.678529 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-201b5275-b6d8-4339-8d38-b10c657990d3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:16.679592 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-201b5275-b6d8-4339-8d38-b10c657990d3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:16.685794 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-201b5275-b6d8-4339-8d38-b10c657990d3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:16.686171 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-201b5275-b6d8-4339-8d38-b10c657990d3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:16.686956 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-201b5275-b6d8-4339-8d38-b10c657990d3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:16.687389 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-201b5275-b6d8-4339-8d38-b10c657990d3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:16.705222 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1577681b-3c1d-4b23-9982-0b36a1c4b64d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:16.713019 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1577681b-3c1d-4b23-9982-0b36a1c4b64d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078026 Mar 03 02:39:16.713589 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 923/1836] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:16 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:16.717978 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-81c9b8d4-8d86-4cbb-8b28-331fcff240f7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:16.718572 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-81c9b8d4-8d86-4cbb-8b28-331fcff240f7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:16.724051 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-81c9b8d4-8d86-4cbb-8b28-331fcff240f7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:16.724505 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-81c9b8d4-8d86-4cbb-8b28-331fcff240f7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:16.724836 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-201b5275-b6d8-4339-8d38-b10c657990d3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050219 Mar 03 02:39:16.725286 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-81c9b8d4-8d86-4cbb-8b28-331fcff240f7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:16.729342 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 914/1837] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:16 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:39:16.729508 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-81c9b8d4-8d86-4cbb-8b28-331fcff240f7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:16.855715 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-81c9b8d4-8d86-4cbb-8b28-331fcff240f7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:16.863789 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-81c9b8d4-8d86-4cbb-8b28-331fcff240f7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:16.865288 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-81c9b8d4-8d86-4cbb-8b28-331fcff240f7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:16.866432 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-81c9b8d4-8d86-4cbb-8b28-331fcff240f7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.151952 Mar 03 02:39:16.867160 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 924/1838] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:39:16 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:39:17.482318 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1e56e43a-cb27-4663-b92d-0718cc787784 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:17.483219 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1e56e43a-cb27-4663-b92d-0718cc787784 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:17.489058 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1e56e43a-cb27-4663-b92d-0718cc787784 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:17.489508 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1e56e43a-cb27-4663-b92d-0718cc787784 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:17.490271 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1e56e43a-cb27-4663-b92d-0718cc787784 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:17.490702 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1e56e43a-cb27-4663-b92d-0718cc787784 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:17.519129 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1e56e43a-cb27-4663-b92d-0718cc787784 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040753 Mar 03 02:39:17.519749 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 915/1839] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:17 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:17.554858 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-861cb4f7-7cc3-4838-9856-f97ad41343a8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:17.555845 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-861cb4f7-7cc3-4838-9856-f97ad41343a8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:17.562030 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-861cb4f7-7cc3-4838-9856-f97ad41343a8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:17.562474 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-861cb4f7-7cc3-4838-9856-f97ad41343a8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:17.563245 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-861cb4f7-7cc3-4838-9856-f97ad41343a8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:17.563704 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-861cb4f7-7cc3-4838-9856-f97ad41343a8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:17.591490 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-861cb4f7-7cc3-4838-9856-f97ad41343a8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041058 Mar 03 02:39:17.592130 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 925/1840] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:17 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:17.730398 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f54df586-593c-41fa-80a7-6836947102b9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:17.730938 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f54df586-593c-41fa-80a7-6836947102b9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:17.736832 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f54df586-593c-41fa-80a7-6836947102b9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:17.736994 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-fd568ead-611f-464a-88c0-2743a43acc74 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:17.737280 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f54df586-593c-41fa-80a7-6836947102b9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:17.737742 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-fd568ead-611f-464a-88c0-2743a43acc74 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:17.738059 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f54df586-593c-41fa-80a7-6836947102b9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:17.738504 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f54df586-593c-41fa-80a7-6836947102b9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:17.745089 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fd568ead-611f-464a-88c0-2743a43acc74 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:17.745541 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fd568ead-611f-464a-88c0-2743a43acc74 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:17.746325 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fd568ead-611f-464a-88c0-2743a43acc74 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:17.746770 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fd568ead-611f-464a-88c0-2743a43acc74 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:17.775646 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-fd568ead-611f-464a-88c0-2743a43acc74 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042630 Mar 03 02:39:17.776219 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 926/1841] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:17 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:39:17.798488 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f54df586-593c-41fa-80a7-6836947102b9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:17.806582 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f54df586-593c-41fa-80a7-6836947102b9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.080796 Mar 03 02:39:17.807134 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 916/1842] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:17 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:17.885026 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6415a87b-5e1d-4569-b232-cfbd657784da tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:17.885626 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6415a87b-5e1d-4569-b232-cfbd657784da tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:17.891649 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6415a87b-5e1d-4569-b232-cfbd657784da tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:17.892109 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6415a87b-5e1d-4569-b232-cfbd657784da tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:17.892886 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6415a87b-5e1d-4569-b232-cfbd657784da tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:17.893324 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6415a87b-5e1d-4569-b232-cfbd657784da tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:18.025191 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-6415a87b-5e1d-4569-b232-cfbd657784da tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:18.033305 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-6415a87b-5e1d-4569-b232-cfbd657784da tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:18.034809 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-6415a87b-5e1d-4569-b232-cfbd657784da tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:18.036003 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6415a87b-5e1d-4569-b232-cfbd657784da tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.154954 Mar 03 02:39:18.036558 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 927/1843] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:39:17 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:39:18.530714 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-cd0f4313-512c-4fbb-844e-cafda6b90720 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:18.531633 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-cd0f4313-512c-4fbb-844e-cafda6b90720 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:18.537777 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cd0f4313-512c-4fbb-844e-cafda6b90720 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:18.538227 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cd0f4313-512c-4fbb-844e-cafda6b90720 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:18.539099 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cd0f4313-512c-4fbb-844e-cafda6b90720 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:18.539481 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cd0f4313-512c-4fbb-844e-cafda6b90720 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:18.566670 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-cd0f4313-512c-4fbb-844e-cafda6b90720 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039941 Mar 03 02:39:18.567205 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 917/1844] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:18 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:18.603385 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2a999484-14cb-479d-82fc-1d93fc24722a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:18.604312 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2a999484-14cb-479d-82fc-1d93fc24722a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:18.610480 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2a999484-14cb-479d-82fc-1d93fc24722a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:18.610923 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2a999484-14cb-479d-82fc-1d93fc24722a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:18.611721 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2a999484-14cb-479d-82fc-1d93fc24722a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:18.612153 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2a999484-14cb-479d-82fc-1d93fc24722a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:18.639965 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2a999484-14cb-479d-82fc-1d93fc24722a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040932 Mar 03 02:39:18.640508 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 928/1845] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:18 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:18.786827 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f713b521-b6be-42d4-be14-baafdd088419 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:18.787690 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f713b521-b6be-42d4-be14-baafdd088419 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:18.794051 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f713b521-b6be-42d4-be14-baafdd088419 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:18.794504 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f713b521-b6be-42d4-be14-baafdd088419 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:18.795284 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f713b521-b6be-42d4-be14-baafdd088419 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:18.795747 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f713b521-b6be-42d4-be14-baafdd088419 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:18.822944 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9a1c8e66-4b75-4e51-8d22-66f18d3e3f3a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:18.823543 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9a1c8e66-4b75-4e51-8d22-66f18d3e3f3a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:18.824873 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f713b521-b6be-42d4-be14-baafdd088419 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042026 Mar 03 02:39:18.825437 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 918/1846] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:18 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:18.829368 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9a1c8e66-4b75-4e51-8d22-66f18d3e3f3a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:18.829816 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9a1c8e66-4b75-4e51-8d22-66f18d3e3f3a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:18.830593 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9a1c8e66-4b75-4e51-8d22-66f18d3e3f3a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:18.831025 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9a1c8e66-4b75-4e51-8d22-66f18d3e3f3a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:18.894736 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9a1c8e66-4b75-4e51-8d22-66f18d3e3f3a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:18.902618 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9a1c8e66-4b75-4e51-8d22-66f18d3e3f3a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.084289 Mar 03 02:39:18.903225 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 929/1847] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:18 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:39:19.054808 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2b222249-998e-440f-8f00-f788150950c1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:19.055905 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2b222249-998e-440f-8f00-f788150950c1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:19.061755 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2b222249-998e-440f-8f00-f788150950c1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:19.062207 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2b222249-998e-440f-8f00-f788150950c1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:19.062987 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2b222249-998e-440f-8f00-f788150950c1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:19.063426 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2b222249-998e-440f-8f00-f788150950c1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:19.196346 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2b222249-998e-440f-8f00-f788150950c1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:19.204440 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2b222249-998e-440f-8f00-f788150950c1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:19.205949 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2b222249-998e-440f-8f00-f788150950c1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:19.207101 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2b222249-998e-440f-8f00-f788150950c1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.156800 Mar 03 02:39:19.207672 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 919/1848] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:39:19 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:39:19.578479 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b1455212-f008-49f4-b22e-8ff5ba8571ae tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:19.579418 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b1455212-f008-49f4-b22e-8ff5ba8571ae tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:19.585978 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b1455212-f008-49f4-b22e-8ff5ba8571ae tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:19.586428 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b1455212-f008-49f4-b22e-8ff5ba8571ae tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:19.587204 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b1455212-f008-49f4-b22e-8ff5ba8571ae tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:19.587682 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b1455212-f008-49f4-b22e-8ff5ba8571ae tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:19.619677 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b1455212-f008-49f4-b22e-8ff5ba8571ae tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045199 Mar 03 02:39:19.620300 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 930/1849] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:19 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:19.650987 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-430fb5fa-fd3d-44ae-9469-a2482790a8e0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:19.651900 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-430fb5fa-fd3d-44ae-9469-a2482790a8e0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:19.657993 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-430fb5fa-fd3d-44ae-9469-a2482790a8e0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:19.658440 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-430fb5fa-fd3d-44ae-9469-a2482790a8e0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:19.659205 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-430fb5fa-fd3d-44ae-9469-a2482790a8e0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:19.659657 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-430fb5fa-fd3d-44ae-9469-a2482790a8e0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:19.687307 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-430fb5fa-fd3d-44ae-9469-a2482790a8e0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040796 Mar 03 02:39:19.687882 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 920/1850] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:19 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:19.837024 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-52d3ca82-f527-4e84-bd5c-945bc09f1df0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:19.837915 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-52d3ca82-f527-4e84-bd5c-945bc09f1df0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:19.843781 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-52d3ca82-f527-4e84-bd5c-945bc09f1df0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:19.844222 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-52d3ca82-f527-4e84-bd5c-945bc09f1df0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:19.844981 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-52d3ca82-f527-4e84-bd5c-945bc09f1df0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:19.845413 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-52d3ca82-f527-4e84-bd5c-945bc09f1df0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:19.873642 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-52d3ca82-f527-4e84-bd5c-945bc09f1df0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041080 Mar 03 02:39:19.874242 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 931/1851] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:19 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:19.918981 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6fd2290a-21d9-4520-ac0f-3efbbb74e3eb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:19.919588 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6fd2290a-21d9-4520-ac0f-3efbbb74e3eb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:19.925411 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6fd2290a-21d9-4520-ac0f-3efbbb74e3eb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:19.925863 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6fd2290a-21d9-4520-ac0f-3efbbb74e3eb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:19.926649 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6fd2290a-21d9-4520-ac0f-3efbbb74e3eb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:19.927659 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6fd2290a-21d9-4520-ac0f-3efbbb74e3eb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:19.985309 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6fd2290a-21d9-4520-ac0f-3efbbb74e3eb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:19.992587 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6fd2290a-21d9-4520-ac0f-3efbbb74e3eb tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.077383 Mar 03 02:39:19.993147 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 921/1852] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:19 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:20.224984 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b4396111-7c89-4831-92e7-20e6c9faf9ab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:20.225512 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b4396111-7c89-4831-92e7-20e6c9faf9ab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:20.231388 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b4396111-7c89-4831-92e7-20e6c9faf9ab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:20.231880 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b4396111-7c89-4831-92e7-20e6c9faf9ab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:20.232658 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b4396111-7c89-4831-92e7-20e6c9faf9ab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:20.233095 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b4396111-7c89-4831-92e7-20e6c9faf9ab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:20.362142 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b4396111-7c89-4831-92e7-20e6c9faf9ab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:20.371272 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b4396111-7c89-4831-92e7-20e6c9faf9ab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:20.372796 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b4396111-7c89-4831-92e7-20e6c9faf9ab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:20.373934 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b4396111-7c89-4831-92e7-20e6c9faf9ab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.152979 Mar 03 02:39:20.374485 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 932/1853] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:39:20 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:39:20.524587 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 02:39:20.524746 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: Thu Mar 3 02:39:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 03 02:39:20.631037 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-25fc85a6-8a69-4b54-9c84-20ec89314c0b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:20.631996 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-25fc85a6-8a69-4b54-9c84-20ec89314c0b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:20.638005 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-25fc85a6-8a69-4b54-9c84-20ec89314c0b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:20.638449 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-25fc85a6-8a69-4b54-9c84-20ec89314c0b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:20.639216 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-25fc85a6-8a69-4b54-9c84-20ec89314c0b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:20.639666 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-25fc85a6-8a69-4b54-9c84-20ec89314c0b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:20.668086 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-25fc85a6-8a69-4b54-9c84-20ec89314c0b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040917 Mar 03 02:39:20.668700 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 922/1854] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:20 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:39:20.699102 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c1e494ae-32cd-492a-91fb-bb9ae83d8208 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:20.700056 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c1e494ae-32cd-492a-91fb-bb9ae83d8208 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:20.706251 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c1e494ae-32cd-492a-91fb-bb9ae83d8208 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:20.706688 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c1e494ae-32cd-492a-91fb-bb9ae83d8208 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:20.707475 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c1e494ae-32cd-492a-91fb-bb9ae83d8208 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:20.707950 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c1e494ae-32cd-492a-91fb-bb9ae83d8208 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:20.736114 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c1e494ae-32cd-492a-91fb-bb9ae83d8208 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041456 Mar 03 02:39:20.736665 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 933/1855] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:20 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:20.885704 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f6b0af04-d6ba-4dfd-994e-e37853b63706 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:20.886608 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f6b0af04-d6ba-4dfd-994e-e37853b63706 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:20.892399 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f6b0af04-d6ba-4dfd-994e-e37853b63706 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:20.892843 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f6b0af04-d6ba-4dfd-994e-e37853b63706 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:20.893612 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f6b0af04-d6ba-4dfd-994e-e37853b63706 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:20.894046 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f6b0af04-d6ba-4dfd-994e-e37853b63706 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:20.921666 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f6b0af04-d6ba-4dfd-994e-e37853b63706 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040495 Mar 03 02:39:20.922208 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 923/1856] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:20 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:21.009943 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-37752656-5084-449b-898d-bbf78460e73a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:21.010542 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-37752656-5084-449b-898d-bbf78460e73a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:21.016538 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-37752656-5084-449b-898d-bbf78460e73a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:21.017013 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-37752656-5084-449b-898d-bbf78460e73a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:21.017812 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-37752656-5084-449b-898d-bbf78460e73a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:21.018245 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-37752656-5084-449b-898d-bbf78460e73a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:21.081274 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-37752656-5084-449b-898d-bbf78460e73a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:21.089188 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-37752656-5084-449b-898d-bbf78460e73a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.083646 Mar 03 02:39:21.089754 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 934/1857] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:21 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:21.391861 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-479f42d8-e19c-4084-9912-9eab24ea7659 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:21.392463 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-479f42d8-e19c-4084-9912-9eab24ea7659 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:21.398644 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-479f42d8-e19c-4084-9912-9eab24ea7659 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:21.399097 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-479f42d8-e19c-4084-9912-9eab24ea7659 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:21.399890 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-479f42d8-e19c-4084-9912-9eab24ea7659 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:21.400351 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-479f42d8-e19c-4084-9912-9eab24ea7659 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:21.532925 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-479f42d8-e19c-4084-9912-9eab24ea7659 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:21.541399 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-479f42d8-e19c-4084-9912-9eab24ea7659 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:21.542923 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-479f42d8-e19c-4084-9912-9eab24ea7659 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:21.544096 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-479f42d8-e19c-4084-9912-9eab24ea7659 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.156173 Mar 03 02:39:21.544644 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 924/1858] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:39:21 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:39:21.680166 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-be3a6dec-75fe-4b5f-962e-2c27b916c6f9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:21.681012 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-be3a6dec-75fe-4b5f-962e-2c27b916c6f9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:21.686895 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-be3a6dec-75fe-4b5f-962e-2c27b916c6f9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:21.687350 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-be3a6dec-75fe-4b5f-962e-2c27b916c6f9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:21.688170 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-be3a6dec-75fe-4b5f-962e-2c27b916c6f9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:21.688616 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-be3a6dec-75fe-4b5f-962e-2c27b916c6f9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:21.716042 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-be3a6dec-75fe-4b5f-962e-2c27b916c6f9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040517 Mar 03 02:39:21.716634 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 935/1859] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:21 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:21.748185 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-401ab33c-6abc-4aa4-b893-1802e3cb3c51 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:21.749080 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-401ab33c-6abc-4aa4-b893-1802e3cb3c51 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:21.754893 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-401ab33c-6abc-4aa4-b893-1802e3cb3c51 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:21.755336 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-401ab33c-6abc-4aa4-b893-1802e3cb3c51 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:21.756135 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-401ab33c-6abc-4aa4-b893-1802e3cb3c51 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:21.756567 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-401ab33c-6abc-4aa4-b893-1802e3cb3c51 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:21.783426 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-401ab33c-6abc-4aa4-b893-1802e3cb3c51 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039162 Mar 03 02:39:21.783993 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 925/1860] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:21 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:21.932786 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2592ec80-f16e-4822-8b5a-a16081204efb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:21.933620 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2592ec80-f16e-4822-8b5a-a16081204efb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:21.939388 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2592ec80-f16e-4822-8b5a-a16081204efb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:21.939875 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2592ec80-f16e-4822-8b5a-a16081204efb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:21.940669 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2592ec80-f16e-4822-8b5a-a16081204efb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:21.941094 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2592ec80-f16e-4822-8b5a-a16081204efb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:21.968923 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2592ec80-f16e-4822-8b5a-a16081204efb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040197 Mar 03 02:39:21.969471 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 936/1861] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:21 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:22.106443 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a6c8e09a-562d-4a60-91a3-4745339f8f53 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:22.107048 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a6c8e09a-562d-4a60-91a3-4745339f8f53 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:22.112872 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a6c8e09a-562d-4a60-91a3-4745339f8f53 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:22.113321 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a6c8e09a-562d-4a60-91a3-4745339f8f53 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:22.114096 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a6c8e09a-562d-4a60-91a3-4745339f8f53 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:22.114532 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a6c8e09a-562d-4a60-91a3-4745339f8f53 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:22.171580 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a6c8e09a-562d-4a60-91a3-4745339f8f53 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:22.178659 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a6c8e09a-562d-4a60-91a3-4745339f8f53 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.077084 Mar 03 02:39:22.179387 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 926/1862] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:22 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:22.562467 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0a721972-cdf8-4b93-8cfd-957dbc72b971 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:22.563070 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0a721972-cdf8-4b93-8cfd-957dbc72b971 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:22.568880 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0a721972-cdf8-4b93-8cfd-957dbc72b971 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:22.569325 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0a721972-cdf8-4b93-8cfd-957dbc72b971 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:22.570925 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0a721972-cdf8-4b93-8cfd-957dbc72b971 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:22.571355 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0a721972-cdf8-4b93-8cfd-957dbc72b971 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:22.701445 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0a721972-cdf8-4b93-8cfd-957dbc72b971 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:22.709803 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0a721972-cdf8-4b93-8cfd-957dbc72b971 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:22.711361 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0a721972-cdf8-4b93-8cfd-957dbc72b971 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:22.712523 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0a721972-cdf8-4b93-8cfd-957dbc72b971 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.153977 Mar 03 02:39:22.713076 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 937/1863] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:39:22 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:39:22.731501 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-51016931-29d8-4a6a-be30-15076fe95ea4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:22.732483 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-51016931-29d8-4a6a-be30-15076fe95ea4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:22.738287 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-51016931-29d8-4a6a-be30-15076fe95ea4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:22.738726 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-51016931-29d8-4a6a-be30-15076fe95ea4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:22.739507 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-51016931-29d8-4a6a-be30-15076fe95ea4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:22.739989 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-51016931-29d8-4a6a-be30-15076fe95ea4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:22.768901 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-51016931-29d8-4a6a-be30-15076fe95ea4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045527 Mar 03 02:39:22.769540 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 927/1864] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:22 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:22.794282 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8a04b6fb-ac74-4b1f-9613-d5f45a02bd00 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:22.795187 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8a04b6fb-ac74-4b1f-9613-d5f45a02bd00 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:22.801076 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8a04b6fb-ac74-4b1f-9613-d5f45a02bd00 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:22.801531 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8a04b6fb-ac74-4b1f-9613-d5f45a02bd00 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:22.802305 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8a04b6fb-ac74-4b1f-9613-d5f45a02bd00 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:22.802741 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8a04b6fb-ac74-4b1f-9613-d5f45a02bd00 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:22.831369 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8a04b6fb-ac74-4b1f-9613-d5f45a02bd00 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041037 Mar 03 02:39:22.831958 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 938/1865] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:22 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:22.981063 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-924af5f1-4d79-474d-9976-6ce7d33bab24 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:22.981961 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-924af5f1-4d79-474d-9976-6ce7d33bab24 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:22.987759 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-924af5f1-4d79-474d-9976-6ce7d33bab24 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:22.988230 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-924af5f1-4d79-474d-9976-6ce7d33bab24 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:22.989024 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-924af5f1-4d79-474d-9976-6ce7d33bab24 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:22.989454 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-924af5f1-4d79-474d-9976-6ce7d33bab24 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:23.017655 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-924af5f1-4d79-474d-9976-6ce7d33bab24 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040599 Mar 03 02:39:23.018194 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 928/1866] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:22 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:23.195642 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-05d92960-c86a-434a-ad77-6915771a9e93 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:23.196168 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-05d92960-c86a-434a-ad77-6915771a9e93 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:23.201984 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-05d92960-c86a-434a-ad77-6915771a9e93 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:23.202434 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-05d92960-c86a-434a-ad77-6915771a9e93 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:23.203211 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-05d92960-c86a-434a-ad77-6915771a9e93 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:23.203667 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-05d92960-c86a-434a-ad77-6915771a9e93 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:23.261379 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-05d92960-c86a-434a-ad77-6915771a9e93 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:23.268632 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-05d92960-c86a-434a-ad77-6915771a9e93 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.077140 Mar 03 02:39:23.269195 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 939/1867] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:23 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:39:23.730177 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6233db88-52f9-467b-9aa4-5f15c13e1e78 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:23.730693 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6233db88-52f9-467b-9aa4-5f15c13e1e78 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:23.736540 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6233db88-52f9-467b-9aa4-5f15c13e1e78 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:23.736987 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6233db88-52f9-467b-9aa4-5f15c13e1e78 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:23.737761 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6233db88-52f9-467b-9aa4-5f15c13e1e78 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:23.738192 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6233db88-52f9-467b-9aa4-5f15c13e1e78 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:23.780510 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-616a7c55-0da2-45c4-8387-d3a326768625 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:23.781453 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-616a7c55-0da2-45c4-8387-d3a326768625 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:23.787794 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-616a7c55-0da2-45c4-8387-d3a326768625 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:23.788292 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-616a7c55-0da2-45c4-8387-d3a326768625 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:23.789676 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-616a7c55-0da2-45c4-8387-d3a326768625 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:23.790120 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-616a7c55-0da2-45c4-8387-d3a326768625 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:23.820142 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-616a7c55-0da2-45c4-8387-d3a326768625 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043079 Mar 03 02:39:23.821381 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 940/1868] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:23 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:39:23.842801 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-cb6f9775-db9b-42cd-b05c-c55d0cfeb21a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:23.843744 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-cb6f9775-db9b-42cd-b05c-c55d0cfeb21a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:23.849495 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cb6f9775-db9b-42cd-b05c-c55d0cfeb21a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:23.849947 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cb6f9775-db9b-42cd-b05c-c55d0cfeb21a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:23.850727 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cb6f9775-db9b-42cd-b05c-c55d0cfeb21a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:23.851217 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cb6f9775-db9b-42cd-b05c-c55d0cfeb21a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:23.871980 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6233db88-52f9-467b-9aa4-5f15c13e1e78 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:23.880227 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6233db88-52f9-467b-9aa4-5f15c13e1e78 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:23.880637 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-cb6f9775-db9b-42cd-b05c-c55d0cfeb21a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041797 Mar 03 02:39:23.881205 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 941/1869] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:23 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:39:23.881819 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6233db88-52f9-467b-9aa4-5f15c13e1e78 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:23.884268 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6233db88-52f9-467b-9aa4-5f15c13e1e78 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.158175 Mar 03 02:39:23.884820 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 929/1870] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:39:23 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:39:24.029676 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-58cc5f41-7546-4a59-a47c-c1348479cd69 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:24.030591 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-58cc5f41-7546-4a59-a47c-c1348479cd69 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:24.036446 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-58cc5f41-7546-4a59-a47c-c1348479cd69 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:24.036904 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-58cc5f41-7546-4a59-a47c-c1348479cd69 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:24.037686 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-58cc5f41-7546-4a59-a47c-c1348479cd69 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:24.038130 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-58cc5f41-7546-4a59-a47c-c1348479cd69 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:24.066342 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-58cc5f41-7546-4a59-a47c-c1348479cd69 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040604 Mar 03 02:39:24.067151 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 942/1871] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:24 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:24.285041 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-865f9b22-c8ce-49a3-8f01-35213242fd7f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:24.285600 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-865f9b22-c8ce-49a3-8f01-35213242fd7f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:24.291498 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-865f9b22-c8ce-49a3-8f01-35213242fd7f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:24.291984 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-865f9b22-c8ce-49a3-8f01-35213242fd7f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:24.292762 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-865f9b22-c8ce-49a3-8f01-35213242fd7f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:24.293199 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-865f9b22-c8ce-49a3-8f01-35213242fd7f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:24.351088 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-865f9b22-c8ce-49a3-8f01-35213242fd7f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:24.358290 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-865f9b22-c8ce-49a3-8f01-35213242fd7f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.077170 Mar 03 02:39:24.358846 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 930/1872] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:24 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:24.832285 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-00fb685c-dafa-423f-bfa2-79f48e9a44e6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:24.833199 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-00fb685c-dafa-423f-bfa2-79f48e9a44e6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:24.840331 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-00fb685c-dafa-423f-bfa2-79f48e9a44e6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:24.840787 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-00fb685c-dafa-423f-bfa2-79f48e9a44e6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:24.841572 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-00fb685c-dafa-423f-bfa2-79f48e9a44e6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:24.842013 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-00fb685c-dafa-423f-bfa2-79f48e9a44e6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:24.870409 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-00fb685c-dafa-423f-bfa2-79f48e9a44e6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042405 Mar 03 02:39:24.870961 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 943/1873] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:24 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:24.892599 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2fc35856-d2ab-420f-bf7e-044033d23ba2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:24.893539 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2fc35856-d2ab-420f-bf7e-044033d23ba2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:24.900917 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2fc35856-d2ab-420f-bf7e-044033d23ba2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:24.901369 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2fc35856-d2ab-420f-bf7e-044033d23ba2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:24.902146 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d0f8e8c0-1e9c-4745-ae57-dfbc740d4cab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:24.902281 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2fc35856-d2ab-420f-bf7e-044033d23ba2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:24.902600 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2fc35856-d2ab-420f-bf7e-044033d23ba2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:24.902750 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d0f8e8c0-1e9c-4745-ae57-dfbc740d4cab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:24.908520 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d0f8e8c0-1e9c-4745-ae57-dfbc740d4cab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:24.908972 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d0f8e8c0-1e9c-4745-ae57-dfbc740d4cab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:24.909756 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d0f8e8c0-1e9c-4745-ae57-dfbc740d4cab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:24.910192 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d0f8e8c0-1e9c-4745-ae57-dfbc740d4cab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:24.932425 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2fc35856-d2ab-420f-bf7e-044033d23ba2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043705 Mar 03 02:39:24.933000 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 931/1874] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:24 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:25.041928 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d0f8e8c0-1e9c-4745-ae57-dfbc740d4cab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:25.050229 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d0f8e8c0-1e9c-4745-ae57-dfbc740d4cab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:25.051760 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d0f8e8c0-1e9c-4745-ae57-dfbc740d4cab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:25.053001 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d0f8e8c0-1e9c-4745-ae57-dfbc740d4cab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.155021 Mar 03 02:39:25.053469 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 944/1875] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:39:24 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:39:25.078185 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b9d447be-c3cf-4a12-a417-ea042d480015 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:25.079090 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b9d447be-c3cf-4a12-a417-ea042d480015 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:25.084964 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b9d447be-c3cf-4a12-a417-ea042d480015 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:25.085894 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b9d447be-c3cf-4a12-a417-ea042d480015 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:25.086676 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b9d447be-c3cf-4a12-a417-ea042d480015 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:25.087117 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b9d447be-c3cf-4a12-a417-ea042d480015 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:25.114311 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b9d447be-c3cf-4a12-a417-ea042d480015 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040041 Mar 03 02:39:25.114855 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 932/1876] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:25 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:25.374893 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8efda7fa-ec9e-4d81-adf5-199ccc5aa9f9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:25.375416 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8efda7fa-ec9e-4d81-adf5-199ccc5aa9f9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:25.381257 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8efda7fa-ec9e-4d81-adf5-199ccc5aa9f9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:25.381711 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8efda7fa-ec9e-4d81-adf5-199ccc5aa9f9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:25.383101 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8efda7fa-ec9e-4d81-adf5-199ccc5aa9f9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:25.383434 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8efda7fa-ec9e-4d81-adf5-199ccc5aa9f9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:25.443929 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8efda7fa-ec9e-4d81-adf5-199ccc5aa9f9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:25.452063 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8efda7fa-ec9e-4d81-adf5-199ccc5aa9f9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.081066 Mar 03 02:39:25.452630 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 945/1877] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:25 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:25.881993 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-44feaa14-9c06-4fcf-937b-0418c0ec27eb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:25.883537 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-44feaa14-9c06-4fcf-937b-0418c0ec27eb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:25.889299 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-44feaa14-9c06-4fcf-937b-0418c0ec27eb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:25.889744 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-44feaa14-9c06-4fcf-937b-0418c0ec27eb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:25.890508 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-44feaa14-9c06-4fcf-937b-0418c0ec27eb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:25.890936 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-44feaa14-9c06-4fcf-937b-0418c0ec27eb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:25.918109 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-44feaa14-9c06-4fcf-937b-0418c0ec27eb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040136 Mar 03 02:39:25.918709 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 933/1878] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:25 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:25.943811 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e2cce06b-edfe-4424-953a-62f299c60e2d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:25.944924 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e2cce06b-edfe-4424-953a-62f299c60e2d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:25.951198 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e2cce06b-edfe-4424-953a-62f299c60e2d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:25.951674 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e2cce06b-edfe-4424-953a-62f299c60e2d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:25.952452 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e2cce06b-edfe-4424-953a-62f299c60e2d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:25.952883 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e2cce06b-edfe-4424-953a-62f299c60e2d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:25.980294 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e2cce06b-edfe-4424-953a-62f299c60e2d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040508 Mar 03 02:39:25.980832 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 946/1879] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:25 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:26.070268 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3da9893c-ca6b-49c9-b3b6-bc37ba04f6cf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:26.070899 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3da9893c-ca6b-49c9-b3b6-bc37ba04f6cf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:26.076742 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3da9893c-ca6b-49c9-b3b6-bc37ba04f6cf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:26.077213 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3da9893c-ca6b-49c9-b3b6-bc37ba04f6cf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:26.077979 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3da9893c-ca6b-49c9-b3b6-bc37ba04f6cf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:26.078408 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3da9893c-ca6b-49c9-b3b6-bc37ba04f6cf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:26.125811 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6712febf-bbb4-45ef-b37f-387533eb763f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:26.126729 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6712febf-bbb4-45ef-b37f-387533eb763f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:26.132985 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6712febf-bbb4-45ef-b37f-387533eb763f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:26.133381 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6712febf-bbb4-45ef-b37f-387533eb763f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:26.134174 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6712febf-bbb4-45ef-b37f-387533eb763f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:26.134616 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6712febf-bbb4-45ef-b37f-387533eb763f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:26.162622 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6712febf-bbb4-45ef-b37f-387533eb763f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040821 Mar 03 02:39:26.163775 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 947/1880] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:26 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:39:26.209123 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-3da9893c-ca6b-49c9-b3b6-bc37ba04f6cf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:26.217082 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-3da9893c-ca6b-49c9-b3b6-bc37ba04f6cf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:26.218559 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-3da9893c-ca6b-49c9-b3b6-bc37ba04f6cf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:26.219725 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3da9893c-ca6b-49c9-b3b6-bc37ba04f6cf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.153492 Mar 03 02:39:26.220309 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 934/1881] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:39:26 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:39:26.471064 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-faaaf70e-d8c3-4a37-ae6b-dcd997c34543 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:26.471837 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-faaaf70e-d8c3-4a37-ae6b-dcd997c34543 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:26.479388 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-faaaf70e-d8c3-4a37-ae6b-dcd997c34543 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:26.479388 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-faaaf70e-d8c3-4a37-ae6b-dcd997c34543 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:26.481445 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-faaaf70e-d8c3-4a37-ae6b-dcd997c34543 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:26.482213 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-faaaf70e-d8c3-4a37-ae6b-dcd997c34543 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:26.551363 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-faaaf70e-d8c3-4a37-ae6b-dcd997c34543 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:26.559454 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-faaaf70e-d8c3-4a37-ae6b-dcd997c34543 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.092385 Mar 03 02:39:26.560052 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 948/1882] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:26 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:26.930099 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0573b07b-c8bb-489f-80c9-3f12f0654014 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:26.931035 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0573b07b-c8bb-489f-80c9-3f12f0654014 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:26.937724 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0573b07b-c8bb-489f-80c9-3f12f0654014 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:26.938175 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0573b07b-c8bb-489f-80c9-3f12f0654014 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:26.938990 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0573b07b-c8bb-489f-80c9-3f12f0654014 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:26.939423 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0573b07b-c8bb-489f-80c9-3f12f0654014 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:26.968088 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0573b07b-c8bb-489f-80c9-3f12f0654014 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042355 Mar 03 02:39:26.968633 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 935/1883] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:26 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:26.991316 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e6ef3697-ebcb-46d0-bbd7-b02c4f35d7de tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:26.992596 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e6ef3697-ebcb-46d0-bbd7-b02c4f35d7de tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:26.999165 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e6ef3697-ebcb-46d0-bbd7-b02c4f35d7de tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:26.999628 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e6ef3697-ebcb-46d0-bbd7-b02c4f35d7de tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:27.000654 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e6ef3697-ebcb-46d0-bbd7-b02c4f35d7de tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:27.001084 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e6ef3697-ebcb-46d0-bbd7-b02c4f35d7de tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:27.029579 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e6ef3697-ebcb-46d0-bbd7-b02c4f35d7de tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042224 Mar 03 02:39:27.030124 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 949/1884] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:26 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:27.174772 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-17c0fc87-323e-47c5-a7c3-7c58c3d5e3f9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:27.175692 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-17c0fc87-323e-47c5-a7c3-7c58c3d5e3f9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:27.182294 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-17c0fc87-323e-47c5-a7c3-7c58c3d5e3f9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:27.182678 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-17c0fc87-323e-47c5-a7c3-7c58c3d5e3f9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:27.183447 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-17c0fc87-323e-47c5-a7c3-7c58c3d5e3f9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:27.184013 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-17c0fc87-323e-47c5-a7c3-7c58c3d5e3f9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:27.211071 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-17c0fc87-323e-47c5-a7c3-7c58c3d5e3f9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040083 Mar 03 02:39:27.211634 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 936/1885] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:27 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:27.237559 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b6796743-573e-4d53-a318-401d0674b1e8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:27.238160 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b6796743-573e-4d53-a318-401d0674b1e8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:27.245183 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b6796743-573e-4d53-a318-401d0674b1e8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:27.245627 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b6796743-573e-4d53-a318-401d0674b1e8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:27.246393 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b6796743-573e-4d53-a318-401d0674b1e8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:27.246822 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b6796743-573e-4d53-a318-401d0674b1e8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:27.375453 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b6796743-573e-4d53-a318-401d0674b1e8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:27.384090 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b6796743-573e-4d53-a318-401d0674b1e8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:27.385579 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b6796743-573e-4d53-a318-401d0674b1e8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:27.386721 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b6796743-573e-4d53-a318-401d0674b1e8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.153066 Mar 03 02:39:27.387273 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 950/1886] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:39:27 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:39:27.576466 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b2a56db9-fb78-414e-ba2c-7dc44eb83891 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:27.577065 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b2a56db9-fb78-414e-ba2c-7dc44eb83891 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:27.582826 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b2a56db9-fb78-414e-ba2c-7dc44eb83891 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:27.583270 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b2a56db9-fb78-414e-ba2c-7dc44eb83891 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:27.584081 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b2a56db9-fb78-414e-ba2c-7dc44eb83891 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:27.584513 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b2a56db9-fb78-414e-ba2c-7dc44eb83891 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:27.643310 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b2a56db9-fb78-414e-ba2c-7dc44eb83891 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:27.650399 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b2a56db9-fb78-414e-ba2c-7dc44eb83891 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.077791 Mar 03 02:39:27.650951 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 937/1887] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:27 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:27.980819 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c35ed58c-4f8a-4050-9569-f0a794a6a0a9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:27.981733 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c35ed58c-4f8a-4050-9569-f0a794a6a0a9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:27.987539 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c35ed58c-4f8a-4050-9569-f0a794a6a0a9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:27.988043 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c35ed58c-4f8a-4050-9569-f0a794a6a0a9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:27.988823 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c35ed58c-4f8a-4050-9569-f0a794a6a0a9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:27.989265 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c35ed58c-4f8a-4050-9569-f0a794a6a0a9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:28.018348 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c35ed58c-4f8a-4050-9569-f0a794a6a0a9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042574 Mar 03 02:39:28.019023 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 951/1888] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:27 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:28.041692 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ee215907-a608-422c-aa23-9893b993c310 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:28.042632 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ee215907-a608-422c-aa23-9893b993c310 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:28.048851 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ee215907-a608-422c-aa23-9893b993c310 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:28.049297 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ee215907-a608-422c-aa23-9893b993c310 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:28.050083 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ee215907-a608-422c-aa23-9893b993c310 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:28.050532 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ee215907-a608-422c-aa23-9893b993c310 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:28.079507 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ee215907-a608-422c-aa23-9893b993c310 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042594 Mar 03 02:39:28.080117 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 938/1889] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:28 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:39:28.222648 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4eca9c90-83e3-4afb-b1be-4701eb9de865 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:28.223555 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4eca9c90-83e3-4afb-b1be-4701eb9de865 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:28.230009 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4eca9c90-83e3-4afb-b1be-4701eb9de865 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:28.230459 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4eca9c90-83e3-4afb-b1be-4701eb9de865 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:28.231336 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4eca9c90-83e3-4afb-b1be-4701eb9de865 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:28.231774 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4eca9c90-83e3-4afb-b1be-4701eb9de865 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:28.260274 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4eca9c90-83e3-4afb-b1be-4701eb9de865 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041654 Mar 03 02:39:28.260820 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 952/1890] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:28 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:28.405096 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4dae6f09-4f58-484f-84aa-f324f99c5596 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:28.405693 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4dae6f09-4f58-484f-84aa-f324f99c5596 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:28.411452 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4dae6f09-4f58-484f-84aa-f324f99c5596 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:28.411926 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4dae6f09-4f58-484f-84aa-f324f99c5596 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:28.412691 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4dae6f09-4f58-484f-84aa-f324f99c5596 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:28.413124 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4dae6f09-4f58-484f-84aa-f324f99c5596 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:28.540706 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4dae6f09-4f58-484f-84aa-f324f99c5596 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:28.548869 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4dae6f09-4f58-484f-84aa-f324f99c5596 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:28.550351 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4dae6f09-4f58-484f-84aa-f324f99c5596 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:28.551495 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4dae6f09-4f58-484f-84aa-f324f99c5596 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.150344 Mar 03 02:39:28.552076 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 939/1891] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:39:28 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:39:28.666693 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-99543784-51e1-41ad-9677-61a946a6f7ea tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:28.667311 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-99543784-51e1-41ad-9677-61a946a6f7ea tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:28.673213 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-99543784-51e1-41ad-9677-61a946a6f7ea tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:28.673669 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-99543784-51e1-41ad-9677-61a946a6f7ea tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:28.674458 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-99543784-51e1-41ad-9677-61a946a6f7ea tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:28.674909 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-99543784-51e1-41ad-9677-61a946a6f7ea tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:28.733540 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-99543784-51e1-41ad-9677-61a946a6f7ea tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:28.740747 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-99543784-51e1-41ad-9677-61a946a6f7ea tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078233 Mar 03 02:39:28.741875 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 953/1892] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:28 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:29.030081 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-460147de-b6c1-476c-9b48-51874f57fb43 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:29.030997 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-460147de-b6c1-476c-9b48-51874f57fb43 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:29.036839 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-460147de-b6c1-476c-9b48-51874f57fb43 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:29.037291 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-460147de-b6c1-476c-9b48-51874f57fb43 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:29.038073 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-460147de-b6c1-476c-9b48-51874f57fb43 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:29.038512 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-460147de-b6c1-476c-9b48-51874f57fb43 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:29.067511 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-460147de-b6c1-476c-9b48-51874f57fb43 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041431 Mar 03 02:39:29.068097 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 940/1893] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:29 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:29.090473 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-76e1084c-daae-458e-908c-d0214a2c52f2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:29.091379 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-76e1084c-daae-458e-908c-d0214a2c52f2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:29.097584 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-76e1084c-daae-458e-908c-d0214a2c52f2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:29.098033 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-76e1084c-daae-458e-908c-d0214a2c52f2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:29.098805 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-76e1084c-daae-458e-908c-d0214a2c52f2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:29.099240 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-76e1084c-daae-458e-908c-d0214a2c52f2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:29.128452 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-76e1084c-daae-458e-908c-d0214a2c52f2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042079 Mar 03 02:39:29.129007 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 954/1894] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:29 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:29.271763 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a3e2e7fe-e4a9-487d-9ca3-36ea1b8301b1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:29.272671 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a3e2e7fe-e4a9-487d-9ca3-36ea1b8301b1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:29.279348 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a3e2e7fe-e4a9-487d-9ca3-36ea1b8301b1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:29.279842 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a3e2e7fe-e4a9-487d-9ca3-36ea1b8301b1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:29.280675 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a3e2e7fe-e4a9-487d-9ca3-36ea1b8301b1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:29.281064 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a3e2e7fe-e4a9-487d-9ca3-36ea1b8301b1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:29.309140 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a3e2e7fe-e4a9-487d-9ca3-36ea1b8301b1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041379 Mar 03 02:39:29.309684 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 941/1895] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:29 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:29.570069 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b3fbc920-cce4-4508-a6bf-16a90e398844 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:29.570617 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b3fbc920-cce4-4508-a6bf-16a90e398844 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:29.577044 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b3fbc920-cce4-4508-a6bf-16a90e398844 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:29.577484 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b3fbc920-cce4-4508-a6bf-16a90e398844 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:29.578256 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b3fbc920-cce4-4508-a6bf-16a90e398844 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:29.578686 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b3fbc920-cce4-4508-a6bf-16a90e398844 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:29.710026 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b3fbc920-cce4-4508-a6bf-16a90e398844 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:29.718639 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b3fbc920-cce4-4508-a6bf-16a90e398844 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:29.720148 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b3fbc920-cce4-4508-a6bf-16a90e398844 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:29.721289 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b3fbc920-cce4-4508-a6bf-16a90e398844 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.155216 Mar 03 02:39:29.721842 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 955/1896] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:39:29 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:39:29.757576 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9c817f9f-79d5-4fbf-b2a8-e73f2af8b8a8 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:29.759093 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9c817f9f-79d5-4fbf-b2a8-e73f2af8b8a8 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:29.764864 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9c817f9f-79d5-4fbf-b2a8-e73f2af8b8a8 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:29.765312 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9c817f9f-79d5-4fbf-b2a8-e73f2af8b8a8 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:29.766088 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9c817f9f-79d5-4fbf-b2a8-e73f2af8b8a8 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:29.766524 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9c817f9f-79d5-4fbf-b2a8-e73f2af8b8a8 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:29.828655 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9c817f9f-79d5-4fbf-b2a8-e73f2af8b8a8 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:29.835757 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9c817f9f-79d5-4fbf-b2a8-e73f2af8b8a8 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.082075 Mar 03 02:39:29.836970 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 942/1897] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:29 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:30.079458 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-fe932ff1-04b5-4fc9-9700-002de8419df3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:30.080334 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-fe932ff1-04b5-4fc9-9700-002de8419df3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:30.086788 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fe932ff1-04b5-4fc9-9700-002de8419df3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:30.087242 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fe932ff1-04b5-4fc9-9700-002de8419df3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:30.088058 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fe932ff1-04b5-4fc9-9700-002de8419df3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:30.088496 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fe932ff1-04b5-4fc9-9700-002de8419df3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:30.115894 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-fe932ff1-04b5-4fc9-9700-002de8419df3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040429 Mar 03 02:39:30.116458 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 956/1898] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:30 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:30.140023 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2ffd5763-9d11-4105-80db-069c5f70e7f1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:30.140925 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2ffd5763-9d11-4105-80db-069c5f70e7f1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:30.147079 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2ffd5763-9d11-4105-80db-069c5f70e7f1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:30.147529 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2ffd5763-9d11-4105-80db-069c5f70e7f1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:30.148339 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2ffd5763-9d11-4105-80db-069c5f70e7f1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:30.148774 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2ffd5763-9d11-4105-80db-069c5f70e7f1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:30.175508 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2ffd5763-9d11-4105-80db-069c5f70e7f1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039386 Mar 03 02:39:30.176075 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 943/1899] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:30 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:30.321331 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a7966f22-75d2-41db-b2a5-a662d726982e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:30.322229 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a7966f22-75d2-41db-b2a5-a662d726982e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:30.328104 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a7966f22-75d2-41db-b2a5-a662d726982e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:30.328553 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a7966f22-75d2-41db-b2a5-a662d726982e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:30.329332 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a7966f22-75d2-41db-b2a5-a662d726982e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:30.329819 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a7966f22-75d2-41db-b2a5-a662d726982e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:30.357039 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a7966f22-75d2-41db-b2a5-a662d726982e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040399 Mar 03 02:39:30.357606 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 957/1900] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:30 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:30.739369 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-de86b64c-5996-4f64-9cb2-b19049961a21 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:30.739920 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-de86b64c-5996-4f64-9cb2-b19049961a21 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:30.746665 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-de86b64c-5996-4f64-9cb2-b19049961a21 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:30.747113 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-de86b64c-5996-4f64-9cb2-b19049961a21 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:30.747918 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-de86b64c-5996-4f64-9cb2-b19049961a21 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:30.748360 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-de86b64c-5996-4f64-9cb2-b19049961a21 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:30.853674 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d0b1edd4-113b-47ef-bd36-36eb2f7cd683 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:30.854274 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d0b1edd4-113b-47ef-bd36-36eb2f7cd683 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:30.859933 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d0b1edd4-113b-47ef-bd36-36eb2f7cd683 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:30.860380 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d0b1edd4-113b-47ef-bd36-36eb2f7cd683 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:30.861213 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d0b1edd4-113b-47ef-bd36-36eb2f7cd683 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:30.861646 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d0b1edd4-113b-47ef-bd36-36eb2f7cd683 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:30.878601 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-de86b64c-5996-4f64-9cb2-b19049961a21 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:30.886863 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-de86b64c-5996-4f64-9cb2-b19049961a21 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:30.888435 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-de86b64c-5996-4f64-9cb2-b19049961a21 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:30.889606 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-de86b64c-5996-4f64-9cb2-b19049961a21 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.154216 Mar 03 02:39:30.890168 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 944/1901] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:39:30 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:39:30.920724 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d0b1edd4-113b-47ef-bd36-36eb2f7cd683 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:30.927907 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d0b1edd4-113b-47ef-bd36-36eb2f7cd683 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078723 Mar 03 02:39:30.928468 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 958/1902] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:30 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:39:31.128522 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3649f396-ae50-463c-89d6-1f3041d2cc5f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:31.129423 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3649f396-ae50-463c-89d6-1f3041d2cc5f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:31.135315 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3649f396-ae50-463c-89d6-1f3041d2cc5f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:31.135803 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3649f396-ae50-463c-89d6-1f3041d2cc5f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:31.136581 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3649f396-ae50-463c-89d6-1f3041d2cc5f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:31.137028 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3649f396-ae50-463c-89d6-1f3041d2cc5f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:31.165233 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3649f396-ae50-463c-89d6-1f3041d2cc5f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040553 Mar 03 02:39:31.165823 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 945/1903] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:31 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:39:31.186533 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9ba9fbc1-f5bf-45d5-877c-11e4173ef71b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:31.187434 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9ba9fbc1-f5bf-45d5-877c-11e4173ef71b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:31.193287 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9ba9fbc1-f5bf-45d5-877c-11e4173ef71b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:31.193731 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9ba9fbc1-f5bf-45d5-877c-11e4173ef71b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:31.194496 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9ba9fbc1-f5bf-45d5-877c-11e4173ef71b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:31.194925 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9ba9fbc1-f5bf-45d5-877c-11e4173ef71b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:31.223020 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9ba9fbc1-f5bf-45d5-877c-11e4173ef71b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040580 Mar 03 02:39:31.223567 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 959/1904] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:31 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:31.369576 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-bb75f20d-daff-44a8-a53a-461d0502dcae tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:31.370478 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-bb75f20d-daff-44a8-a53a-461d0502dcae tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:31.376223 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bb75f20d-daff-44a8-a53a-461d0502dcae tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:31.376668 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bb75f20d-daff-44a8-a53a-461d0502dcae tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:31.377444 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bb75f20d-daff-44a8-a53a-461d0502dcae tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:31.377877 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bb75f20d-daff-44a8-a53a-461d0502dcae tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:31.404922 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-bb75f20d-daff-44a8-a53a-461d0502dcae tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040334 Mar 03 02:39:31.405473 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 946/1905] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:31 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:31.907970 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2974a305-5d36-4830-b5bc-9da9ae2257f8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:31.908603 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2974a305-5d36-4830-b5bc-9da9ae2257f8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:31.915169 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2974a305-5d36-4830-b5bc-9da9ae2257f8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:31.915638 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2974a305-5d36-4830-b5bc-9da9ae2257f8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:31.916419 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2974a305-5d36-4830-b5bc-9da9ae2257f8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:31.916852 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2974a305-5d36-4830-b5bc-9da9ae2257f8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:31.945636 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-fee66dbd-0302-47dd-ab56-9212b117e22c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:31.946404 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-fee66dbd-0302-47dd-ab56-9212b117e22c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:31.952279 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fee66dbd-0302-47dd-ab56-9212b117e22c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:31.952728 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fee66dbd-0302-47dd-ab56-9212b117e22c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:31.953508 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fee66dbd-0302-47dd-ab56-9212b117e22c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:31.953937 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fee66dbd-0302-47dd-ab56-9212b117e22c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:32.013202 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-fee66dbd-0302-47dd-ab56-9212b117e22c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:32.020492 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-fee66dbd-0302-47dd-ab56-9212b117e22c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.079236 Mar 03 02:39:32.021062 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 947/1906] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:31 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:39:32.050516 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2974a305-5d36-4830-b5bc-9da9ae2257f8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:32.058884 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2974a305-5d36-4830-b5bc-9da9ae2257f8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:32.060415 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2974a305-5d36-4830-b5bc-9da9ae2257f8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:32.061567 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2974a305-5d36-4830-b5bc-9da9ae2257f8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.157583 Mar 03 02:39:32.062118 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 960/1907] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:39:31 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:39:32.176693 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ba8afd9e-f758-4466-8e4c-0d1d03d06ce2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:32.177541 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ba8afd9e-f758-4466-8e4c-0d1d03d06ce2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:32.183727 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ba8afd9e-f758-4466-8e4c-0d1d03d06ce2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:32.184188 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ba8afd9e-f758-4466-8e4c-0d1d03d06ce2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:32.184970 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ba8afd9e-f758-4466-8e4c-0d1d03d06ce2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:32.185412 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ba8afd9e-f758-4466-8e4c-0d1d03d06ce2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:32.213636 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ba8afd9e-f758-4466-8e4c-0d1d03d06ce2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040919 Mar 03 02:39:32.214182 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 948/1908] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:32 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:32.234185 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ff96333e-f653-4066-8312-7cc8396b8cfc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:32.235114 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ff96333e-f653-4066-8312-7cc8396b8cfc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:32.241315 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ff96333e-f653-4066-8312-7cc8396b8cfc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:32.241792 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ff96333e-f653-4066-8312-7cc8396b8cfc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:32.242951 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ff96333e-f653-4066-8312-7cc8396b8cfc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:32.243667 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ff96333e-f653-4066-8312-7cc8396b8cfc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:32.271367 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ff96333e-f653-4066-8312-7cc8396b8cfc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041069 Mar 03 02:39:32.271956 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 961/1909] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:32 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:32.416398 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c3b5d248-e76a-4d19-a027-88888873478a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:32.417304 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c3b5d248-e76a-4d19-a027-88888873478a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:32.423026 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c3b5d248-e76a-4d19-a027-88888873478a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:32.423476 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c3b5d248-e76a-4d19-a027-88888873478a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:32.424281 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c3b5d248-e76a-4d19-a027-88888873478a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:32.424722 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c3b5d248-e76a-4d19-a027-88888873478a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:32.452961 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c3b5d248-e76a-4d19-a027-88888873478a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040494 Mar 03 02:39:32.453450 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 949/1910] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:32 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:33.037507 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c7f7a7c9-5857-428b-9f8c-1d5d11045e69 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:33.038113 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c7f7a7c9-5857-428b-9f8c-1d5d11045e69 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:33.044550 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c7f7a7c9-5857-428b-9f8c-1d5d11045e69 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:33.045003 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c7f7a7c9-5857-428b-9f8c-1d5d11045e69 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:33.045779 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c7f7a7c9-5857-428b-9f8c-1d5d11045e69 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:33.046220 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c7f7a7c9-5857-428b-9f8c-1d5d11045e69 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:33.080137 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-84d4be26-ff04-46b4-9793-ba4a00be82d4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:33.080738 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-84d4be26-ff04-46b4-9793-ba4a00be82d4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:33.087015 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-84d4be26-ff04-46b4-9793-ba4a00be82d4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:33.087650 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-84d4be26-ff04-46b4-9793-ba4a00be82d4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:33.088330 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-84d4be26-ff04-46b4-9793-ba4a00be82d4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:33.088769 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-84d4be26-ff04-46b4-9793-ba4a00be82d4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:33.105831 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c7f7a7c9-5857-428b-9f8c-1d5d11045e69 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:33.113228 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c7f7a7c9-5857-428b-9f8c-1d5d11045e69 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.079603 Mar 03 02:39:33.113790 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 962/1911] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:33 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:33.225158 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ccf1b7ff-07a9-428a-bfa0-45ff39f3e117 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:33.226149 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ccf1b7ff-07a9-428a-bfa0-45ff39f3e117 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:33.228922 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-84d4be26-ff04-46b4-9793-ba4a00be82d4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:33.231935 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ccf1b7ff-07a9-428a-bfa0-45ff39f3e117 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:33.232383 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ccf1b7ff-07a9-428a-bfa0-45ff39f3e117 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:33.233161 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ccf1b7ff-07a9-428a-bfa0-45ff39f3e117 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:33.233594 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ccf1b7ff-07a9-428a-bfa0-45ff39f3e117 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:33.237035 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-84d4be26-ff04-46b4-9793-ba4a00be82d4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:33.238573 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-84d4be26-ff04-46b4-9793-ba4a00be82d4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:33.239750 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-84d4be26-ff04-46b4-9793-ba4a00be82d4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.163554 Mar 03 02:39:33.240304 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 950/1912] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:39:33 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:39:33.263143 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ccf1b7ff-07a9-428a-bfa0-45ff39f3e117 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041976 Mar 03 02:39:33.263870 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 963/1913] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:33 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:39:33.283267 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5602cbd8-0f8b-4105-a8f5-f9b4ffeb223b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:33.284234 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5602cbd8-0f8b-4105-a8f5-f9b4ffeb223b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:33.289966 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5602cbd8-0f8b-4105-a8f5-f9b4ffeb223b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:33.290411 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5602cbd8-0f8b-4105-a8f5-f9b4ffeb223b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:33.291187 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5602cbd8-0f8b-4105-a8f5-f9b4ffeb223b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:33.291644 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5602cbd8-0f8b-4105-a8f5-f9b4ffeb223b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:33.319065 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5602cbd8-0f8b-4105-a8f5-f9b4ffeb223b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039659 Mar 03 02:39:33.319615 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 951/1914] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:33 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:33.464325 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a5df4ab3-5ea5-48f9-91b2-5d1d341ac31d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:33.465236 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a5df4ab3-5ea5-48f9-91b2-5d1d341ac31d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:33.471134 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a5df4ab3-5ea5-48f9-91b2-5d1d341ac31d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:33.471587 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a5df4ab3-5ea5-48f9-91b2-5d1d341ac31d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:33.472401 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a5df4ab3-5ea5-48f9-91b2-5d1d341ac31d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:33.472841 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a5df4ab3-5ea5-48f9-91b2-5d1d341ac31d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:33.501098 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a5df4ab3-5ea5-48f9-91b2-5d1d341ac31d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040789 Mar 03 02:39:33.501648 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 964/1915] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:33 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:34.130589 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-620d57d6-4a1e-4a8d-b934-31f356ee1c49 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:34.131228 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-620d57d6-4a1e-4a8d-b934-31f356ee1c49 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:34.137168 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-620d57d6-4a1e-4a8d-b934-31f356ee1c49 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:34.137612 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-620d57d6-4a1e-4a8d-b934-31f356ee1c49 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:34.138386 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-620d57d6-4a1e-4a8d-b934-31f356ee1c49 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:34.138812 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-620d57d6-4a1e-4a8d-b934-31f356ee1c49 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:34.177941 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 02:39:34.178204 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: Thu Mar 3 02:39:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 03 02:39:34.197888 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-620d57d6-4a1e-4a8d-b934-31f356ee1c49 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:34.205177 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-620d57d6-4a1e-4a8d-b934-31f356ee1c49 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078433 Mar 03 02:39:34.205739 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 952/1916] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:34 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:34.258977 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-80e48f25-010d-4619-a616-526afb535ce9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:34.259590 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-80e48f25-010d-4619-a616-526afb535ce9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:34.265873 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-80e48f25-010d-4619-a616-526afb535ce9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:34.266415 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-80e48f25-010d-4619-a616-526afb535ce9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:34.267207 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-80e48f25-010d-4619-a616-526afb535ce9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:34.267681 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-80e48f25-010d-4619-a616-526afb535ce9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:34.274696 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a3f8d9db-dd7e-4ca1-a6d7-2a768defa98a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:34.275597 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a3f8d9db-dd7e-4ca1-a6d7-2a768defa98a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:34.281412 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a3f8d9db-dd7e-4ca1-a6d7-2a768defa98a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:34.281848 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a3f8d9db-dd7e-4ca1-a6d7-2a768defa98a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:34.282625 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a3f8d9db-dd7e-4ca1-a6d7-2a768defa98a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:34.283057 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a3f8d9db-dd7e-4ca1-a6d7-2a768defa98a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:34.311636 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a3f8d9db-dd7e-4ca1-a6d7-2a768defa98a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041215 Mar 03 02:39:34.312132 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 953/1917] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:34 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:39:34.332098 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4c386328-d33e-4aa8-becf-80487a5a5739 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:39:34.333038 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4c386328-d33e-4aa8-becf-80487a5a5739 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:34.339477 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4c386328-d33e-4aa8-becf-80487a5a5739 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:34.339954 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4c386328-d33e-4aa8-becf-80487a5a5739 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:34.340741 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4c386328-d33e-4aa8-becf-80487a5a5739 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:34.341180 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4c386328-d33e-4aa8-becf-80487a5a5739 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:34.399096 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-80e48f25-010d-4619-a616-526afb535ce9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:34.407209 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-80e48f25-010d-4619-a616-526afb535ce9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:34.408753 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-80e48f25-010d-4619-a616-526afb535ce9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:34.409911 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-80e48f25-010d-4619-a616-526afb535ce9 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.155715 Mar 03 02:39:34.410467 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 965/1918] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:39:34 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:39:34.419972 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4c386328-d33e-4aa8-becf-80487a5a5739 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "POST /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/action" status: 200 len: 40529 microversion: 2.1 time: 0.093303 Mar 03 02:39:34.421046 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 954/1919] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Mar 3 02:39:34 2022] POST /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936/action => generated 40529 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 03 02:39:34.512552 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2b98bc5c-cfa4-4bf3-95f8-3ace4bedc26b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:34.513495 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2b98bc5c-cfa4-4bf3-95f8-3ace4bedc26b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:34.519327 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2b98bc5c-cfa4-4bf3-95f8-3ace4bedc26b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:34.519825 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2b98bc5c-cfa4-4bf3-95f8-3ace4bedc26b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:34.520607 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2b98bc5c-cfa4-4bf3-95f8-3ace4bedc26b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:34.521048 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2b98bc5c-cfa4-4bf3-95f8-3ace4bedc26b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:34.549005 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2b98bc5c-cfa4-4bf3-95f8-3ace4bedc26b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040377 Mar 03 02:39:34.549548 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 966/1920] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:34 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:35.222944 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-84fec8d9-cb15-42db-a0d0-169ca8411672 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:35.223557 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-84fec8d9-cb15-42db-a0d0-169ca8411672 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:35.230278 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-84fec8d9-cb15-42db-a0d0-169ca8411672 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:35.230721 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-84fec8d9-cb15-42db-a0d0-169ca8411672 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:35.231488 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-84fec8d9-cb15-42db-a0d0-169ca8411672 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:35.231956 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-84fec8d9-cb15-42db-a0d0-169ca8411672 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:35.291436 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-84fec8d9-cb15-42db-a0d0-169ca8411672 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:35.298987 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-84fec8d9-cb15-42db-a0d0-169ca8411672 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.080381 Mar 03 02:39:35.299540 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 955/1921] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:35 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:35.323253 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f33cd475-8de8-49b5-9a67-8e40e10a4604 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:35.324195 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f33cd475-8de8-49b5-9a67-8e40e10a4604 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:35.330368 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f33cd475-8de8-49b5-9a67-8e40e10a4604 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:35.330814 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f33cd475-8de8-49b5-9a67-8e40e10a4604 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:35.331596 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f33cd475-8de8-49b5-9a67-8e40e10a4604 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:35.332054 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f33cd475-8de8-49b5-9a67-8e40e10a4604 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:35.358938 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f33cd475-8de8-49b5-9a67-8e40e10a4604 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040649 Mar 03 02:39:35.359488 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 967/1922] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:35 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:35.428620 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-adac8b66-05bd-448b-9bf0-36629474e8d7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:35.429233 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-adac8b66-05bd-448b-9bf0-36629474e8d7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:35.436044 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-adac8b66-05bd-448b-9bf0-36629474e8d7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:35.436505 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-adac8b66-05bd-448b-9bf0-36629474e8d7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:35.437287 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-adac8b66-05bd-448b-9bf0-36629474e8d7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:35.437731 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-adac8b66-05bd-448b-9bf0-36629474e8d7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:35.560734 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-60900a34-2f1a-41b9-9113-e031b2af9df3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:35.561777 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-60900a34-2f1a-41b9-9113-e031b2af9df3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:35.567785 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-60900a34-2f1a-41b9-9113-e031b2af9df3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:35.568238 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-60900a34-2f1a-41b9-9113-e031b2af9df3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:35.569022 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-60900a34-2f1a-41b9-9113-e031b2af9df3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:35.569243 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-adac8b66-05bd-448b-9bf0-36629474e8d7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:35.569455 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-60900a34-2f1a-41b9-9113-e031b2af9df3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:35.578121 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-adac8b66-05bd-448b-9bf0-36629474e8d7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:35.579663 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-adac8b66-05bd-448b-9bf0-36629474e8d7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:35.580820 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-adac8b66-05bd-448b-9bf0-36629474e8d7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.156159 Mar 03 02:39:35.581379 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 956/1923] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:39:35 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:39:35.598948 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-60900a34-2f1a-41b9-9113-e031b2af9df3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042096 Mar 03 02:39:35.599506 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 968/1924] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:35 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:36.317757 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-775f2a7e-a8b5-4c24-9737-c59fc87ceef1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:36.318370 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-775f2a7e-a8b5-4c24-9737-c59fc87ceef1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:36.325565 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-775f2a7e-a8b5-4c24-9737-c59fc87ceef1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:36.326012 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-775f2a7e-a8b5-4c24-9737-c59fc87ceef1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:36.326791 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-775f2a7e-a8b5-4c24-9737-c59fc87ceef1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:36.327222 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-775f2a7e-a8b5-4c24-9737-c59fc87ceef1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:36.371235 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a1746ee3-8250-4246-be83-27c4abd2d24e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:36.372331 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a1746ee3-8250-4246-be83-27c4abd2d24e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:36.378947 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a1746ee3-8250-4246-be83-27c4abd2d24e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:36.379478 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a1746ee3-8250-4246-be83-27c4abd2d24e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:36.380360 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a1746ee3-8250-4246-be83-27c4abd2d24e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:36.380883 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a1746ee3-8250-4246-be83-27c4abd2d24e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:36.388426 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-775f2a7e-a8b5-4c24-9737-c59fc87ceef1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:36.395865 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-775f2a7e-a8b5-4c24-9737-c59fc87ceef1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.083472 Mar 03 02:39:36.396461 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 957/1925] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:36 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:36.409912 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a1746ee3-8250-4246-be83-27c4abd2d24e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043524 Mar 03 02:39:36.410455 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 969/1926] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:36 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:39:36.599326 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c86e3853-5d3d-422a-9aef-a1951573fdab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:36.599964 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c86e3853-5d3d-422a-9aef-a1951573fdab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:36.606434 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c86e3853-5d3d-422a-9aef-a1951573fdab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:36.606886 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c86e3853-5d3d-422a-9aef-a1951573fdab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:36.607705 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c86e3853-5d3d-422a-9aef-a1951573fdab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:36.608145 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c86e3853-5d3d-422a-9aef-a1951573fdab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:36.610285 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6160f2fa-f79f-4cdf-9b87-3ebe39105ff9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:36.611188 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6160f2fa-f79f-4cdf-9b87-3ebe39105ff9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:36.617648 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6160f2fa-f79f-4cdf-9b87-3ebe39105ff9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:36.618184 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6160f2fa-f79f-4cdf-9b87-3ebe39105ff9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:36.619210 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6160f2fa-f79f-4cdf-9b87-3ebe39105ff9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:36.619676 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6160f2fa-f79f-4cdf-9b87-3ebe39105ff9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:36.652612 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6160f2fa-f79f-4cdf-9b87-3ebe39105ff9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046133 Mar 03 02:39:36.653376 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 970/1927] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:36 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:39:36.743961 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c86e3853-5d3d-422a-9aef-a1951573fdab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:36.752081 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c86e3853-5d3d-422a-9aef-a1951573fdab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:36.753612 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c86e3853-5d3d-422a-9aef-a1951573fdab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:36.754760 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c86e3853-5d3d-422a-9aef-a1951573fdab tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 200 len: 1754 microversion: 2.20 time: 0.159290 Mar 03 02:39:36.755326 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 958/1928] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:39:36 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:39:37.411826 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9e6f755f-258f-48d1-9ca1-de9d8f1f3fdd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:37.412438 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9e6f755f-258f-48d1-9ca1-de9d8f1f3fdd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:37.419263 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9e6f755f-258f-48d1-9ca1-de9d8f1f3fdd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:37.419751 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9e6f755f-258f-48d1-9ca1-de9d8f1f3fdd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:37.420548 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9e6f755f-258f-48d1-9ca1-de9d8f1f3fdd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:37.420990 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9e6f755f-258f-48d1-9ca1-de9d8f1f3fdd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:37.421165 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-86ad0ebc-750c-463b-9e61-23c448b27ca4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:37.422079 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-86ad0ebc-750c-463b-9e61-23c448b27ca4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:37.428292 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-86ad0ebc-750c-463b-9e61-23c448b27ca4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:37.428747 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-86ad0ebc-750c-463b-9e61-23c448b27ca4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:37.430178 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-86ad0ebc-750c-463b-9e61-23c448b27ca4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:37.430628 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-86ad0ebc-750c-463b-9e61-23c448b27ca4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:37.458340 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-86ad0ebc-750c-463b-9e61-23c448b27ca4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041088 Mar 03 02:39:37.458918 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 959/1929] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:37 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:39:37.480417 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9e6f755f-258f-48d1-9ca1-de9d8f1f3fdd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:37.487560 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9e6f755f-258f-48d1-9ca1-de9d8f1f3fdd tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.079605 Mar 03 02:39:37.488146 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 971/1930] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:37 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:37.663657 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c4f7bbe5-32be-4f0f-9796-1d25ca77a028 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:37.665063 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c4f7bbe5-32be-4f0f-9796-1d25ca77a028 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:37.670718 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c4f7bbe5-32be-4f0f-9796-1d25ca77a028 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:37.671158 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c4f7bbe5-32be-4f0f-9796-1d25ca77a028 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:37.671964 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c4f7bbe5-32be-4f0f-9796-1d25ca77a028 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:37.672396 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c4f7bbe5-32be-4f0f-9796-1d25ca77a028 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:37.698563 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c4f7bbe5-32be-4f0f-9796-1d25ca77a028 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038959 Mar 03 02:39:37.699105 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 960/1931] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:37 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:38.470336 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6fc5ade0-36ca-475b-9040-8fd571555cf0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:38.471250 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6fc5ade0-36ca-475b-9040-8fd571555cf0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:38.477949 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6fc5ade0-36ca-475b-9040-8fd571555cf0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:38.478405 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6fc5ade0-36ca-475b-9040-8fd571555cf0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:38.479184 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6fc5ade0-36ca-475b-9040-8fd571555cf0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:38.479645 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6fc5ade0-36ca-475b-9040-8fd571555cf0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:38.505593 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f3c62e17-4f69-40b8-aac3-eb98e992ac57 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:38.506196 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f3c62e17-4f69-40b8-aac3-eb98e992ac57 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:38.507492 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6fc5ade0-36ca-475b-9040-8fd571555cf0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041176 Mar 03 02:39:38.509290 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 972/1932] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:38 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:38.512868 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f3c62e17-4f69-40b8-aac3-eb98e992ac57 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:38.513321 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f3c62e17-4f69-40b8-aac3-eb98e992ac57 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:38.514112 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f3c62e17-4f69-40b8-aac3-eb98e992ac57 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:38.514549 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f3c62e17-4f69-40b8-aac3-eb98e992ac57 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:38.576336 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f3c62e17-4f69-40b8-aac3-eb98e992ac57 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:38.583493 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f3c62e17-4f69-40b8-aac3-eb98e992ac57 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.081688 Mar 03 02:39:38.584095 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 961/1933] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:38 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:39:38.709893 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ac285d0e-56a1-4ca2-8379-c6c4ca2dbe9d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:38.710840 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ac285d0e-56a1-4ca2-8379-c6c4ca2dbe9d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:38.716712 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ac285d0e-56a1-4ca2-8379-c6c4ca2dbe9d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:38.717156 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ac285d0e-56a1-4ca2-8379-c6c4ca2dbe9d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:38.717924 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ac285d0e-56a1-4ca2-8379-c6c4ca2dbe9d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:38.718356 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ac285d0e-56a1-4ca2-8379-c6c4ca2dbe9d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:38.746271 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ac285d0e-56a1-4ca2-8379-c6c4ca2dbe9d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040251 Mar 03 02:39:38.746754 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 973/1934] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:38 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:39.520448 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-67e8e931-b56a-4536-aacb-65c8c513f72e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:39.521629 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-67e8e931-b56a-4536-aacb-65c8c513f72e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:39.528399 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-67e8e931-b56a-4536-aacb-65c8c513f72e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:39.528840 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-67e8e931-b56a-4536-aacb-65c8c513f72e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:39.529608 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-67e8e931-b56a-4536-aacb-65c8c513f72e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:39.530039 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-67e8e931-b56a-4536-aacb-65c8c513f72e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:39.556865 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-67e8e931-b56a-4536-aacb-65c8c513f72e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040653 Mar 03 02:39:39.557399 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 962/1935] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:39 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:39.599072 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d48822d4-b55d-47fb-9b43-fa18a484a6d7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:39.599698 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d48822d4-b55d-47fb-9b43-fa18a484a6d7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:39.605931 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d48822d4-b55d-47fb-9b43-fa18a484a6d7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:39.606377 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d48822d4-b55d-47fb-9b43-fa18a484a6d7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:39.607144 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d48822d4-b55d-47fb-9b43-fa18a484a6d7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:39.607574 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d48822d4-b55d-47fb-9b43-fa18a484a6d7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:39.669236 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d48822d4-b55d-47fb-9b43-fa18a484a6d7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:39.676397 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d48822d4-b55d-47fb-9b43-fa18a484a6d7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.081221 Mar 03 02:39:39.676949 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 974/1936] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:39 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:39.758159 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7d202968-1361-4f45-912b-668276f6a211 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:39.759136 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7d202968-1361-4f45-912b-668276f6a211 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:39.764845 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7d202968-1361-4f45-912b-668276f6a211 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:39.765293 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7d202968-1361-4f45-912b-668276f6a211 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:39.766061 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7d202968-1361-4f45-912b-668276f6a211 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:39.766500 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7d202968-1361-4f45-912b-668276f6a211 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:39.795024 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7d202968-1361-4f45-912b-668276f6a211 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041345 Mar 03 02:39:39.795571 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 963/1937] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:39 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:40.568325 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d5409cb0-bda6-4857-869e-4113ca9505fd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:40.569235 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d5409cb0-bda6-4857-869e-4113ca9505fd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:40.575693 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d5409cb0-bda6-4857-869e-4113ca9505fd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:40.576142 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d5409cb0-bda6-4857-869e-4113ca9505fd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:40.576920 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d5409cb0-bda6-4857-869e-4113ca9505fd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:40.577354 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d5409cb0-bda6-4857-869e-4113ca9505fd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:40.605624 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d5409cb0-bda6-4857-869e-4113ca9505fd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041249 Mar 03 02:39:40.606235 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 975/1938] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:40 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:40.692789 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-76cfc901-f2c5-4a8b-8132-b47dc211ac98 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:40.693428 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-76cfc901-f2c5-4a8b-8132-b47dc211ac98 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:40.699834 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-76cfc901-f2c5-4a8b-8132-b47dc211ac98 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:40.700284 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-76cfc901-f2c5-4a8b-8132-b47dc211ac98 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:40.701059 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-76cfc901-f2c5-4a8b-8132-b47dc211ac98 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:40.701497 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-76cfc901-f2c5-4a8b-8132-b47dc211ac98 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:40.758949 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-76cfc901-f2c5-4a8b-8132-b47dc211ac98 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:40.766219 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-76cfc901-f2c5-4a8b-8132-b47dc211ac98 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.077316 Mar 03 02:39:40.766786 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 964/1939] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:40 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:40.806741 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6efb0a25-4dd3-4ae8-bc84-d9636ee23931 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:40.807682 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6efb0a25-4dd3-4ae8-bc84-d9636ee23931 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:40.813469 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6efb0a25-4dd3-4ae8-bc84-d9636ee23931 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:40.813916 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6efb0a25-4dd3-4ae8-bc84-d9636ee23931 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:40.814695 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6efb0a25-4dd3-4ae8-bc84-d9636ee23931 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:40.815128 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6efb0a25-4dd3-4ae8-bc84-d9636ee23931 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:40.843326 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6efb0a25-4dd3-4ae8-bc84-d9636ee23931 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040961 Mar 03 02:39:40.843923 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 976/1940] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:40 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:41.618075 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8e6b2a0e-cecd-4704-9a94-6ca7259e1737 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:41.619263 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8e6b2a0e-cecd-4704-9a94-6ca7259e1737 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:41.625117 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8e6b2a0e-cecd-4704-9a94-6ca7259e1737 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:41.625568 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8e6b2a0e-cecd-4704-9a94-6ca7259e1737 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:41.626349 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8e6b2a0e-cecd-4704-9a94-6ca7259e1737 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:41.626788 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8e6b2a0e-cecd-4704-9a94-6ca7259e1737 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:41.655178 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8e6b2a0e-cecd-4704-9a94-6ca7259e1737 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042029 Mar 03 02:39:41.655741 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 965/1941] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:41 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:41.782224 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0f480a2d-e8f5-465c-b004-b68325cbd04a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:41.782769 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0f480a2d-e8f5-465c-b004-b68325cbd04a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:41.789523 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0f480a2d-e8f5-465c-b004-b68325cbd04a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:41.790082 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0f480a2d-e8f5-465c-b004-b68325cbd04a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:41.790866 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0f480a2d-e8f5-465c-b004-b68325cbd04a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:41.791306 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0f480a2d-e8f5-465c-b004-b68325cbd04a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:41.850360 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0f480a2d-e8f5-465c-b004-b68325cbd04a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:41.854860 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f0894240-cc49-45f4-beed-a26fc1019f08 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:41.855791 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f0894240-cc49-45f4-beed-a26fc1019f08 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:41.858555 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0f480a2d-e8f5-465c-b004-b68325cbd04a tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.080200 Mar 03 02:39:41.859138 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 977/1942] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:41 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:41.862544 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f0894240-cc49-45f4-beed-a26fc1019f08 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:41.863120 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f0894240-cc49-45f4-beed-a26fc1019f08 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:41.864152 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f0894240-cc49-45f4-beed-a26fc1019f08 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:41.864703 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f0894240-cc49-45f4-beed-a26fc1019f08 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:41.892761 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f0894240-cc49-45f4-beed-a26fc1019f08 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042346 Mar 03 02:39:41.893307 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 966/1943] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:41 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:39:42.666544 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-69cc50ed-4cf6-4278-8255-5a177ce8f16d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:42.667443 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-69cc50ed-4cf6-4278-8255-5a177ce8f16d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:42.673217 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-69cc50ed-4cf6-4278-8255-5a177ce8f16d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:42.673660 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-69cc50ed-4cf6-4278-8255-5a177ce8f16d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:42.674429 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-69cc50ed-4cf6-4278-8255-5a177ce8f16d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:42.674856 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-69cc50ed-4cf6-4278-8255-5a177ce8f16d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:42.702186 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-69cc50ed-4cf6-4278-8255-5a177ce8f16d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039603 Mar 03 02:39:42.702730 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 978/1944] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:42 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:42.876282 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ea11a650-85e5-47a5-825f-f4b7fea5895d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:42.876884 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ea11a650-85e5-47a5-825f-f4b7fea5895d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:42.883812 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ea11a650-85e5-47a5-825f-f4b7fea5895d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:42.884262 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ea11a650-85e5-47a5-825f-f4b7fea5895d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:42.885030 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ea11a650-85e5-47a5-825f-f4b7fea5895d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:42.885461 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ea11a650-85e5-47a5-825f-f4b7fea5895d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:42.904481 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-17ddba66-e31e-4cf6-a70d-70935a47b0c2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:42.905378 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-17ddba66-e31e-4cf6-a70d-70935a47b0c2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:42.911532 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-17ddba66-e31e-4cf6-a70d-70935a47b0c2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:42.912000 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-17ddba66-e31e-4cf6-a70d-70935a47b0c2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:42.912773 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-17ddba66-e31e-4cf6-a70d-70935a47b0c2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:42.913206 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-17ddba66-e31e-4cf6-a70d-70935a47b0c2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:42.942526 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-17ddba66-e31e-4cf6-a70d-70935a47b0c2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041847 Mar 03 02:39:42.942839 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ea11a650-85e5-47a5-825f-f4b7fea5895d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:42.943120 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 979/1945] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:42 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:39:42.951360 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ea11a650-85e5-47a5-825f-f4b7fea5895d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078839 Mar 03 02:39:42.951937 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 967/1946] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:42 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:43.714580 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-292db54f-fd34-4b1e-bf7e-a19faa4fc70b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:43.715451 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-292db54f-fd34-4b1e-bf7e-a19faa4fc70b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:43.721633 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-292db54f-fd34-4b1e-bf7e-a19faa4fc70b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:43.722087 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-292db54f-fd34-4b1e-bf7e-a19faa4fc70b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:43.722884 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-292db54f-fd34-4b1e-bf7e-a19faa4fc70b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:43.723325 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-292db54f-fd34-4b1e-bf7e-a19faa4fc70b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:43.754179 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-292db54f-fd34-4b1e-bf7e-a19faa4fc70b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044201 Mar 03 02:39:43.754946 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 980/1947] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:43 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:43.954959 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1add2b94-1089-4ae0-a950-efe6af524fd4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:43.956064 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1add2b94-1089-4ae0-a950-efe6af524fd4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:43.962892 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1add2b94-1089-4ae0-a950-efe6af524fd4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:43.963343 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1add2b94-1089-4ae0-a950-efe6af524fd4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:43.964157 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1add2b94-1089-4ae0-a950-efe6af524fd4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:43.964649 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1add2b94-1089-4ae0-a950-efe6af524fd4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:43.968442 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5f68c09c-00eb-453e-a994-d864e1c514a2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:43.969065 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5f68c09c-00eb-453e-a994-d864e1c514a2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:43.975559 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5f68c09c-00eb-453e-a994-d864e1c514a2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:43.975941 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5f68c09c-00eb-453e-a994-d864e1c514a2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:43.976769 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5f68c09c-00eb-453e-a994-d864e1c514a2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:43.977206 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5f68c09c-00eb-453e-a994-d864e1c514a2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:43.994075 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1add2b94-1089-4ae0-a950-efe6af524fd4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042775 Mar 03 02:39:43.994930 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 968/1948] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:43 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:44.040471 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5f68c09c-00eb-453e-a994-d864e1c514a2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:44.047765 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5f68c09c-00eb-453e-a994-d864e1c514a2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.083330 Mar 03 02:39:44.048525 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 981/1949] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:43 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:44.765973 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e077e140-5f81-4d2c-8485-06e4f175a445 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:44.766800 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e077e140-5f81-4d2c-8485-06e4f175a445 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:44.772634 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e077e140-5f81-4d2c-8485-06e4f175a445 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:44.773118 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e077e140-5f81-4d2c-8485-06e4f175a445 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:44.773902 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e077e140-5f81-4d2c-8485-06e4f175a445 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:44.774346 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e077e140-5f81-4d2c-8485-06e4f175a445 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:44.801919 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e077e140-5f81-4d2c-8485-06e4f175a445 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040052 Mar 03 02:39:44.802471 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 969/1950] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:44 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:45.005500 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-42377bf9-8d18-4ce9-9394-82382f5d04c6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:45.006399 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-42377bf9-8d18-4ce9-9394-82382f5d04c6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:45.012549 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-42377bf9-8d18-4ce9-9394-82382f5d04c6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:45.012994 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-42377bf9-8d18-4ce9-9394-82382f5d04c6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:45.013800 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-42377bf9-8d18-4ce9-9394-82382f5d04c6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:45.014240 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-42377bf9-8d18-4ce9-9394-82382f5d04c6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:45.043305 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-42377bf9-8d18-4ce9-9394-82382f5d04c6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041643 Mar 03 02:39:45.043812 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 982/1951] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:45 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:45.064518 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-fe3c9ec4-ff87-4148-a132-a8e4b9ef46ba tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:45.065113 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-fe3c9ec4-ff87-4148-a132-a8e4b9ef46ba tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:45.071493 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fe3c9ec4-ff87-4148-a132-a8e4b9ef46ba tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:45.071973 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fe3c9ec4-ff87-4148-a132-a8e4b9ef46ba tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:45.072777 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fe3c9ec4-ff87-4148-a132-a8e4b9ef46ba tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:45.073208 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fe3c9ec4-ff87-4148-a132-a8e4b9ef46ba tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:45.131846 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-fe3c9ec4-ff87-4148-a132-a8e4b9ef46ba tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:45.139336 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-fe3c9ec4-ff87-4148-a132-a8e4b9ef46ba tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078660 Mar 03 02:39:45.139934 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 970/1952] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:45 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:45.814064 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9c72b550-4b67-4de2-88d3-16630f9c44a8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:45.814904 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9c72b550-4b67-4de2-88d3-16630f9c44a8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:45.820716 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9c72b550-4b67-4de2-88d3-16630f9c44a8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:45.821161 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9c72b550-4b67-4de2-88d3-16630f9c44a8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:45.821927 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9c72b550-4b67-4de2-88d3-16630f9c44a8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:45.822359 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9c72b550-4b67-4de2-88d3-16630f9c44a8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:45.850191 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9c72b550-4b67-4de2-88d3-16630f9c44a8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040166 Mar 03 02:39:45.850732 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 983/1953] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:45 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:46.054326 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f6a6a416-c83d-4fa7-85e2-1d24beaab708 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:46.055258 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f6a6a416-c83d-4fa7-85e2-1d24beaab708 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:46.061097 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f6a6a416-c83d-4fa7-85e2-1d24beaab708 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:46.061579 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f6a6a416-c83d-4fa7-85e2-1d24beaab708 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:46.062358 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f6a6a416-c83d-4fa7-85e2-1d24beaab708 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:46.062797 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f6a6a416-c83d-4fa7-85e2-1d24beaab708 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:46.090552 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f6a6a416-c83d-4fa7-85e2-1d24beaab708 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040217 Mar 03 02:39:46.091171 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 971/1954] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:46 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:46.157109 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-221b7c68-fd72-4298-83ae-9d2146032b31 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:46.157710 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-221b7c68-fd72-4298-83ae-9d2146032b31 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:46.164567 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-221b7c68-fd72-4298-83ae-9d2146032b31 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:46.165018 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-221b7c68-fd72-4298-83ae-9d2146032b31 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:46.165789 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-221b7c68-fd72-4298-83ae-9d2146032b31 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:46.166226 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-221b7c68-fd72-4298-83ae-9d2146032b31 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:46.224097 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-221b7c68-fd72-4298-83ae-9d2146032b31 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:46.231295 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-221b7c68-fd72-4298-83ae-9d2146032b31 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078053 Mar 03 02:39:46.231962 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 984/1955] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:46 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:46.862428 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-78d88259-f12d-4304-85c7-e147b3750fbb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:46.863331 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-78d88259-f12d-4304-85c7-e147b3750fbb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:46.869930 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-78d88259-f12d-4304-85c7-e147b3750fbb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:46.870380 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-78d88259-f12d-4304-85c7-e147b3750fbb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:46.871154 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-78d88259-f12d-4304-85c7-e147b3750fbb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:46.871592 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-78d88259-f12d-4304-85c7-e147b3750fbb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:46.899989 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-78d88259-f12d-4304-85c7-e147b3750fbb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041565 Mar 03 02:39:46.900540 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 972/1956] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:46 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:47.103109 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-fb15a1a9-d8be-4056-bc25-2aeb2f6d4d0b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:47.104049 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-fb15a1a9-d8be-4056-bc25-2aeb2f6d4d0b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:47.109877 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fb15a1a9-d8be-4056-bc25-2aeb2f6d4d0b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:47.110324 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fb15a1a9-d8be-4056-bc25-2aeb2f6d4d0b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:47.111102 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fb15a1a9-d8be-4056-bc25-2aeb2f6d4d0b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:47.111539 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fb15a1a9-d8be-4056-bc25-2aeb2f6d4d0b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:47.139920 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-fb15a1a9-d8be-4056-bc25-2aeb2f6d4d0b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041701 Mar 03 02:39:47.140398 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 985/1957] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:47 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:47.248616 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f8deab27-3d80-459d-8711-dade735e59c2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:47.249215 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f8deab27-3d80-459d-8711-dade735e59c2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:47.255340 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f8deab27-3d80-459d-8711-dade735e59c2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:47.255821 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f8deab27-3d80-459d-8711-dade735e59c2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:47.256589 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f8deab27-3d80-459d-8711-dade735e59c2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:47.257025 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f8deab27-3d80-459d-8711-dade735e59c2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:47.315019 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f8deab27-3d80-459d-8711-dade735e59c2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:47.322571 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f8deab27-3d80-459d-8711-dade735e59c2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.077801 Mar 03 02:39:47.323129 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 973/1958] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:47 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:39:47.911368 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-82009848-6134-4c0a-a38e-39b60cd5f64b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:47.912306 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-82009848-6134-4c0a-a38e-39b60cd5f64b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:47.918221 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-82009848-6134-4c0a-a38e-39b60cd5f64b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:47.918672 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-82009848-6134-4c0a-a38e-39b60cd5f64b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:47.919493 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-82009848-6134-4c0a-a38e-39b60cd5f64b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:47.919957 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-82009848-6134-4c0a-a38e-39b60cd5f64b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:47.947845 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-82009848-6134-4c0a-a38e-39b60cd5f64b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040316 Mar 03 02:39:47.948391 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 986/1959] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:47 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:48.150609 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-32083418-a54d-48d7-a0eb-38545b2afb7b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:48.151512 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-32083418-a54d-48d7-a0eb-38545b2afb7b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:48.157378 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-32083418-a54d-48d7-a0eb-38545b2afb7b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:48.157824 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-32083418-a54d-48d7-a0eb-38545b2afb7b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:48.158592 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-32083418-a54d-48d7-a0eb-38545b2afb7b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:48.159054 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-32083418-a54d-48d7-a0eb-38545b2afb7b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:48.186768 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-32083418-a54d-48d7-a0eb-38545b2afb7b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040236 Mar 03 02:39:48.187232 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 974/1960] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:48 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:48.339026 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-235d0fa8-19f9-4b5d-83f9-2c53d62f7c9c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:48.339693 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-235d0fa8-19f9-4b5d-83f9-2c53d62f7c9c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:48.345529 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-235d0fa8-19f9-4b5d-83f9-2c53d62f7c9c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:48.345980 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-235d0fa8-19f9-4b5d-83f9-2c53d62f7c9c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:48.346758 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-235d0fa8-19f9-4b5d-83f9-2c53d62f7c9c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:48.347195 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-235d0fa8-19f9-4b5d-83f9-2c53d62f7c9c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:48.406624 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-235d0fa8-19f9-4b5d-83f9-2c53d62f7c9c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:48.414451 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-235d0fa8-19f9-4b5d-83f9-2c53d62f7c9c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078480 Mar 03 02:39:48.415020 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 987/1961] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:48 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:48.958811 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0c1c8e5e-56ba-4fba-a23b-552612793756 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:48.959732 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0c1c8e5e-56ba-4fba-a23b-552612793756 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:48.966304 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0c1c8e5e-56ba-4fba-a23b-552612793756 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:48.966746 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0c1c8e5e-56ba-4fba-a23b-552612793756 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:48.967512 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0c1c8e5e-56ba-4fba-a23b-552612793756 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:48.967966 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0c1c8e5e-56ba-4fba-a23b-552612793756 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:48.996585 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0c1c8e5e-56ba-4fba-a23b-552612793756 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041747 Mar 03 02:39:48.997133 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 975/1962] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:48 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:49.198878 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-90405235-6870-4a98-af6d-88e94c372e25 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:49.199838 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-90405235-6870-4a98-af6d-88e94c372e25 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:49.205966 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-90405235-6870-4a98-af6d-88e94c372e25 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:49.206409 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-90405235-6870-4a98-af6d-88e94c372e25 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:49.207174 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-90405235-6870-4a98-af6d-88e94c372e25 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:49.207624 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-90405235-6870-4a98-af6d-88e94c372e25 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:49.234752 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-90405235-6870-4a98-af6d-88e94c372e25 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040518 Mar 03 02:39:49.235227 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 988/1963] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:49 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:49.430527 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5034a879-8a68-4660-b497-285a9d4dc4ae tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:49.431134 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5034a879-8a68-4660-b497-285a9d4dc4ae tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:49.436980 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5034a879-8a68-4660-b497-285a9d4dc4ae tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:49.437429 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5034a879-8a68-4660-b497-285a9d4dc4ae tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:49.438206 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5034a879-8a68-4660-b497-285a9d4dc4ae tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:49.438642 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5034a879-8a68-4660-b497-285a9d4dc4ae tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:49.497006 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5034a879-8a68-4660-b497-285a9d4dc4ae tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:49.504189 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5034a879-8a68-4660-b497-285a9d4dc4ae tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.077862 Mar 03 02:39:49.504747 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 976/1964] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:49 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:50.008275 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-21992205-f934-4202-814f-9648ea5e7fc7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:50.009184 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-21992205-f934-4202-814f-9648ea5e7fc7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:50.014972 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-21992205-f934-4202-814f-9648ea5e7fc7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:50.015422 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-21992205-f934-4202-814f-9648ea5e7fc7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:50.016249 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-21992205-f934-4202-814f-9648ea5e7fc7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:50.016683 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-21992205-f934-4202-814f-9648ea5e7fc7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:50.044271 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-21992205-f934-4202-814f-9648ea5e7fc7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040202 Mar 03 02:39:50.044820 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 989/1965] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:50 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:50.246234 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0e9a0293-e048-44b0-a7dc-d0e154928072 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:50.247129 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0e9a0293-e048-44b0-a7dc-d0e154928072 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:50.252951 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0e9a0293-e048-44b0-a7dc-d0e154928072 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:50.253394 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0e9a0293-e048-44b0-a7dc-d0e154928072 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:50.254157 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0e9a0293-e048-44b0-a7dc-d0e154928072 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:50.254590 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0e9a0293-e048-44b0-a7dc-d0e154928072 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:50.281826 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0e9a0293-e048-44b0-a7dc-d0e154928072 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040248 Mar 03 02:39:50.282293 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 977/1966] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:50 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:50.521510 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0cd2344c-4169-4bd8-9e43-34b5fec26ddf tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:50.522113 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0cd2344c-4169-4bd8-9e43-34b5fec26ddf tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:50.528894 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0cd2344c-4169-4bd8-9e43-34b5fec26ddf tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:50.529342 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0cd2344c-4169-4bd8-9e43-34b5fec26ddf tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:50.530111 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0cd2344c-4169-4bd8-9e43-34b5fec26ddf tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:50.530539 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0cd2344c-4169-4bd8-9e43-34b5fec26ddf tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:50.587952 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0cd2344c-4169-4bd8-9e43-34b5fec26ddf tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:50.595099 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0cd2344c-4169-4bd8-9e43-34b5fec26ddf tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.077395 Mar 03 02:39:50.595670 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 990/1967] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:50 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:51.056823 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a24b263a-4ccf-4a17-91cc-2f30a7d359e5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:51.057722 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a24b263a-4ccf-4a17-91cc-2f30a7d359e5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:51.063516 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a24b263a-4ccf-4a17-91cc-2f30a7d359e5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:51.063996 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a24b263a-4ccf-4a17-91cc-2f30a7d359e5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:51.064778 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a24b263a-4ccf-4a17-91cc-2f30a7d359e5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:51.065215 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a24b263a-4ccf-4a17-91cc-2f30a7d359e5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:51.092783 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a24b263a-4ccf-4a17-91cc-2f30a7d359e5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040478 Mar 03 02:39:51.093321 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 978/1968] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:51 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:51.293467 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-843fa8a5-241e-4550-9501-9a8f23ed78c6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:51.294372 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-843fa8a5-241e-4550-9501-9a8f23ed78c6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:51.300244 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-843fa8a5-241e-4550-9501-9a8f23ed78c6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:51.300697 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-843fa8a5-241e-4550-9501-9a8f23ed78c6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:51.301476 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-843fa8a5-241e-4550-9501-9a8f23ed78c6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:51.301911 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-843fa8a5-241e-4550-9501-9a8f23ed78c6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:51.329389 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-843fa8a5-241e-4550-9501-9a8f23ed78c6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039860 Mar 03 02:39:51.329937 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 991/1969] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:51 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:51.611825 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d49aa7eb-02f2-475d-b520-4eb25be80cba tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:51.612374 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d49aa7eb-02f2-475d-b520-4eb25be80cba tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:51.619438 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d49aa7eb-02f2-475d-b520-4eb25be80cba tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:51.619906 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d49aa7eb-02f2-475d-b520-4eb25be80cba tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:51.620675 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d49aa7eb-02f2-475d-b520-4eb25be80cba tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:51.621105 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d49aa7eb-02f2-475d-b520-4eb25be80cba tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:51.681664 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d49aa7eb-02f2-475d-b520-4eb25be80cba tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:51.688853 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d49aa7eb-02f2-475d-b520-4eb25be80cba tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.080941 Mar 03 02:39:51.689411 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 979/1970] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:51 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:52.105362 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c450dd2d-4db1-4ae8-ad68-29f06104bfa3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:52.106260 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c450dd2d-4db1-4ae8-ad68-29f06104bfa3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:52.112440 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c450dd2d-4db1-4ae8-ad68-29f06104bfa3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:52.112886 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c450dd2d-4db1-4ae8-ad68-29f06104bfa3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:52.113654 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c450dd2d-4db1-4ae8-ad68-29f06104bfa3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:52.114085 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c450dd2d-4db1-4ae8-ad68-29f06104bfa3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:52.141311 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c450dd2d-4db1-4ae8-ad68-29f06104bfa3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040776 Mar 03 02:39:52.141857 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 992/1971] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:52 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:52.341356 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e55ec523-18e7-4064-b5d8-eac1bbecfd33 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:52.342256 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e55ec523-18e7-4064-b5d8-eac1bbecfd33 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:52.347971 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e55ec523-18e7-4064-b5d8-eac1bbecfd33 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:52.348415 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e55ec523-18e7-4064-b5d8-eac1bbecfd33 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:52.349186 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e55ec523-18e7-4064-b5d8-eac1bbecfd33 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:52.349616 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e55ec523-18e7-4064-b5d8-eac1bbecfd33 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:52.376813 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e55ec523-18e7-4064-b5d8-eac1bbecfd33 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039456 Mar 03 02:39:52.377375 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 980/1972] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:52 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:52.705394 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-22b0f30f-9682-4dd2-82cb-a9622197c440 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:52.705959 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-22b0f30f-9682-4dd2-82cb-a9622197c440 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:52.712397 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-22b0f30f-9682-4dd2-82cb-a9622197c440 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:52.712854 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-22b0f30f-9682-4dd2-82cb-a9622197c440 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:52.713639 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-22b0f30f-9682-4dd2-82cb-a9622197c440 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:52.714080 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-22b0f30f-9682-4dd2-82cb-a9622197c440 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:52.775622 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-22b0f30f-9682-4dd2-82cb-a9622197c440 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:52.782957 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-22b0f30f-9682-4dd2-82cb-a9622197c440 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.081510 Mar 03 02:39:52.783524 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 993/1973] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:52 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:53.152878 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-16f472c0-992f-4e5e-88c6-54ba47bf231b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:53.153814 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-16f472c0-992f-4e5e-88c6-54ba47bf231b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:53.159926 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-16f472c0-992f-4e5e-88c6-54ba47bf231b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:53.160373 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-16f472c0-992f-4e5e-88c6-54ba47bf231b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:53.161139 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-16f472c0-992f-4e5e-88c6-54ba47bf231b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:53.161571 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-16f472c0-992f-4e5e-88c6-54ba47bf231b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:53.189747 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-16f472c0-992f-4e5e-88c6-54ba47bf231b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040808 Mar 03 02:39:53.190279 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 981/1974] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:53 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:53.388030 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1007fd28-5479-444f-9f0b-c6c30003ce20 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:53.388935 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1007fd28-5479-444f-9f0b-c6c30003ce20 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:53.395074 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1007fd28-5479-444f-9f0b-c6c30003ce20 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:53.395516 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1007fd28-5479-444f-9f0b-c6c30003ce20 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:53.396319 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1007fd28-5479-444f-9f0b-c6c30003ce20 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:53.396752 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1007fd28-5479-444f-9f0b-c6c30003ce20 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:53.424580 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1007fd28-5479-444f-9f0b-c6c30003ce20 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040634 Mar 03 02:39:53.425128 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 994/1975] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:53 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:53.799759 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-484cb583-cf89-4562-a6db-6b2b8c79ad20 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:53.800317 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-484cb583-cf89-4562-a6db-6b2b8c79ad20 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:53.806204 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-484cb583-cf89-4562-a6db-6b2b8c79ad20 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:53.806659 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-484cb583-cf89-4562-a6db-6b2b8c79ad20 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:53.807440 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-484cb583-cf89-4562-a6db-6b2b8c79ad20 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:53.807920 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-484cb583-cf89-4562-a6db-6b2b8c79ad20 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:53.869362 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-484cb583-cf89-4562-a6db-6b2b8c79ad20 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:53.876873 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-484cb583-cf89-4562-a6db-6b2b8c79ad20 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.081132 Mar 03 02:39:53.877438 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 982/1976] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:53 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:54.202089 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-36d16e10-02d3-4dc6-a0b4-34d979d7e1a1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:54.203000 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-36d16e10-02d3-4dc6-a0b4-34d979d7e1a1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:54.208864 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-36d16e10-02d3-4dc6-a0b4-34d979d7e1a1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:54.209316 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-36d16e10-02d3-4dc6-a0b4-34d979d7e1a1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:54.210090 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-36d16e10-02d3-4dc6-a0b4-34d979d7e1a1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:54.211025 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-36d16e10-02d3-4dc6-a0b4-34d979d7e1a1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:54.238378 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-36d16e10-02d3-4dc6-a0b4-34d979d7e1a1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040351 Mar 03 02:39:54.238925 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 995/1977] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:54 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:54.436774 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ae288d87-15a2-4e37-9625-6153d447f856 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:54.437676 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ae288d87-15a2-4e37-9625-6153d447f856 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:54.443879 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ae288d87-15a2-4e37-9625-6153d447f856 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:54.444327 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ae288d87-15a2-4e37-9625-6153d447f856 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:54.445210 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ae288d87-15a2-4e37-9625-6153d447f856 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:54.445662 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ae288d87-15a2-4e37-9625-6153d447f856 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:54.472337 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ae288d87-15a2-4e37-9625-6153d447f856 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039520 Mar 03 02:39:54.472866 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 983/1978] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:54 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:54.894826 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-eff2e996-ad7c-4619-919f-0e51d23b855c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:54.895436 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-eff2e996-ad7c-4619-919f-0e51d23b855c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:54.902800 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eff2e996-ad7c-4619-919f-0e51d23b855c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:54.903254 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eff2e996-ad7c-4619-919f-0e51d23b855c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:54.904066 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eff2e996-ad7c-4619-919f-0e51d23b855c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:54.904508 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eff2e996-ad7c-4619-919f-0e51d23b855c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:54.964140 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-eff2e996-ad7c-4619-919f-0e51d23b855c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:54.971315 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-eff2e996-ad7c-4619-919f-0e51d23b855c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.080387 Mar 03 02:39:54.971922 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 996/1979] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:54 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:55.250386 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7678dbde-df2b-4b68-a805-c5d80211590c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:55.251209 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7678dbde-df2b-4b68-a805-c5d80211590c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:55.257008 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7678dbde-df2b-4b68-a805-c5d80211590c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:55.258059 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7678dbde-df2b-4b68-a805-c5d80211590c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:55.258834 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7678dbde-df2b-4b68-a805-c5d80211590c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:55.259264 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7678dbde-df2b-4b68-a805-c5d80211590c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:55.287498 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7678dbde-df2b-4b68-a805-c5d80211590c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041193 Mar 03 02:39:55.288088 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 984/1980] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:55 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:55.483946 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-310229b7-89cd-42cb-8775-52141a3382ce tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:55.484851 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-310229b7-89cd-42cb-8775-52141a3382ce tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:55.490603 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-310229b7-89cd-42cb-8775-52141a3382ce tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:55.491045 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-310229b7-89cd-42cb-8775-52141a3382ce tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:55.492058 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-310229b7-89cd-42cb-8775-52141a3382ce tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:55.492509 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-310229b7-89cd-42cb-8775-52141a3382ce tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:55.520362 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-310229b7-89cd-42cb-8775-52141a3382ce tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040352 Mar 03 02:39:55.520834 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 997/1981] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:55 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:55.989222 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f82f2ef8-6980-4871-9fa6-c28d16bf6e64 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:55.989826 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f82f2ef8-6980-4871-9fa6-c28d16bf6e64 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:55.996958 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f82f2ef8-6980-4871-9fa6-c28d16bf6e64 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:55.997411 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f82f2ef8-6980-4871-9fa6-c28d16bf6e64 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:55.998195 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f82f2ef8-6980-4871-9fa6-c28d16bf6e64 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:55.998648 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f82f2ef8-6980-4871-9fa6-c28d16bf6e64 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:56.057370 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f82f2ef8-6980-4871-9fa6-c28d16bf6e64 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:56.064564 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f82f2ef8-6980-4871-9fa6-c28d16bf6e64 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.079289 Mar 03 02:39:56.065120 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 985/1982] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:55 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:56.298395 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-41d49ae2-eeb7-4959-b3e1-84ad9377fade tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:56.299224 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-41d49ae2-eeb7-4959-b3e1-84ad9377fade tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:56.305856 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-41d49ae2-eeb7-4959-b3e1-84ad9377fade tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:56.306311 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-41d49ae2-eeb7-4959-b3e1-84ad9377fade tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:56.307109 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-41d49ae2-eeb7-4959-b3e1-84ad9377fade tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:56.307553 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-41d49ae2-eeb7-4959-b3e1-84ad9377fade tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:56.336088 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-41d49ae2-eeb7-4959-b3e1-84ad9377fade tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041107 Mar 03 02:39:56.336750 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 998/1983] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:56 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:56.532443 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-df27f2f1-b5a1-4f0b-b1f6-a815a8859038 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:56.533352 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-df27f2f1-b5a1-4f0b-b1f6-a815a8859038 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:56.539927 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-df27f2f1-b5a1-4f0b-b1f6-a815a8859038 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:56.540382 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-df27f2f1-b5a1-4f0b-b1f6-a815a8859038 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:56.541161 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-df27f2f1-b5a1-4f0b-b1f6-a815a8859038 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:56.541597 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-df27f2f1-b5a1-4f0b-b1f6-a815a8859038 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:56.568256 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-df27f2f1-b5a1-4f0b-b1f6-a815a8859038 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039787 Mar 03 02:39:56.568730 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 986/1984] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:56 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:57.081217 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-49922729-0e14-430d-8fdc-47b01a64289d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:57.081820 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-49922729-0e14-430d-8fdc-47b01a64289d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:57.087635 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-49922729-0e14-430d-8fdc-47b01a64289d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:57.088087 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-49922729-0e14-430d-8fdc-47b01a64289d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:57.088853 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-49922729-0e14-430d-8fdc-47b01a64289d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:57.089291 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-49922729-0e14-430d-8fdc-47b01a64289d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:57.147368 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-49922729-0e14-430d-8fdc-47b01a64289d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:57.154480 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-49922729-0e14-430d-8fdc-47b01a64289d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.077138 Mar 03 02:39:57.155065 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 999/1985] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:57 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:57.347729 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c32851be-d98e-403f-ad8e-1f6bb786d769 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:57.348673 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c32851be-d98e-403f-ad8e-1f6bb786d769 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:57.355048 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c32851be-d98e-403f-ad8e-1f6bb786d769 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:57.355512 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c32851be-d98e-403f-ad8e-1f6bb786d769 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:57.356332 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c32851be-d98e-403f-ad8e-1f6bb786d769 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:57.356771 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c32851be-d98e-403f-ad8e-1f6bb786d769 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:57.385477 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c32851be-d98e-403f-ad8e-1f6bb786d769 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041795 Mar 03 02:39:57.386031 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 987/1986] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:57 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:57.579872 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b9d9f4d6-1508-4358-8ded-43d90acf22a9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:57.580779 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b9d9f4d6-1508-4358-8ded-43d90acf22a9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:57.587151 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b9d9f4d6-1508-4358-8ded-43d90acf22a9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:57.587620 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b9d9f4d6-1508-4358-8ded-43d90acf22a9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:57.588395 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b9d9f4d6-1508-4358-8ded-43d90acf22a9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:57.588828 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b9d9f4d6-1508-4358-8ded-43d90acf22a9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:57.615922 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b9d9f4d6-1508-4358-8ded-43d90acf22a9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039958 Mar 03 02:39:57.616977 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1000/1987] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:57 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:58.170909 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f9605195-bff7-47ed-b9a6-ed45a4711de5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:58.171507 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f9605195-bff7-47ed-b9a6-ed45a4711de5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:58.177309 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f9605195-bff7-47ed-b9a6-ed45a4711de5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:58.177759 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f9605195-bff7-47ed-b9a6-ed45a4711de5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:58.178540 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f9605195-bff7-47ed-b9a6-ed45a4711de5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:58.179058 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f9605195-bff7-47ed-b9a6-ed45a4711de5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:58.236321 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f9605195-bff7-47ed-b9a6-ed45a4711de5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:58.243773 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f9605195-bff7-47ed-b9a6-ed45a4711de5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.076473 Mar 03 02:39:58.244327 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 988/1988] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:58 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:58.396475 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-80ea5ac8-ed1c-402d-829f-eaa87c4acc44 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:58.397387 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-80ea5ac8-ed1c-402d-829f-eaa87c4acc44 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:58.404348 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-80ea5ac8-ed1c-402d-829f-eaa87c4acc44 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:58.404801 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-80ea5ac8-ed1c-402d-829f-eaa87c4acc44 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:58.405585 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-80ea5ac8-ed1c-402d-829f-eaa87c4acc44 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:58.406021 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-80ea5ac8-ed1c-402d-829f-eaa87c4acc44 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:58.434257 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-80ea5ac8-ed1c-402d-829f-eaa87c4acc44 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041701 Mar 03 02:39:58.434804 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1001/1989] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:58 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:58.627969 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-66f69824-1442-492a-b540-9acaf28f4a23 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:58.628872 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-66f69824-1442-492a-b540-9acaf28f4a23 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:58.635671 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-66f69824-1442-492a-b540-9acaf28f4a23 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:58.636118 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-66f69824-1442-492a-b540-9acaf28f4a23 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:58.636886 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-66f69824-1442-492a-b540-9acaf28f4a23 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:58.637317 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-66f69824-1442-492a-b540-9acaf28f4a23 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:58.663754 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-66f69824-1442-492a-b540-9acaf28f4a23 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039671 Mar 03 02:39:58.664228 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 989/1990] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:58 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:39:59.259586 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5c9daa54-6c75-42f7-b13f-c8a035781867 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:59.260231 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5c9daa54-6c75-42f7-b13f-c8a035781867 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:59.266335 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5c9daa54-6c75-42f7-b13f-c8a035781867 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:59.266783 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5c9daa54-6c75-42f7-b13f-c8a035781867 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:59.267551 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5c9daa54-6c75-42f7-b13f-c8a035781867 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:59.268010 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5c9daa54-6c75-42f7-b13f-c8a035781867 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:59.326186 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5c9daa54-6c75-42f7-b13f-c8a035781867 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:39:59.333442 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5c9daa54-6c75-42f7-b13f-c8a035781867 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.077730 Mar 03 02:39:59.334014 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1002/1991] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:39:59 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:39:59.446108 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-89ff4153-562b-4bf3-9819-c3b26ea22c34 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:39:59.447022 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-89ff4153-562b-4bf3-9819-c3b26ea22c34 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:59.452864 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-89ff4153-562b-4bf3-9819-c3b26ea22c34 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:59.453322 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-89ff4153-562b-4bf3-9819-c3b26ea22c34 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:59.454105 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-89ff4153-562b-4bf3-9819-c3b26ea22c34 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:59.454547 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-89ff4153-562b-4bf3-9819-c3b26ea22c34 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:59.531348 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-89ff4153-562b-4bf3-9819-c3b26ea22c34 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "POST /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/action" status: 200 len: 89928 microversion: 2.1 time: 0.089349 Mar 03 02:39:59.532850 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 990/1992] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Mar 3 02:39:59 2022] POST /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb/action => generated 89928 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:39:59.675781 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5fd71345-aa49-4eb1-b362-eaa6db58df96 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:39:59.676651 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5fd71345-aa49-4eb1-b362-eaa6db58df96 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:39:59.682760 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5fd71345-aa49-4eb1-b362-eaa6db58df96 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:59.683212 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5fd71345-aa49-4eb1-b362-eaa6db58df96 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:59.684011 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5fd71345-aa49-4eb1-b362-eaa6db58df96 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:39:59.684443 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5fd71345-aa49-4eb1-b362-eaa6db58df96 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:39:59.713728 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5fd71345-aa49-4eb1-b362-eaa6db58df96 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042367 Mar 03 02:39:59.714289 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1003/1993] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:39:59 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:00.350619 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ae0b5d82-d9fe-4f10-9a8d-28307a1f83c6 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:00.351376 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ae0b5d82-d9fe-4f10-9a8d-28307a1f83c6 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:00.358158 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ae0b5d82-d9fe-4f10-9a8d-28307a1f83c6 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:00.358609 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ae0b5d82-d9fe-4f10-9a8d-28307a1f83c6 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:00.359417 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ae0b5d82-d9fe-4f10-9a8d-28307a1f83c6 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:00.359884 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ae0b5d82-d9fe-4f10-9a8d-28307a1f83c6 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:00.420259 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ae0b5d82-d9fe-4f10-9a8d-28307a1f83c6 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:40:00.428039 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ae0b5d82-d9fe-4f10-9a8d-28307a1f83c6 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.081605 Mar 03 02:40:00.428601 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 991/1994] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:40:00 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:40:00.725313 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ae8fd4a7-9bf0-49ed-982c-4722b1315ec3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:00.726694 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ae8fd4a7-9bf0-49ed-982c-4722b1315ec3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:00.732948 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ae8fd4a7-9bf0-49ed-982c-4722b1315ec3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:00.733409 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ae8fd4a7-9bf0-49ed-982c-4722b1315ec3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:00.734194 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ae8fd4a7-9bf0-49ed-982c-4722b1315ec3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:00.734637 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ae8fd4a7-9bf0-49ed-982c-4722b1315ec3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:00.763151 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ae8fd4a7-9bf0-49ed-982c-4722b1315ec3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041890 Mar 03 02:40:00.763729 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1004/1995] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:00 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:01.446126 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8325cd91-e53e-4a2d-8602-642c111d0659 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:01.446728 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8325cd91-e53e-4a2d-8602-642c111d0659 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:01.452928 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8325cd91-e53e-4a2d-8602-642c111d0659 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:01.453379 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8325cd91-e53e-4a2d-8602-642c111d0659 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:01.454178 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8325cd91-e53e-4a2d-8602-642c111d0659 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:01.454611 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8325cd91-e53e-4a2d-8602-642c111d0659 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:01.516257 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8325cd91-e53e-4a2d-8602-642c111d0659 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:40:01.524133 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8325cd91-e53e-4a2d-8602-642c111d0659 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.081771 Mar 03 02:40:01.524701 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 992/1996] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:40:01 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:40:01.774541 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-15414fde-8aed-481f-ae27-9dce343b909b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:01.775392 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-15414fde-8aed-481f-ae27-9dce343b909b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:01.781207 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-15414fde-8aed-481f-ae27-9dce343b909b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:01.781650 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-15414fde-8aed-481f-ae27-9dce343b909b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:01.782424 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-15414fde-8aed-481f-ae27-9dce343b909b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:01.782859 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-15414fde-8aed-481f-ae27-9dce343b909b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:01.810040 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-15414fde-8aed-481f-ae27-9dce343b909b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039633 Mar 03 02:40:01.810580 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1005/1997] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:01 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:02.541494 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-00cad03e-de04-4168-8155-bc9a45374fb0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:02.542099 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-00cad03e-de04-4168-8155-bc9a45374fb0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:02.548578 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-00cad03e-de04-4168-8155-bc9a45374fb0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:02.549024 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-00cad03e-de04-4168-8155-bc9a45374fb0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:02.549800 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-00cad03e-de04-4168-8155-bc9a45374fb0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:02.550237 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-00cad03e-de04-4168-8155-bc9a45374fb0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:02.609108 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-00cad03e-de04-4168-8155-bc9a45374fb0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:40:02.616279 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-00cad03e-de04-4168-8155-bc9a45374fb0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.079340 Mar 03 02:40:02.616838 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 993/1998] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:40:02 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:40:02.822032 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-502e1bfb-ae5f-4f5c-a7cd-33fbc7669ec6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:02.822871 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-502e1bfb-ae5f-4f5c-a7cd-33fbc7669ec6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:02.829108 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-502e1bfb-ae5f-4f5c-a7cd-33fbc7669ec6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:02.829564 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-502e1bfb-ae5f-4f5c-a7cd-33fbc7669ec6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:02.830358 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-502e1bfb-ae5f-4f5c-a7cd-33fbc7669ec6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:02.830800 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-502e1bfb-ae5f-4f5c-a7cd-33fbc7669ec6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:02.858265 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-502e1bfb-ae5f-4f5c-a7cd-33fbc7669ec6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040802 Mar 03 02:40:02.858826 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1006/1999] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:02 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:03.633632 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a9b25a6a-4a97-40af-aa58-6cc2d0c157cc tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:03.634240 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a9b25a6a-4a97-40af-aa58-6cc2d0c157cc tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:03.640398 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a9b25a6a-4a97-40af-aa58-6cc2d0c157cc tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:03.640850 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a9b25a6a-4a97-40af-aa58-6cc2d0c157cc tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:03.641626 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a9b25a6a-4a97-40af-aa58-6cc2d0c157cc tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:03.642064 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a9b25a6a-4a97-40af-aa58-6cc2d0c157cc tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:03.699822 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a9b25a6a-4a97-40af-aa58-6cc2d0c157cc tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:40:03.706961 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a9b25a6a-4a97-40af-aa58-6cc2d0c157cc tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.077693 Mar 03 02:40:03.707515 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 994/2000] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:40:03 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:40:03.870464 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-dea4b343-614e-4fd0-8a86-95328eb76528 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:03.871377 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-dea4b343-614e-4fd0-8a86-95328eb76528 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:03.877620 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dea4b343-614e-4fd0-8a86-95328eb76528 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:03.878073 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dea4b343-614e-4fd0-8a86-95328eb76528 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:03.878857 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dea4b343-614e-4fd0-8a86-95328eb76528 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:03.879298 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dea4b343-614e-4fd0-8a86-95328eb76528 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:03.907425 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-dea4b343-614e-4fd0-8a86-95328eb76528 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041751 Mar 03 02:40:03.908029 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1007/2001] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:03 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:04.724569 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-77a48eb4-f4fe-46e6-a935-57d4c031f1b7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:04.725186 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-77a48eb4-f4fe-46e6-a935-57d4c031f1b7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:04.732049 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-77a48eb4-f4fe-46e6-a935-57d4c031f1b7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:04.732505 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-77a48eb4-f4fe-46e6-a935-57d4c031f1b7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:04.733290 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-77a48eb4-f4fe-46e6-a935-57d4c031f1b7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:04.733734 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-77a48eb4-f4fe-46e6-a935-57d4c031f1b7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:04.792396 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-77a48eb4-f4fe-46e6-a935-57d4c031f1b7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:40:04.799506 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-77a48eb4-f4fe-46e6-a935-57d4c031f1b7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078843 Mar 03 02:40:04.800096 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 995/2002] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:40:04 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:40:04.919198 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f2ff1d69-5278-4f5f-be14-a323c62bd100 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:04.920130 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f2ff1d69-5278-4f5f-be14-a323c62bd100 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:04.926251 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f2ff1d69-5278-4f5f-be14-a323c62bd100 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:04.926695 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f2ff1d69-5278-4f5f-be14-a323c62bd100 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:04.927462 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f2ff1d69-5278-4f5f-be14-a323c62bd100 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:04.927930 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f2ff1d69-5278-4f5f-be14-a323c62bd100 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:04.956622 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f2ff1d69-5278-4f5f-be14-a323c62bd100 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041400 Mar 03 02:40:04.957180 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1008/2003] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:04 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:05.816068 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-922db830-0fac-4ace-b7a6-a11aa227b186 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:05.816596 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-922db830-0fac-4ace-b7a6-a11aa227b186 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:05.822954 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-922db830-0fac-4ace-b7a6-a11aa227b186 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:05.823407 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-922db830-0fac-4ace-b7a6-a11aa227b186 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:05.824241 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-922db830-0fac-4ace-b7a6-a11aa227b186 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:05.824681 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-922db830-0fac-4ace-b7a6-a11aa227b186 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:05.885102 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-922db830-0fac-4ace-b7a6-a11aa227b186 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:40:05.892827 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-922db830-0fac-4ace-b7a6-a11aa227b186 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.080769 Mar 03 02:40:05.893626 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 996/2004] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:40:05 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:40:05.968234 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e0365dde-44f1-43ad-9c5e-bf1dd6660313 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:05.969159 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e0365dde-44f1-43ad-9c5e-bf1dd6660313 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:05.975487 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e0365dde-44f1-43ad-9c5e-bf1dd6660313 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:05.975986 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e0365dde-44f1-43ad-9c5e-bf1dd6660313 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:05.977066 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e0365dde-44f1-43ad-9c5e-bf1dd6660313 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:05.977672 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e0365dde-44f1-43ad-9c5e-bf1dd6660313 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:06.010779 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e0365dde-44f1-43ad-9c5e-bf1dd6660313 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046533 Mar 03 02:40:06.011361 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1009/2005] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:05 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:06.910462 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9a603b86-1786-447b-a864-14ea7df54fa4 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:06.911058 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9a603b86-1786-447b-a864-14ea7df54fa4 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:06.917898 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9a603b86-1786-447b-a864-14ea7df54fa4 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:06.918345 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9a603b86-1786-447b-a864-14ea7df54fa4 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:06.919129 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9a603b86-1786-447b-a864-14ea7df54fa4 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:06.919557 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9a603b86-1786-447b-a864-14ea7df54fa4 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:06.978267 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9a603b86-1786-447b-a864-14ea7df54fa4 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:40:06.985851 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9a603b86-1786-447b-a864-14ea7df54fa4 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.079306 Mar 03 02:40:06.986415 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 997/2006] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:40:06 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:40:07.022381 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5fa51178-a77c-4f69-b861-2014f09f4de7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:07.023816 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5fa51178-a77c-4f69-b861-2014f09f4de7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:07.030011 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5fa51178-a77c-4f69-b861-2014f09f4de7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:07.030475 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5fa51178-a77c-4f69-b861-2014f09f4de7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:07.031249 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5fa51178-a77c-4f69-b861-2014f09f4de7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:07.031711 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5fa51178-a77c-4f69-b861-2014f09f4de7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:07.059408 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5fa51178-a77c-4f69-b861-2014f09f4de7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040939 Mar 03 02:40:07.060001 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1010/2007] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:07 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:08.002361 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-45f73fcb-6533-4bcd-bb7b-26c13dac4014 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:08.002936 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-45f73fcb-6533-4bcd-bb7b-26c13dac4014 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:08.009328 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-45f73fcb-6533-4bcd-bb7b-26c13dac4014 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:08.009776 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-45f73fcb-6533-4bcd-bb7b-26c13dac4014 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:08.010547 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-45f73fcb-6533-4bcd-bb7b-26c13dac4014 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:08.010980 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-45f73fcb-6533-4bcd-bb7b-26c13dac4014 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:08.070630 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6ff1c79f-39f6-4d1e-a23f-28452c32f7bb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:08.071571 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6ff1c79f-39f6-4d1e-a23f-28452c32f7bb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:08.072861 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-45f73fcb-6533-4bcd-bb7b-26c13dac4014 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:40:08.077583 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6ff1c79f-39f6-4d1e-a23f-28452c32f7bb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:08.078028 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6ff1c79f-39f6-4d1e-a23f-28452c32f7bb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:08.078812 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6ff1c79f-39f6-4d1e-a23f-28452c32f7bb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:08.079242 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6ff1c79f-39f6-4d1e-a23f-28452c32f7bb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:08.080133 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-45f73fcb-6533-4bcd-bb7b-26c13dac4014 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.081680 Mar 03 02:40:08.080696 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 998/2008] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:40:07 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:40:08.107009 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6ff1c79f-39f6-4d1e-a23f-28452c32f7bb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040447 Mar 03 02:40:08.107552 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1011/2009] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:08 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:40:09.097877 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-582bf3df-a63f-41fa-8b97-378adb8d7dd5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:09.098611 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-582bf3df-a63f-41fa-8b97-378adb8d7dd5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:09.104941 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-582bf3df-a63f-41fa-8b97-378adb8d7dd5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:09.105412 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-582bf3df-a63f-41fa-8b97-378adb8d7dd5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:09.106190 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-582bf3df-a63f-41fa-8b97-378adb8d7dd5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:09.106623 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-582bf3df-a63f-41fa-8b97-378adb8d7dd5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:09.119686 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-bfcbcdf3-5fb2-4e87-8328-be482998e005 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:09.120622 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-bfcbcdf3-5fb2-4e87-8328-be482998e005 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:09.127349 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bfcbcdf3-5fb2-4e87-8328-be482998e005 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:09.127844 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bfcbcdf3-5fb2-4e87-8328-be482998e005 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:09.128628 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bfcbcdf3-5fb2-4e87-8328-be482998e005 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:09.129066 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bfcbcdf3-5fb2-4e87-8328-be482998e005 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:09.157484 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-bfcbcdf3-5fb2-4e87-8328-be482998e005 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042913 Mar 03 02:40:09.158053 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1012/2010] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:09 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:40:09.165318 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-582bf3df-a63f-41fa-8b97-378adb8d7dd5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:40:09.172522 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-582bf3df-a63f-41fa-8b97-378adb8d7dd5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078684 Mar 03 02:40:09.173069 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 999/2011] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:40:09 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:40:10.170157 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-19aad967-3c5b-4f5c-a286-00155e740aa9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:10.171060 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-19aad967-3c5b-4f5c-a286-00155e740aa9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:10.177335 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-19aad967-3c5b-4f5c-a286-00155e740aa9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:10.177779 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-19aad967-3c5b-4f5c-a286-00155e740aa9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:10.178557 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-19aad967-3c5b-4f5c-a286-00155e740aa9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:10.178999 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-19aad967-3c5b-4f5c-a286-00155e740aa9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:10.189601 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6bbfb1ee-216b-457a-a95b-0214c3199e55 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:10.190207 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6bbfb1ee-216b-457a-a95b-0214c3199e55 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:10.196821 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6bbfb1ee-216b-457a-a95b-0214c3199e55 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:10.197287 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6bbfb1ee-216b-457a-a95b-0214c3199e55 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:10.198071 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6bbfb1ee-216b-457a-a95b-0214c3199e55 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:10.198501 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6bbfb1ee-216b-457a-a95b-0214c3199e55 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:10.207803 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-19aad967-3c5b-4f5c-a286-00155e740aa9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042157 Mar 03 02:40:10.208378 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1013/2012] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:10 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:10.257892 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6bbfb1ee-216b-457a-a95b-0214c3199e55 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:40:10.264871 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6bbfb1ee-216b-457a-a95b-0214c3199e55 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.079104 Mar 03 02:40:10.265427 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1000/2013] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:40:10 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:40:11.220110 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-494119d6-c28c-4f85-a09b-8414208e46f8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:11.221018 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-494119d6-c28c-4f85-a09b-8414208e46f8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:11.228447 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-494119d6-c28c-4f85-a09b-8414208e46f8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:11.228898 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-494119d6-c28c-4f85-a09b-8414208e46f8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:11.229679 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-494119d6-c28c-4f85-a09b-8414208e46f8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:11.230114 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-494119d6-c28c-4f85-a09b-8414208e46f8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:11.258874 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-494119d6-c28c-4f85-a09b-8414208e46f8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042662 Mar 03 02:40:11.259425 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1014/2014] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:11 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:11.281769 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a29a80c8-4479-4e4c-9c43-9a4fd49393fe tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:11.282373 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a29a80c8-4479-4e4c-9c43-9a4fd49393fe tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:11.289113 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a29a80c8-4479-4e4c-9c43-9a4fd49393fe tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:11.289614 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a29a80c8-4479-4e4c-9c43-9a4fd49393fe tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:11.290324 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a29a80c8-4479-4e4c-9c43-9a4fd49393fe tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:11.290754 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a29a80c8-4479-4e4c-9c43-9a4fd49393fe tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:11.347431 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a29a80c8-4479-4e4c-9c43-9a4fd49393fe tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:40:11.355517 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a29a80c8-4479-4e4c-9c43-9a4fd49393fe tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.077606 Mar 03 02:40:11.356147 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1001/2015] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:40:11 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:40:12.270428 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6343d698-6ff5-4947-a5a2-0f98f66f58ed tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:12.271335 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6343d698-6ff5-4947-a5a2-0f98f66f58ed tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:12.278101 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6343d698-6ff5-4947-a5a2-0f98f66f58ed tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:12.278558 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6343d698-6ff5-4947-a5a2-0f98f66f58ed tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:12.279331 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6343d698-6ff5-4947-a5a2-0f98f66f58ed tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:12.279806 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6343d698-6ff5-4947-a5a2-0f98f66f58ed tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:12.307850 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6343d698-6ff5-4947-a5a2-0f98f66f58ed tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041327 Mar 03 02:40:12.308335 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1015/2016] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:12 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:12.372357 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a24f4724-f2bc-477d-8392-b825904df5b7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:12.372963 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a24f4724-f2bc-477d-8392-b825904df5b7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:12.379138 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a24f4724-f2bc-477d-8392-b825904df5b7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:12.379589 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a24f4724-f2bc-477d-8392-b825904df5b7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:12.380395 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a24f4724-f2bc-477d-8392-b825904df5b7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:12.380832 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a24f4724-f2bc-477d-8392-b825904df5b7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:12.441186 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a24f4724-f2bc-477d-8392-b825904df5b7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:40:12.448455 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a24f4724-f2bc-477d-8392-b825904df5b7 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.080242 Mar 03 02:40:12.449011 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1002/2017] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:40:12 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:40:13.319410 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8c0cbf8d-4530-4b78-b9f5-6ed6d6ae8a36 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:13.321224 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8c0cbf8d-4530-4b78-b9f5-6ed6d6ae8a36 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:13.327419 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8c0cbf8d-4530-4b78-b9f5-6ed6d6ae8a36 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:13.327907 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8c0cbf8d-4530-4b78-b9f5-6ed6d6ae8a36 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:13.328686 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8c0cbf8d-4530-4b78-b9f5-6ed6d6ae8a36 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:13.329124 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8c0cbf8d-4530-4b78-b9f5-6ed6d6ae8a36 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:13.357607 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8c0cbf8d-4530-4b78-b9f5-6ed6d6ae8a36 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042353 Mar 03 02:40:13.358156 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1016/2018] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:13 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:13.466094 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1d6e08a9-764a-41c7-ac03-81d31b1735d5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:13.466697 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1d6e08a9-764a-41c7-ac03-81d31b1735d5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:13.472902 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1d6e08a9-764a-41c7-ac03-81d31b1735d5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:13.473353 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1d6e08a9-764a-41c7-ac03-81d31b1735d5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:13.474225 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1d6e08a9-764a-41c7-ac03-81d31b1735d5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:13.474616 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1d6e08a9-764a-41c7-ac03-81d31b1735d5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:13.533246 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1d6e08a9-764a-41c7-ac03-81d31b1735d5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:40:13.541093 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1d6e08a9-764a-41c7-ac03-81d31b1735d5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078931 Mar 03 02:40:13.541644 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1003/2019] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:40:13 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:40:14.370130 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4bd55a62-15d9-49e2-941d-11015a522dfa tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:14.371043 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4bd55a62-15d9-49e2-941d-11015a522dfa tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:14.377309 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4bd55a62-15d9-49e2-941d-11015a522dfa tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:14.377760 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4bd55a62-15d9-49e2-941d-11015a522dfa tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:14.378542 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4bd55a62-15d9-49e2-941d-11015a522dfa tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:14.378979 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4bd55a62-15d9-49e2-941d-11015a522dfa tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:14.406884 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4bd55a62-15d9-49e2-941d-11015a522dfa tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041456 Mar 03 02:40:14.407435 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1017/2020] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:14 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:14.558009 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-779ac1a0-cb7b-4268-9317-39d83964b141 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:14.558607 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-779ac1a0-cb7b-4268-9317-39d83964b141 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:14.564413 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-779ac1a0-cb7b-4268-9317-39d83964b141 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:14.564862 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-779ac1a0-cb7b-4268-9317-39d83964b141 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:14.565635 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-779ac1a0-cb7b-4268-9317-39d83964b141 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:14.566064 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-779ac1a0-cb7b-4268-9317-39d83964b141 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:14.628086 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-779ac1a0-cb7b-4268-9317-39d83964b141 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:40:14.635774 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-779ac1a0-cb7b-4268-9317-39d83964b141 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.082074 Mar 03 02:40:14.636331 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1004/2021] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:40:14 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:40:15.418486 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0ad2fdd4-97e1-4907-a024-eaab25f89e61 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:15.419385 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0ad2fdd4-97e1-4907-a024-eaab25f89e61 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:15.425680 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0ad2fdd4-97e1-4907-a024-eaab25f89e61 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:15.426121 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0ad2fdd4-97e1-4907-a024-eaab25f89e61 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:15.426886 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0ad2fdd4-97e1-4907-a024-eaab25f89e61 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:15.427315 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0ad2fdd4-97e1-4907-a024-eaab25f89e61 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:15.454405 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0ad2fdd4-97e1-4907-a024-eaab25f89e61 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039955 Mar 03 02:40:15.454943 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1018/2022] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:15 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:15.652954 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f96aadfb-dbd3-4897-84f7-0fbf5d168b6e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:15.653557 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f96aadfb-dbd3-4897-84f7-0fbf5d168b6e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:15.659901 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f96aadfb-dbd3-4897-84f7-0fbf5d168b6e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:15.660350 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f96aadfb-dbd3-4897-84f7-0fbf5d168b6e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:15.661127 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f96aadfb-dbd3-4897-84f7-0fbf5d168b6e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:15.661560 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f96aadfb-dbd3-4897-84f7-0fbf5d168b6e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:15.718919 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f96aadfb-dbd3-4897-84f7-0fbf5d168b6e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:40:15.726247 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f96aadfb-dbd3-4897-84f7-0fbf5d168b6e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.076904 Mar 03 02:40:15.726817 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1005/2023] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:40:15 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:40:16.466342 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-505d1b8c-52bd-4823-924a-29ce9c0c4c14 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:16.467306 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-505d1b8c-52bd-4823-924a-29ce9c0c4c14 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:16.473554 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-505d1b8c-52bd-4823-924a-29ce9c0c4c14 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:16.474002 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-505d1b8c-52bd-4823-924a-29ce9c0c4c14 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:16.474776 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-505d1b8c-52bd-4823-924a-29ce9c0c4c14 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:16.475209 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-505d1b8c-52bd-4823-924a-29ce9c0c4c14 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:16.503850 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-505d1b8c-52bd-4823-924a-29ce9c0c4c14 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041422 Mar 03 02:40:16.504390 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1019/2024] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:16 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:16.742436 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f70d3068-f582-4fbb-8b1a-d86b12a5eb90 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:16.743255 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f70d3068-f582-4fbb-8b1a-d86b12a5eb90 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:16.749444 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f70d3068-f582-4fbb-8b1a-d86b12a5eb90 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:16.749888 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f70d3068-f582-4fbb-8b1a-d86b12a5eb90 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:16.750763 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f70d3068-f582-4fbb-8b1a-d86b12a5eb90 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:16.751202 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f70d3068-f582-4fbb-8b1a-d86b12a5eb90 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:16.809583 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f70d3068-f582-4fbb-8b1a-d86b12a5eb90 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:40:16.816873 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f70d3068-f582-4fbb-8b1a-d86b12a5eb90 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078526 Mar 03 02:40:16.817435 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1006/2025] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:40:16 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:40:17.514949 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-26392742-7d9b-4af4-835c-1d18d156d96c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:17.515874 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-26392742-7d9b-4af4-835c-1d18d156d96c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:17.522053 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-26392742-7d9b-4af4-835c-1d18d156d96c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:17.522500 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-26392742-7d9b-4af4-835c-1d18d156d96c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:17.523498 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-26392742-7d9b-4af4-835c-1d18d156d96c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:17.523961 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-26392742-7d9b-4af4-835c-1d18d156d96c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:17.551208 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-26392742-7d9b-4af4-835c-1d18d156d96c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040242 Mar 03 02:40:17.551788 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1020/2026] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:17 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:17.833216 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ebbcc56e-560d-4389-b516-0ccf96551c4f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:17.833819 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ebbcc56e-560d-4389-b516-0ccf96551c4f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:17.840091 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ebbcc56e-560d-4389-b516-0ccf96551c4f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:17.840537 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ebbcc56e-560d-4389-b516-0ccf96551c4f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:17.841309 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ebbcc56e-560d-4389-b516-0ccf96551c4f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:17.841772 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ebbcc56e-560d-4389-b516-0ccf96551c4f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:17.898964 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ebbcc56e-560d-4389-b516-0ccf96551c4f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:40:17.906077 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ebbcc56e-560d-4389-b516-0ccf96551c4f tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.076706 Mar 03 02:40:17.906639 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1007/2027] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:40:17 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:40:18.562409 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a059d6bb-5ceb-4857-bb70-f674d5854562 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:18.563336 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a059d6bb-5ceb-4857-bb70-f674d5854562 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:18.570576 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a059d6bb-5ceb-4857-bb70-f674d5854562 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:18.571033 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a059d6bb-5ceb-4857-bb70-f674d5854562 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:18.571856 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a059d6bb-5ceb-4857-bb70-f674d5854562 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:18.572293 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a059d6bb-5ceb-4857-bb70-f674d5854562 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:18.599726 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a059d6bb-5ceb-4857-bb70-f674d5854562 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041234 Mar 03 02:40:18.600267 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1021/2028] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:18 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:18.922403 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2e97d74a-54a0-41f5-b23f-9e41348d17e0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:18.923006 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2e97d74a-54a0-41f5-b23f-9e41348d17e0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:18.929841 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2e97d74a-54a0-41f5-b23f-9e41348d17e0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:18.930283 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2e97d74a-54a0-41f5-b23f-9e41348d17e0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:18.931058 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2e97d74a-54a0-41f5-b23f-9e41348d17e0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:18.931495 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2e97d74a-54a0-41f5-b23f-9e41348d17e0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:18.990361 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2e97d74a-54a0-41f5-b23f-9e41348d17e0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:40:18.998365 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2e97d74a-54a0-41f5-b23f-9e41348d17e0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.079836 Mar 03 02:40:18.998927 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1008/2029] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:40:18 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:40:19.611420 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-eb3c88ee-8cb7-488e-bb8c-734285dadff0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:19.612348 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-eb3c88ee-8cb7-488e-bb8c-734285dadff0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:19.619021 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eb3c88ee-8cb7-488e-bb8c-734285dadff0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:19.619467 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eb3c88ee-8cb7-488e-bb8c-734285dadff0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:19.620270 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eb3c88ee-8cb7-488e-bb8c-734285dadff0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:19.620703 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eb3c88ee-8cb7-488e-bb8c-734285dadff0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:19.648330 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-eb3c88ee-8cb7-488e-bb8c-734285dadff0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040196 Mar 03 02:40:19.649054 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1022/2030] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:19 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:20.015748 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-95d22cf0-da3f-49bb-8a95-6f91fb2e9e19 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:20.016350 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-95d22cf0-da3f-49bb-8a95-6f91fb2e9e19 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:20.023137 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-95d22cf0-da3f-49bb-8a95-6f91fb2e9e19 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:20.023656 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-95d22cf0-da3f-49bb-8a95-6f91fb2e9e19 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:20.024427 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-95d22cf0-da3f-49bb-8a95-6f91fb2e9e19 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:20.024862 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-95d22cf0-da3f-49bb-8a95-6f91fb2e9e19 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:20.082954 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-95d22cf0-da3f-49bb-8a95-6f91fb2e9e19 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:40:20.090841 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-95d22cf0-da3f-49bb-8a95-6f91fb2e9e19 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078975 Mar 03 02:40:20.091392 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1009/2031] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:40:20 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:40:20.660131 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-237cd4c0-65a4-4fa8-84d9-187efcc32030 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:20.661041 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-237cd4c0-65a4-4fa8-84d9-187efcc32030 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:20.667388 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-237cd4c0-65a4-4fa8-84d9-187efcc32030 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:20.667863 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-237cd4c0-65a4-4fa8-84d9-187efcc32030 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:20.668646 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-237cd4c0-65a4-4fa8-84d9-187efcc32030 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:20.669085 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-237cd4c0-65a4-4fa8-84d9-187efcc32030 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:20.696305 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-237cd4c0-65a4-4fa8-84d9-187efcc32030 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040142 Mar 03 02:40:20.697882 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1023/2032] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:20 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:21.107364 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f03695ea-4e5d-4ff8-b695-6b5c7f25d5e5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:21.107992 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f03695ea-4e5d-4ff8-b695-6b5c7f25d5e5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:21.114120 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f03695ea-4e5d-4ff8-b695-6b5c7f25d5e5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:21.114567 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f03695ea-4e5d-4ff8-b695-6b5c7f25d5e5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:21.115341 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f03695ea-4e5d-4ff8-b695-6b5c7f25d5e5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:21.115810 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f03695ea-4e5d-4ff8-b695-6b5c7f25d5e5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:21.179426 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f03695ea-4e5d-4ff8-b695-6b5c7f25d5e5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:40:21.186622 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f03695ea-4e5d-4ff8-b695-6b5c7f25d5e5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.083074 Mar 03 02:40:21.187187 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1010/2033] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:40:21 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:40:21.708920 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1c37e4e7-619d-44b8-942b-d29aff3fb3c9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:21.709821 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1c37e4e7-619d-44b8-942b-d29aff3fb3c9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:21.716202 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1c37e4e7-619d-44b8-942b-d29aff3fb3c9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:21.716644 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1c37e4e7-619d-44b8-942b-d29aff3fb3c9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:21.717413 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1c37e4e7-619d-44b8-942b-d29aff3fb3c9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:21.717846 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1c37e4e7-619d-44b8-942b-d29aff3fb3c9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:21.746258 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1c37e4e7-619d-44b8-942b-d29aff3fb3c9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041243 Mar 03 02:40:21.746742 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1024/2034] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:21 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:22.204306 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6f7f106f-1abe-465a-a792-e832a1c8379e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:22.204923 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6f7f106f-1abe-465a-a792-e832a1c8379e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:22.212378 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6f7f106f-1abe-465a-a792-e832a1c8379e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:22.212828 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6f7f106f-1abe-465a-a792-e832a1c8379e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:22.213607 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6f7f106f-1abe-465a-a792-e832a1c8379e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:22.214045 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6f7f106f-1abe-465a-a792-e832a1c8379e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:22.271332 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6f7f106f-1abe-465a-a792-e832a1c8379e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:40:22.279181 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6f7f106f-1abe-465a-a792-e832a1c8379e tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078706 Mar 03 02:40:22.279763 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1011/2035] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:40:22 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:40:22.757808 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-22714ea2-c3e1-4e96-8283-7f4389a6bd61 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:22.758732 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-22714ea2-c3e1-4e96-8283-7f4389a6bd61 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:22.764888 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-22714ea2-c3e1-4e96-8283-7f4389a6bd61 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:22.765333 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-22714ea2-c3e1-4e96-8283-7f4389a6bd61 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:22.766101 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-22714ea2-c3e1-4e96-8283-7f4389a6bd61 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:22.766534 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-22714ea2-c3e1-4e96-8283-7f4389a6bd61 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:22.793091 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-22714ea2-c3e1-4e96-8283-7f4389a6bd61 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039801 Mar 03 02:40:22.793639 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1025/2036] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:22 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:23.295438 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3d894d5b-6ce7-4da6-9abc-8a32362bfb13 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:23.296077 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3d894d5b-6ce7-4da6-9abc-8a32362bfb13 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:23.302365 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3d894d5b-6ce7-4da6-9abc-8a32362bfb13 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:23.302761 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3d894d5b-6ce7-4da6-9abc-8a32362bfb13 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:23.303539 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3d894d5b-6ce7-4da6-9abc-8a32362bfb13 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:23.304117 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3d894d5b-6ce7-4da6-9abc-8a32362bfb13 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:23.363329 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-3d894d5b-6ce7-4da6-9abc-8a32362bfb13 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:40:23.370945 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3d894d5b-6ce7-4da6-9abc-8a32362bfb13 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.079595 Mar 03 02:40:23.371500 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1012/2037] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:40:23 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:40:23.804564 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-080376e4-f1c5-4dc1-a5c2-235434f5d1d0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:23.805514 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-080376e4-f1c5-4dc1-a5c2-235434f5d1d0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:23.811832 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-080376e4-f1c5-4dc1-a5c2-235434f5d1d0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:23.812312 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-080376e4-f1c5-4dc1-a5c2-235434f5d1d0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:23.813077 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-080376e4-f1c5-4dc1-a5c2-235434f5d1d0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:23.813520 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-080376e4-f1c5-4dc1-a5c2-235434f5d1d0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:23.844804 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-080376e4-f1c5-4dc1-a5c2-235434f5d1d0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044320 Mar 03 02:40:23.845366 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1026/2038] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:23 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:24.388707 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-23b724f4-fa10-4569-9472-d6a210754f30 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:24.389307 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-23b724f4-fa10-4569-9472-d6a210754f30 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:24.395550 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-23b724f4-fa10-4569-9472-d6a210754f30 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:24.396028 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-23b724f4-fa10-4569-9472-d6a210754f30 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:24.396803 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-23b724f4-fa10-4569-9472-d6a210754f30 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:24.397246 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-23b724f4-fa10-4569-9472-d6a210754f30 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:24.455804 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-23b724f4-fa10-4569-9472-d6a210754f30 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:40:24.463325 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-23b724f4-fa10-4569-9472-d6a210754f30 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078542 Mar 03 02:40:24.463937 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1013/2039] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:40:24 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:40:24.856819 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5151aaf3-0da8-4287-9bc4-5acb25db16f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:24.857728 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5151aaf3-0da8-4287-9bc4-5acb25db16f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:24.863884 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5151aaf3-0da8-4287-9bc4-5acb25db16f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:24.864326 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5151aaf3-0da8-4287-9bc4-5acb25db16f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:24.865095 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5151aaf3-0da8-4287-9bc4-5acb25db16f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:24.865524 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5151aaf3-0da8-4287-9bc4-5acb25db16f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:24.892255 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5151aaf3-0da8-4287-9bc4-5acb25db16f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039369 Mar 03 02:40:24.892795 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1027/2040] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:24 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:25.480021 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-aade7dae-c410-4b13-9d20-4dcbaa5da44c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:25.480747 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-aade7dae-c410-4b13-9d20-4dcbaa5da44c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:25.486929 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aade7dae-c410-4b13-9d20-4dcbaa5da44c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:25.487381 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aade7dae-c410-4b13-9d20-4dcbaa5da44c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:25.488193 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aade7dae-c410-4b13-9d20-4dcbaa5da44c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:25.488634 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aade7dae-c410-4b13-9d20-4dcbaa5da44c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:25.546142 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-aade7dae-c410-4b13-9d20-4dcbaa5da44c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:40:25.553306 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-aade7dae-c410-4b13-9d20-4dcbaa5da44c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.077172 Mar 03 02:40:25.554382 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1014/2041] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:40:25 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:40:25.903724 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b5acb8fb-02ca-4544-97aa-0e9127faa9ff tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:25.904629 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b5acb8fb-02ca-4544-97aa-0e9127faa9ff tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:25.910961 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b5acb8fb-02ca-4544-97aa-0e9127faa9ff tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:25.911411 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b5acb8fb-02ca-4544-97aa-0e9127faa9ff tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:25.912216 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b5acb8fb-02ca-4544-97aa-0e9127faa9ff tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:25.912650 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b5acb8fb-02ca-4544-97aa-0e9127faa9ff tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:25.941028 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b5acb8fb-02ca-4544-97aa-0e9127faa9ff tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041261 Mar 03 02:40:25.941573 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1028/2042] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:25 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:26.570459 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3558844c-3485-48cf-836a-cee1a44fda97 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:26.571057 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3558844c-3485-48cf-836a-cee1a44fda97 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:26.577253 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3558844c-3485-48cf-836a-cee1a44fda97 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:26.577726 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3558844c-3485-48cf-836a-cee1a44fda97 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:26.578494 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3558844c-3485-48cf-836a-cee1a44fda97 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:26.578923 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3558844c-3485-48cf-836a-cee1a44fda97 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:26.636955 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-3558844c-3485-48cf-836a-cee1a44fda97 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:40:26.644041 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3558844c-3485-48cf-836a-cee1a44fda97 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.077406 Mar 03 02:40:26.644595 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1015/2043] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:40:26 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:40:26.952854 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-283f8159-39de-4dc0-91bd-c5478909bb12 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:26.953794 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-283f8159-39de-4dc0-91bd-c5478909bb12 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:26.960837 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-283f8159-39de-4dc0-91bd-c5478909bb12 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:26.961493 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-283f8159-39de-4dc0-91bd-c5478909bb12 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:26.962266 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-283f8159-39de-4dc0-91bd-c5478909bb12 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:26.962700 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-283f8159-39de-4dc0-91bd-c5478909bb12 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:26.989514 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-283f8159-39de-4dc0-91bd-c5478909bb12 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040600 Mar 03 02:40:26.990059 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1029/2044] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:26 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:27.661567 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8b0f3b58-a296-4d4f-a24c-29788605cc5d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:27.662168 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8b0f3b58-a296-4d4f-a24c-29788605cc5d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:27.669099 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b0f3b58-a296-4d4f-a24c-29788605cc5d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:27.669542 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b0f3b58-a296-4d4f-a24c-29788605cc5d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:27.670314 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b0f3b58-a296-4d4f-a24c-29788605cc5d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:27.670745 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b0f3b58-a296-4d4f-a24c-29788605cc5d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:27.731525 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8b0f3b58-a296-4d4f-a24c-29788605cc5d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:40:27.738610 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8b0f3b58-a296-4d4f-a24c-29788605cc5d tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.080888 Mar 03 02:40:27.739169 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1016/2045] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:40:27 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:40:28.001620 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-acf681d7-4f77-491a-8143-e00a89c5a995 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:28.002453 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-acf681d7-4f77-491a-8143-e00a89c5a995 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:28.008795 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-acf681d7-4f77-491a-8143-e00a89c5a995 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:28.009250 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-acf681d7-4f77-491a-8143-e00a89c5a995 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:28.010040 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-acf681d7-4f77-491a-8143-e00a89c5a995 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:28.010476 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-acf681d7-4f77-491a-8143-e00a89c5a995 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:28.037825 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-acf681d7-4f77-491a-8143-e00a89c5a995 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040258 Mar 03 02:40:28.039013 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1030/2046] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:27 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:28.756129 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-65924848-8a03-43db-91d4-6ae6fd638785 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:28.757204 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-65924848-8a03-43db-91d4-6ae6fd638785 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:28.765232 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-65924848-8a03-43db-91d4-6ae6fd638785 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:28.765787 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-65924848-8a03-43db-91d4-6ae6fd638785 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:28.766662 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-65924848-8a03-43db-91d4-6ae6fd638785 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:28.767203 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-65924848-8a03-43db-91d4-6ae6fd638785 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:28.826072 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-65924848-8a03-43db-91d4-6ae6fd638785 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:40:28.833198 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-65924848-8a03-43db-91d4-6ae6fd638785 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.080912 Mar 03 02:40:28.833758 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1017/2047] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:40:28 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:40:29.050269 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c69690fb-1030-4c63-bf08-885440456401 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:29.051084 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c69690fb-1030-4c63-bf08-885440456401 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:29.057646 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c69690fb-1030-4c63-bf08-885440456401 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:29.058094 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c69690fb-1030-4c63-bf08-885440456401 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:29.058867 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c69690fb-1030-4c63-bf08-885440456401 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:29.059298 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c69690fb-1030-4c63-bf08-885440456401 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:29.087780 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c69690fb-1030-4c63-bf08-885440456401 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041527 Mar 03 02:40:29.088331 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1031/2048] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:29 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:29.850877 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-decf04e6-876f-4d06-abee-c45ce72cdaf2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:29.851633 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-decf04e6-876f-4d06-abee-c45ce72cdaf2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:29.857813 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-decf04e6-876f-4d06-abee-c45ce72cdaf2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:29.858253 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-decf04e6-876f-4d06-abee-c45ce72cdaf2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:29.859021 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-decf04e6-876f-4d06-abee-c45ce72cdaf2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:29.859453 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-decf04e6-876f-4d06-abee-c45ce72cdaf2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:29.917247 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-decf04e6-876f-4d06-abee-c45ce72cdaf2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:40:29.924370 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-decf04e6-876f-4d06-abee-c45ce72cdaf2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.077976 Mar 03 02:40:29.924939 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1018/2049] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:40:29 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:40:30.099198 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7aba9e32-7c68-4799-afb1-db5fb52573f0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:30.100134 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7aba9e32-7c68-4799-afb1-db5fb52573f0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:30.107555 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7aba9e32-7c68-4799-afb1-db5fb52573f0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:30.107985 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7aba9e32-7c68-4799-afb1-db5fb52573f0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:30.108762 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7aba9e32-7c68-4799-afb1-db5fb52573f0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:30.109193 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7aba9e32-7c68-4799-afb1-db5fb52573f0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:30.137304 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7aba9e32-7c68-4799-afb1-db5fb52573f0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042014 Mar 03 02:40:30.137860 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1032/2050] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:30 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:30.941464 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-bc491191-b68d-4608-b1b8-109a6d1740c0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:30.942207 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-bc491191-b68d-4608-b1b8-109a6d1740c0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:30.949080 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bc491191-b68d-4608-b1b8-109a6d1740c0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:30.949528 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bc491191-b68d-4608-b1b8-109a6d1740c0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:30.950303 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bc491191-b68d-4608-b1b8-109a6d1740c0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:30.950735 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bc491191-b68d-4608-b1b8-109a6d1740c0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:31.009177 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-bc491191-b68d-4608-b1b8-109a6d1740c0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:40:31.016566 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-bc491191-b68d-4608-b1b8-109a6d1740c0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078984 Mar 03 02:40:31.017122 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1019/2051] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:40:30 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:40:31.149435 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-471ffb18-dca1-40e8-9385-ed21fc94491f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:31.150344 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-471ffb18-dca1-40e8-9385-ed21fc94491f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:31.156179 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-471ffb18-dca1-40e8-9385-ed21fc94491f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:31.156626 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-471ffb18-dca1-40e8-9385-ed21fc94491f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:31.157403 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-471ffb18-dca1-40e8-9385-ed21fc94491f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:31.157832 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-471ffb18-dca1-40e8-9385-ed21fc94491f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:31.186647 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-471ffb18-dca1-40e8-9385-ed21fc94491f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041779 Mar 03 02:40:31.187201 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1033/2052] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:31 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:32.032753 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c6ade0a0-c24f-4c1d-845c-5865fa4d0cc1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:32.033354 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c6ade0a0-c24f-4c1d-845c-5865fa4d0cc1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:32.039646 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c6ade0a0-c24f-4c1d-845c-5865fa4d0cc1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:32.040095 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c6ade0a0-c24f-4c1d-845c-5865fa4d0cc1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:32.040861 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c6ade0a0-c24f-4c1d-845c-5865fa4d0cc1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:32.041292 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c6ade0a0-c24f-4c1d-845c-5865fa4d0cc1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:32.099744 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c6ade0a0-c24f-4c1d-845c-5865fa4d0cc1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:40:32.107027 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c6ade0a0-c24f-4c1d-845c-5865fa4d0cc1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078088 Mar 03 02:40:32.107582 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1020/2053] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:40:32 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:40:32.198613 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f7e52505-6f98-48b7-84e1-2ba54fe53289 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:32.199557 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f7e52505-6f98-48b7-84e1-2ba54fe53289 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:32.205796 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f7e52505-6f98-48b7-84e1-2ba54fe53289 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:32.206256 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f7e52505-6f98-48b7-84e1-2ba54fe53289 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:32.207041 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f7e52505-6f98-48b7-84e1-2ba54fe53289 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:32.207501 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f7e52505-6f98-48b7-84e1-2ba54fe53289 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:32.235443 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f7e52505-6f98-48b7-84e1-2ba54fe53289 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041339 Mar 03 02:40:32.236031 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1034/2054] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:32 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:32.323569 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-227a39f4-4d33-4ab2-b6bf-a1c755c3b89d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:32.324174 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-227a39f4-4d33-4ab2-b6bf-a1c755c3b89d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:32.330181 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-227a39f4-4d33-4ab2-b6bf-a1c755c3b89d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:32.330519 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-227a39f4-4d33-4ab2-b6bf-a1c755c3b89d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:32.331294 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-227a39f4-4d33-4ab2-b6bf-a1c755c3b89d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:32.331760 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-227a39f4-4d33-4ab2-b6bf-a1c755c3b89d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:32.380260 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-20a03fcd-354d-4e62-8cae-a6d6d8a14809 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:32.380872 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-20a03fcd-354d-4e62-8cae-a6d6d8a14809 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:32.387914 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-20a03fcd-354d-4e62-8cae-a6d6d8a14809 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:32.388375 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-20a03fcd-354d-4e62-8cae-a6d6d8a14809 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:32.389159 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-20a03fcd-354d-4e62-8cae-a6d6d8a14809 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:32.389597 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-20a03fcd-354d-4e62-8cae-a6d6d8a14809 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:48.675888 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.wsgi [None req-227a39f4-4d33-4ab2-b6bf-a1c755c3b89d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] HTTP exception thrown: Cannot 'detach_volume' instance f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 while it is in task_state spawning Mar 03 02:40:48.676490 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-227a39f4-4d33-4ab2-b6bf-a1c755c3b89d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Returning 409 to user: Cannot 'detach_volume' instance f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 while it is in task_state spawning {{(pid=116858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:40:48.677315 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-227a39f4-4d33-4ab2-b6bf-a1c755c3b89d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments/7a8c1a58-9dac-4710-bc0b-674fd3b89dbc" status: 409 len: 155 microversion: 2.20 time: 16.359023 Mar 03 02:40:48.682251 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1021/2055] 10.222.0.30 () {60 vars in 1456 bytes} [Thu Mar 3 02:40:32 2022] DELETE /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments/7a8c1a58-9dac-4710-bc0b-674fd3b89dbc => generated 155 bytes in 16360 msecs (HTTP/1.1 409) 9 headers in 380 bytes (2 switches on core 0) Mar 03 02:40:48.683027 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4cd48e3f-cf2d-44f5-874e-de9de372f103 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:48.683638 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4cd48e3f-cf2d-44f5-874e-de9de372f103 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:48.689255 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4cd48e3f-cf2d-44f5-874e-de9de372f103 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:48.689699 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4cd48e3f-cf2d-44f5-874e-de9de372f103 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:48.690470 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4cd48e3f-cf2d-44f5-874e-de9de372f103 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:48.690985 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4cd48e3f-cf2d-44f5-874e-de9de372f103 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:48.751439 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4cd48e3f-cf2d-44f5-874e-de9de372f103 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:40:48.759241 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4cd48e3f-cf2d-44f5-874e-de9de372f103 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.080285 Mar 03 02:40:48.773870 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1022/2056] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:40:48 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:40:48.773870 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-94da0e76-cce6-46da-bbfe-9142a210317d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:48.773870 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-94da0e76-cce6-46da-bbfe-9142a210317d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:48.773870 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-94da0e76-cce6-46da-bbfe-9142a210317d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:48.774870 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-94da0e76-cce6-46da-bbfe-9142a210317d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:48.774870 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-94da0e76-cce6-46da-bbfe-9142a210317d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:48.774870 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-94da0e76-cce6-46da-bbfe-9142a210317d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:48.781514 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.objects.instance [None req-20a03fcd-354d-4e62-8cae-a6d6d8a14809 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lazy-loading 'services' on Instance uuid 26ff8756-bd0b-464a-9c28-75b4ee57f99d {{(pid=116859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 03 02:40:48.816901 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-94da0e76-cce6-46da-bbfe-9142a210317d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055655 Mar 03 02:40:48.817463 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1023/2057] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:48 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:48.822701 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8a025ce2-176d-4c66-94c4-a5a91b80956d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:48.823586 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8a025ce2-176d-4c66-94c4-a5a91b80956d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:48.828999 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8a025ce2-176d-4c66-94c4-a5a91b80956d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:48.829450 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8a025ce2-176d-4c66-94c4-a5a91b80956d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:48.830222 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8a025ce2-176d-4c66-94c4-a5a91b80956d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:48.830656 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8a025ce2-176d-4c66-94c4-a5a91b80956d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:48.858329 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8a025ce2-176d-4c66-94c4-a5a91b80956d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039822 Mar 03 02:40:48.859127 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1024/2058] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:48 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:48.865163 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-10d50175-9a69-44eb-a710-48b5968de853 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:48.866595 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-10d50175-9a69-44eb-a710-48b5968de853 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:48.872624 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-10d50175-9a69-44eb-a710-48b5968de853 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:48.873073 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-10d50175-9a69-44eb-a710-48b5968de853 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:48.873853 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-10d50175-9a69-44eb-a710-48b5968de853 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:48.874292 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-10d50175-9a69-44eb-a710-48b5968de853 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:48.904333 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-10d50175-9a69-44eb-a710-48b5968de853 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044390 Mar 03 02:40:48.904883 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1025/2059] 10.222.0.30 () {60 vars in 1342 bytes} [Thu Mar 3 02:40:48 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:40:49.785473 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-56df6425-9018-4f64-81d6-e9fa2bbc1041 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:49.786119 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-56df6425-9018-4f64-81d6-e9fa2bbc1041 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:49.792511 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-56df6425-9018-4f64-81d6-e9fa2bbc1041 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:49.792957 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-56df6425-9018-4f64-81d6-e9fa2bbc1041 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:49.793728 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-56df6425-9018-4f64-81d6-e9fa2bbc1041 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:49.794159 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-56df6425-9018-4f64-81d6-e9fa2bbc1041 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:49.856658 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-56df6425-9018-4f64-81d6-e9fa2bbc1041 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:40:49.863892 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-56df6425-9018-4f64-81d6-e9fa2bbc1041 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.082403 Mar 03 02:40:49.864449 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1026/2060] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:40:49 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:40:49.869798 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d7f278f3-ccd1-453f-a0b4-429c598b7e2d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:49.870685 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d7f278f3-ccd1-453f-a0b4-429c598b7e2d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:49.876318 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d7f278f3-ccd1-453f-a0b4-429c598b7e2d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:49.876760 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d7f278f3-ccd1-453f-a0b4-429c598b7e2d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:49.877575 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d7f278f3-ccd1-453f-a0b4-429c598b7e2d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:49.878009 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d7f278f3-ccd1-453f-a0b4-429c598b7e2d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:49.905676 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d7f278f3-ccd1-453f-a0b4-429c598b7e2d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040248 Mar 03 02:40:49.906213 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1027/2061] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:49 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:49.910599 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-14551ef9-312c-41d8-b7c2-c0611ca06731 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:49.911469 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-14551ef9-312c-41d8-b7c2-c0611ca06731 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:49.917396 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-14551ef9-312c-41d8-b7c2-c0611ca06731 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:49.917841 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-14551ef9-312c-41d8-b7c2-c0611ca06731 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:49.918611 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-14551ef9-312c-41d8-b7c2-c0611ca06731 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:49.919040 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-14551ef9-312c-41d8-b7c2-c0611ca06731 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:49.948070 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-14551ef9-312c-41d8-b7c2-c0611ca06731 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040811 Mar 03 02:40:49.948636 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1028/2062] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:49 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:49.953148 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2fba9e7b-7b69-4460-a47b-f9e7c298bbd8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:49.954032 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2fba9e7b-7b69-4460-a47b-f9e7c298bbd8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:49.959363 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2fba9e7b-7b69-4460-a47b-f9e7c298bbd8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:49.960002 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2fba9e7b-7b69-4460-a47b-f9e7c298bbd8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:49.960780 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2fba9e7b-7b69-4460-a47b-f9e7c298bbd8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:49.961220 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2fba9e7b-7b69-4460-a47b-f9e7c298bbd8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:49.989017 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2fba9e7b-7b69-4460-a47b-f9e7c298bbd8 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039409 Mar 03 02:40:49.989550 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1029/2063] 10.222.0.30 () {60 vars in 1342 bytes} [Thu Mar 3 02:40:49 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:40:50.880341 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b49ef2b7-6d32-4b56-892a-e39101a9c965 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:50.881524 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b49ef2b7-6d32-4b56-892a-e39101a9c965 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:50.887567 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b49ef2b7-6d32-4b56-892a-e39101a9c965 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:50.888042 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b49ef2b7-6d32-4b56-892a-e39101a9c965 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:50.888814 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b49ef2b7-6d32-4b56-892a-e39101a9c965 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:50.889246 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b49ef2b7-6d32-4b56-892a-e39101a9c965 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:50.946834 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b49ef2b7-6d32-4b56-892a-e39101a9c965 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:40:50.954028 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b49ef2b7-6d32-4b56-892a-e39101a9c965 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.077523 Mar 03 02:40:50.954604 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1030/2064] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:40:50 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:40:50.959723 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-10db2b68-bf07-46a6-9e02-44d412ec3ff5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:50.960617 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-10db2b68-bf07-46a6-9e02-44d412ec3ff5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:50.966013 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-10db2b68-bf07-46a6-9e02-44d412ec3ff5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:50.966459 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-10db2b68-bf07-46a6-9e02-44d412ec3ff5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:50.967221 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-10db2b68-bf07-46a6-9e02-44d412ec3ff5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:50.967759 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-10db2b68-bf07-46a6-9e02-44d412ec3ff5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:50.994029 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-10db2b68-bf07-46a6-9e02-44d412ec3ff5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038501 Mar 03 02:40:50.994557 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1031/2065] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:50 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:50.999003 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f651064f-8841-458f-8594-37c5d0060b5f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:50.999906 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f651064f-8841-458f-8594-37c5d0060b5f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:51.005486 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f651064f-8841-458f-8594-37c5d0060b5f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:51.006504 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f651064f-8841-458f-8594-37c5d0060b5f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:51.007274 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f651064f-8841-458f-8594-37c5d0060b5f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:51.007730 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f651064f-8841-458f-8594-37c5d0060b5f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:51.035704 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f651064f-8841-458f-8594-37c5d0060b5f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040162 Mar 03 02:40:51.036246 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1032/2066] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:50 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:51.040792 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5acba944-bb0e-473f-9bd7-a0d5d735bd67 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:51.041644 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5acba944-bb0e-473f-9bd7-a0d5d735bd67 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:51.046770 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5acba944-bb0e-473f-9bd7-a0d5d735bd67 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:51.047218 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5acba944-bb0e-473f-9bd7-a0d5d735bd67 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:51.048037 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5acba944-bb0e-473f-9bd7-a0d5d735bd67 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:51.048469 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5acba944-bb0e-473f-9bd7-a0d5d735bd67 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:51.076911 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5acba944-bb0e-473f-9bd7-a0d5d735bd67 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039676 Mar 03 02:40:51.077473 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1033/2067] 10.222.0.30 () {60 vars in 1342 bytes} [Thu Mar 3 02:40:51 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:40:51.970579 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-508cad20-0573-47ab-b557-6e111e444cf5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:51.971244 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-508cad20-0573-47ab-b557-6e111e444cf5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:51.978323 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-508cad20-0573-47ab-b557-6e111e444cf5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:51.978802 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-508cad20-0573-47ab-b557-6e111e444cf5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:51.979583 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-508cad20-0573-47ab-b557-6e111e444cf5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:51.980046 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-508cad20-0573-47ab-b557-6e111e444cf5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:52.039591 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-508cad20-0573-47ab-b557-6e111e444cf5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:40:52.046943 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-508cad20-0573-47ab-b557-6e111e444cf5 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.080366 Mar 03 02:40:52.047502 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1034/2068] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:40:51 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:40:52.052071 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0110cb5a-93d5-4bda-a4fe-c6c3912d6dcd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:52.053559 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0110cb5a-93d5-4bda-a4fe-c6c3912d6dcd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:52.059385 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0110cb5a-93d5-4bda-a4fe-c6c3912d6dcd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:52.059856 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0110cb5a-93d5-4bda-a4fe-c6c3912d6dcd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:52.060637 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0110cb5a-93d5-4bda-a4fe-c6c3912d6dcd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:52.061073 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0110cb5a-93d5-4bda-a4fe-c6c3912d6dcd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:52.089043 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0110cb5a-93d5-4bda-a4fe-c6c3912d6dcd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040533 Mar 03 02:40:52.089588 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1035/2069] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:52 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:52.093961 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-394d7224-e8a7-42a0-9e02-e3d1288bf74b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:52.094835 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-394d7224-e8a7-42a0-9e02-e3d1288bf74b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:52.100970 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-394d7224-e8a7-42a0-9e02-e3d1288bf74b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:52.101555 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-394d7224-e8a7-42a0-9e02-e3d1288bf74b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:52.102423 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-394d7224-e8a7-42a0-9e02-e3d1288bf74b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:52.102987 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-394d7224-e8a7-42a0-9e02-e3d1288bf74b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:52.129844 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-394d7224-e8a7-42a0-9e02-e3d1288bf74b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039317 Mar 03 02:40:52.130375 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1036/2070] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:52 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:52.194900 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4cd52f54-c685-462d-8a4b-236c5e1a5c2a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:52.195867 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4cd52f54-c685-462d-8a4b-236c5e1a5c2a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:52.201545 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4cd52f54-c685-462d-8a4b-236c5e1a5c2a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:52.202042 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4cd52f54-c685-462d-8a4b-236c5e1a5c2a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:52.202806 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4cd52f54-c685-462d-8a4b-236c5e1a5c2a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:52.203236 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4cd52f54-c685-462d-8a4b-236c5e1a5c2a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:52.231063 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4cd52f54-c685-462d-8a4b-236c5e1a5c2a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.099159 Mar 03 02:40:52.231538 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1037/2071] 10.222.0.30 () {60 vars in 1342 bytes} [Thu Mar 3 02:40:52 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:40:52.644386 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 02:40:52.644922 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: Thu Mar 3 02:40:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d/os-volume_attachments/3ee166b3-4d10-4902-8276-13a90850bf70 (ip 10.222.0.30) !!! Mar 03 02:40:53.063378 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-289ce4f3-c3d7-492f-8063-3d9cf126703c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:53.064029 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-289ce4f3-c3d7-492f-8063-3d9cf126703c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:53.070876 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-289ce4f3-c3d7-492f-8063-3d9cf126703c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:53.071330 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-289ce4f3-c3d7-492f-8063-3d9cf126703c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:53.072141 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-289ce4f3-c3d7-492f-8063-3d9cf126703c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:53.072583 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-289ce4f3-c3d7-492f-8063-3d9cf126703c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:53.131281 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-289ce4f3-c3d7-492f-8063-3d9cf126703c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:40:53.138495 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-289ce4f3-c3d7-492f-8063-3d9cf126703c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078941 Mar 03 02:40:53.139052 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1038/2072] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:40:53 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:40:53.143664 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-bf6819dd-d506-416b-b38a-73dccf518400 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:53.144667 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-bf6819dd-d506-416b-b38a-73dccf518400 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:53.151335 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bf6819dd-d506-416b-b38a-73dccf518400 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:53.151825 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bf6819dd-d506-416b-b38a-73dccf518400 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:53.152617 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bf6819dd-d506-416b-b38a-73dccf518400 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:53.153055 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bf6819dd-d506-416b-b38a-73dccf518400 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:53.180660 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-bf6819dd-d506-416b-b38a-73dccf518400 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040630 Mar 03 02:40:53.181220 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1039/2073] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:53 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:53.185605 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a2165a9a-9e5d-4319-a907-1e46e5d39ec7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:53.186483 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a2165a9a-9e5d-4319-a907-1e46e5d39ec7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:53.191769 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a2165a9a-9e5d-4319-a907-1e46e5d39ec7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:53.192226 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a2165a9a-9e5d-4319-a907-1e46e5d39ec7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:53.192999 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a2165a9a-9e5d-4319-a907-1e46e5d39ec7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:53.194090 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a2165a9a-9e5d-4319-a907-1e46e5d39ec7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:53.221499 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a2165a9a-9e5d-4319-a907-1e46e5d39ec7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039321 Mar 03 02:40:53.222041 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1040/2074] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:53 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:53.242486 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3bacc737-3b9a-4a18-bb5a-f1aa4645caff tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:53.243414 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3bacc737-3b9a-4a18-bb5a-f1aa4645caff tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:53.249212 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3bacc737-3b9a-4a18-bb5a-f1aa4645caff tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:53.249659 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3bacc737-3b9a-4a18-bb5a-f1aa4645caff tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:53.250439 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3bacc737-3b9a-4a18-bb5a-f1aa4645caff tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:53.250873 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3bacc737-3b9a-4a18-bb5a-f1aa4645caff tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:53.279457 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3bacc737-3b9a-4a18-bb5a-f1aa4645caff tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041047 Mar 03 02:40:53.280021 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1041/2075] 10.222.0.30 () {60 vars in 1342 bytes} [Thu Mar 3 02:40:53 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 03 02:40:54.155913 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f9765cff-d7db-4a43-9ceb-6d52223ad8b0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:54.156519 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f9765cff-d7db-4a43-9ceb-6d52223ad8b0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:54.165499 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f9765cff-d7db-4a43-9ceb-6d52223ad8b0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:54.165960 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f9765cff-d7db-4a43-9ceb-6d52223ad8b0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:54.166741 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f9765cff-d7db-4a43-9ceb-6d52223ad8b0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:54.167184 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f9765cff-d7db-4a43-9ceb-6d52223ad8b0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:54.226086 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f9765cff-d7db-4a43-9ceb-6d52223ad8b0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:40:54.233381 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f9765cff-d7db-4a43-9ceb-6d52223ad8b0 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.081404 Mar 03 02:40:54.233941 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1042/2076] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:40:54 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:40:54.238429 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b1f827ac-3986-4339-969b-0bdd8b6c1596 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:54.239321 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b1f827ac-3986-4339-969b-0bdd8b6c1596 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:54.245035 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b1f827ac-3986-4339-969b-0bdd8b6c1596 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:54.245490 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b1f827ac-3986-4339-969b-0bdd8b6c1596 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:54.246269 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b1f827ac-3986-4339-969b-0bdd8b6c1596 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:54.246710 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b1f827ac-3986-4339-969b-0bdd8b6c1596 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:54.273807 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b1f827ac-3986-4339-969b-0bdd8b6c1596 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038894 Mar 03 02:40:54.274345 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1043/2077] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:54 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:54.278698 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-33e8a3a3-2c9b-4fb6-948c-953036af240f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:54.279556 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-33e8a3a3-2c9b-4fb6-948c-953036af240f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:54.284774 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-33e8a3a3-2c9b-4fb6-948c-953036af240f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:54.285228 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-33e8a3a3-2c9b-4fb6-948c-953036af240f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:54.286001 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-33e8a3a3-2c9b-4fb6-948c-953036af240f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:54.286446 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-33e8a3a3-2c9b-4fb6-948c-953036af240f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:54.315555 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-33e8a3a3-2c9b-4fb6-948c-953036af240f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040185 Mar 03 02:40:54.316061 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1044/2078] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:54 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:54.320536 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0a073562-c94d-404c-915f-56491185c130 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:54.321394 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0a073562-c94d-404c-915f-56491185c130 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:54.326642 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0a073562-c94d-404c-915f-56491185c130 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:54.327095 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0a073562-c94d-404c-915f-56491185c130 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:54.327891 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0a073562-c94d-404c-915f-56491185c130 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:54.328334 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0a073562-c94d-404c-915f-56491185c130 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:54.356557 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0a073562-c94d-404c-915f-56491185c130 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039553 Mar 03 02:40:54.357102 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1045/2079] 10.222.0.30 () {60 vars in 1342 bytes} [Thu Mar 3 02:40:54 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:40:55.250486 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-be1ade41-54b2-42f3-8f2f-d07b31bf350c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:55.251174 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-be1ade41-54b2-42f3-8f2f-d07b31bf350c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:55.258401 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-be1ade41-54b2-42f3-8f2f-d07b31bf350c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:55.258847 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-be1ade41-54b2-42f3-8f2f-d07b31bf350c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:55.259658 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-be1ade41-54b2-42f3-8f2f-d07b31bf350c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:55.260099 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-be1ade41-54b2-42f3-8f2f-d07b31bf350c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:55.316818 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-be1ade41-54b2-42f3-8f2f-d07b31bf350c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:40:55.324682 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-be1ade41-54b2-42f3-8f2f-d07b31bf350c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078309 Mar 03 02:40:55.325247 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1046/2080] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:40:55 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:40:55.329725 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-bef6eba7-4e22-4cd4-aadf-94d9116d77f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:55.330615 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-bef6eba7-4e22-4cd4-aadf-94d9116d77f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:55.336927 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bef6eba7-4e22-4cd4-aadf-94d9116d77f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:55.337384 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bef6eba7-4e22-4cd4-aadf-94d9116d77f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:55.338173 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bef6eba7-4e22-4cd4-aadf-94d9116d77f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:55.338614 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bef6eba7-4e22-4cd4-aadf-94d9116d77f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:55.365765 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-bef6eba7-4e22-4cd4-aadf-94d9116d77f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039445 Mar 03 02:40:55.366316 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1047/2081] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:55 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:55.371151 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a944f763-8b13-4da3-ac53-1f681a27734e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:55.372109 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a944f763-8b13-4da3-ac53-1f681a27734e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:55.377446 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a944f763-8b13-4da3-ac53-1f681a27734e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:55.377903 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a944f763-8b13-4da3-ac53-1f681a27734e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:55.378676 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a944f763-8b13-4da3-ac53-1f681a27734e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:55.379121 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a944f763-8b13-4da3-ac53-1f681a27734e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:55.406982 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a944f763-8b13-4da3-ac53-1f681a27734e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039622 Mar 03 02:40:55.407521 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1048/2082] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:55 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:55.412202 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-111772e2-bc88-4f51-8bf0-860bb8cc4f4a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:55.413061 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-111772e2-bc88-4f51-8bf0-860bb8cc4f4a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:55.418307 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-111772e2-bc88-4f51-8bf0-860bb8cc4f4a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:55.418761 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-111772e2-bc88-4f51-8bf0-860bb8cc4f4a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:55.419530 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-111772e2-bc88-4f51-8bf0-860bb8cc4f4a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:55.419996 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-111772e2-bc88-4f51-8bf0-860bb8cc4f4a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:55.447120 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-111772e2-bc88-4f51-8bf0-860bb8cc4f4a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.038601 Mar 03 02:40:55.447680 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1049/2083] 10.222.0.30 () {60 vars in 1342 bytes} [Thu Mar 3 02:40:55 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:40:56.341032 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-06a05b15-3125-431e-8f30-a93c358dfa07 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:56.341661 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-06a05b15-3125-431e-8f30-a93c358dfa07 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:56.347969 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-06a05b15-3125-431e-8f30-a93c358dfa07 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:56.348418 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-06a05b15-3125-431e-8f30-a93c358dfa07 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:56.349195 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-06a05b15-3125-431e-8f30-a93c358dfa07 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:56.350351 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-06a05b15-3125-431e-8f30-a93c358dfa07 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:56.411520 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-06a05b15-3125-431e-8f30-a93c358dfa07 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:40:56.419523 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-06a05b15-3125-431e-8f30-a93c358dfa07 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.082321 Mar 03 02:40:56.420112 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1050/2084] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:40:56 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:40:56.424709 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-59ba9f20-f850-42a2-bfcf-c1854acb18db tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:56.425605 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-59ba9f20-f850-42a2-bfcf-c1854acb18db tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:56.431719 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-59ba9f20-f850-42a2-bfcf-c1854acb18db tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:56.432180 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-59ba9f20-f850-42a2-bfcf-c1854acb18db tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:56.432958 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-59ba9f20-f850-42a2-bfcf-c1854acb18db tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:56.433397 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-59ba9f20-f850-42a2-bfcf-c1854acb18db tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:56.461118 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-59ba9f20-f850-42a2-bfcf-c1854acb18db tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039892 Mar 03 02:40:56.461663 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1051/2085] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:56 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:56.466007 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a8bf376f-1d0d-479b-99d6-0dec17379ffd tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:56.466877 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a8bf376f-1d0d-479b-99d6-0dec17379ffd tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:56.472077 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a8bf376f-1d0d-479b-99d6-0dec17379ffd tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:56.472531 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a8bf376f-1d0d-479b-99d6-0dec17379ffd tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:56.473308 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a8bf376f-1d0d-479b-99d6-0dec17379ffd tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:56.473752 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a8bf376f-1d0d-479b-99d6-0dec17379ffd tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:56.501495 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a8bf376f-1d0d-479b-99d6-0dec17379ffd tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038896 Mar 03 02:40:56.502038 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1052/2086] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:56 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:56.506751 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c93e5234-f305-478b-bd1c-fd2acc4d26a1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:56.507635 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c93e5234-f305-478b-bd1c-fd2acc4d26a1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:56.512742 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c93e5234-f305-478b-bd1c-fd2acc4d26a1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:56.513194 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c93e5234-f305-478b-bd1c-fd2acc4d26a1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:56.513963 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c93e5234-f305-478b-bd1c-fd2acc4d26a1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:56.514403 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c93e5234-f305-478b-bd1c-fd2acc4d26a1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:56.542226 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c93e5234-f305-478b-bd1c-fd2acc4d26a1 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039253 Mar 03 02:40:56.542770 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1053/2087] 10.222.0.30 () {60 vars in 1342 bytes} [Thu Mar 3 02:40:56 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:40:57.435323 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d31b350d-6bb2-4efb-b673-b3cb1a82781b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:57.436005 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d31b350d-6bb2-4efb-b673-b3cb1a82781b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:57.442530 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d31b350d-6bb2-4efb-b673-b3cb1a82781b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:57.442990 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d31b350d-6bb2-4efb-b673-b3cb1a82781b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:57.443913 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d31b350d-6bb2-4efb-b673-b3cb1a82781b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:57.444359 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d31b350d-6bb2-4efb-b673-b3cb1a82781b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:57.502773 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d31b350d-6bb2-4efb-b673-b3cb1a82781b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:40:57.510559 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d31b350d-6bb2-4efb-b673-b3cb1a82781b tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.079098 Mar 03 02:40:57.511122 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1054/2088] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:40:57 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:40:57.515575 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4e083681-d89d-4162-bde7-65ed234da2d0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:57.516491 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4e083681-d89d-4162-bde7-65ed234da2d0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:57.521858 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4e083681-d89d-4162-bde7-65ed234da2d0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:57.522314 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4e083681-d89d-4162-bde7-65ed234da2d0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:57.523090 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4e083681-d89d-4162-bde7-65ed234da2d0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:57.523529 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4e083681-d89d-4162-bde7-65ed234da2d0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:57.550630 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4e083681-d89d-4162-bde7-65ed234da2d0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038506 Mar 03 02:40:57.551495 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1055/2089] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:57 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:57.556743 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-05d45d6c-6a0d-40e8-8198-81c4c6cc6cc0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:57.557642 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-05d45d6c-6a0d-40e8-8198-81c4c6cc6cc0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:57.563237 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-05d45d6c-6a0d-40e8-8198-81c4c6cc6cc0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:57.563718 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-05d45d6c-6a0d-40e8-8198-81c4c6cc6cc0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:57.564495 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-05d45d6c-6a0d-40e8-8198-81c4c6cc6cc0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:57.564934 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-05d45d6c-6a0d-40e8-8198-81c4c6cc6cc0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:57.592675 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-05d45d6c-6a0d-40e8-8198-81c4c6cc6cc0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040211 Mar 03 02:40:57.593214 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1056/2090] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:57 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:57.597546 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-81d02bda-7b80-4b85-b4b2-a25164c210d5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:57.598400 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-81d02bda-7b80-4b85-b4b2-a25164c210d5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:57.604536 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-81d02bda-7b80-4b85-b4b2-a25164c210d5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:57.604986 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-81d02bda-7b80-4b85-b4b2-a25164c210d5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:57.605790 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-81d02bda-7b80-4b85-b4b2-a25164c210d5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:57.606231 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-81d02bda-7b80-4b85-b4b2-a25164c210d5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:57.633937 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-81d02bda-7b80-4b85-b4b2-a25164c210d5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039786 Mar 03 02:40:57.634477 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1057/2091] 10.222.0.30 () {60 vars in 1342 bytes} [Thu Mar 3 02:40:57 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:40:58.527153 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-fda9b7e8-c2c3-4940-bec3-4a11ab4acbd2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:58.527810 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-fda9b7e8-c2c3-4940-bec3-4a11ab4acbd2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:58.534044 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fda9b7e8-c2c3-4940-bec3-4a11ab4acbd2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:58.534492 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fda9b7e8-c2c3-4940-bec3-4a11ab4acbd2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:58.535267 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fda9b7e8-c2c3-4940-bec3-4a11ab4acbd2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:58.535737 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fda9b7e8-c2c3-4940-bec3-4a11ab4acbd2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:58.593686 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-fda9b7e8-c2c3-4940-bec3-4a11ab4acbd2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:40:58.601024 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-fda9b7e8-c2c3-4940-bec3-4a11ab4acbd2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.077743 Mar 03 02:40:58.601584 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1058/2092] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:40:58 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:40:58.606073 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0ae1ed81-f0fb-42a9-a45b-70924fc4177c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:58.606968 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0ae1ed81-f0fb-42a9-a45b-70924fc4177c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:58.612748 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0ae1ed81-f0fb-42a9-a45b-70924fc4177c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:58.613193 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0ae1ed81-f0fb-42a9-a45b-70924fc4177c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:58.613965 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0ae1ed81-f0fb-42a9-a45b-70924fc4177c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:58.614400 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0ae1ed81-f0fb-42a9-a45b-70924fc4177c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:58.642526 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0ae1ed81-f0fb-42a9-a45b-70924fc4177c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039963 Mar 03 02:40:58.643069 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1059/2093] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:58 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:58.647560 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3768ebd6-f3d0-4518-9fd2-ecbaba5795bc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:58.648458 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3768ebd6-f3d0-4518-9fd2-ecbaba5795bc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:58.653724 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3768ebd6-f3d0-4518-9fd2-ecbaba5795bc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:58.654171 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3768ebd6-f3d0-4518-9fd2-ecbaba5795bc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:58.654936 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3768ebd6-f3d0-4518-9fd2-ecbaba5795bc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:58.655366 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3768ebd6-f3d0-4518-9fd2-ecbaba5795bc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:58.682164 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3768ebd6-f3d0-4518-9fd2-ecbaba5795bc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038157 Mar 03 02:40:58.682683 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1060/2094] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:58 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments => generated 197 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:58.687128 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1c5489c6-60e5-4128-8b00-2d86312e72c7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:58.688014 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1c5489c6-60e5-4128-8b00-2d86312e72c7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:58.693768 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1c5489c6-60e5-4128-8b00-2d86312e72c7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:58.694426 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1c5489c6-60e5-4128-8b00-2d86312e72c7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:58.695188 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1c5489c6-60e5-4128-8b00-2d86312e72c7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:58.695644 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1c5489c6-60e5-4128-8b00-2d86312e72c7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:58.721946 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1c5489c6-60e5-4128-8b00-2d86312e72c7 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.038340 Mar 03 02:40:58.722484 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1061/2095] 10.222.0.30 () {60 vars in 1342 bytes} [Thu Mar 3 02:40:58 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments => generated 197 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:40:59.617643 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-61ae162d-9da6-4a42-98ba-58cdf2a00fa1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:59.618241 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-61ae162d-9da6-4a42-98ba-58cdf2a00fa1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:59.624521 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-61ae162d-9da6-4a42-98ba-58cdf2a00fa1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:59.624996 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-61ae162d-9da6-4a42-98ba-58cdf2a00fa1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:59.625766 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-61ae162d-9da6-4a42-98ba-58cdf2a00fa1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:59.626201 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-61ae162d-9da6-4a42-98ba-58cdf2a00fa1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:59.685529 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-61ae162d-9da6-4a42-98ba-58cdf2a00fa1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:40:59.692853 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-61ae162d-9da6-4a42-98ba-58cdf2a00fa1 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.079393 Mar 03 02:40:59.693978 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1062/2096] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:40:59 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:40:59.698565 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c3a3c8ef-2189-45b9-bfa9-63b3702b8932 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:59.699450 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c3a3c8ef-2189-45b9-bfa9-63b3702b8932 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:59.704853 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c3a3c8ef-2189-45b9-bfa9-63b3702b8932 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:59.705303 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c3a3c8ef-2189-45b9-bfa9-63b3702b8932 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:59.706075 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c3a3c8ef-2189-45b9-bfa9-63b3702b8932 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:59.706512 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c3a3c8ef-2189-45b9-bfa9-63b3702b8932 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:59.735820 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c3a3c8ef-2189-45b9-bfa9-63b3702b8932 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040717 Mar 03 02:40:59.736400 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1063/2097] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:59 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:59.741686 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f752d586-c369-4036-a952-5703867a57d5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:59.742853 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f752d586-c369-4036-a952-5703867a57d5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:59.748947 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f752d586-c369-4036-a952-5703867a57d5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:59.749340 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f752d586-c369-4036-a952-5703867a57d5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:59.750140 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f752d586-c369-4036-a952-5703867a57d5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:59.750568 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f752d586-c369-4036-a952-5703867a57d5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:59.783676 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f752d586-c369-4036-a952-5703867a57d5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046221 Mar 03 02:40:59.784609 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1064/2098] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:40:59 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:40:59.789355 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2bb5c980-c5af-420b-a948-1f1805101e7b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:40:59.790240 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2bb5c980-c5af-420b-a948-1f1805101e7b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:40:59.795897 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2bb5c980-c5af-420b-a948-1f1805101e7b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:59.797072 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2bb5c980-c5af-420b-a948-1f1805101e7b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:59.797988 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2bb5c980-c5af-420b-a948-1f1805101e7b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:40:59.798465 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2bb5c980-c5af-420b-a948-1f1805101e7b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:40:59.827587 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2bb5c980-c5af-420b-a948-1f1805101e7b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041837 Mar 03 02:40:59.828174 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1065/2099] 10.222.0.30 () {60 vars in 1342 bytes} [Thu Mar 3 02:40:59 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:41:00.709836 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-283d7872-1cb7-472c-8432-8d54fe90d38c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:41:00.710525 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-283d7872-1cb7-472c-8432-8d54fe90d38c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:41:00.716628 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-283d7872-1cb7-472c-8432-8d54fe90d38c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:41:00.717077 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-283d7872-1cb7-472c-8432-8d54fe90d38c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:41:00.717852 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-283d7872-1cb7-472c-8432-8d54fe90d38c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:41:00.718292 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-283d7872-1cb7-472c-8432-8d54fe90d38c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:41:00.778190 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-283d7872-1cb7-472c-8432-8d54fe90d38c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:41:00.785391 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-283d7872-1cb7-472c-8432-8d54fe90d38c tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.079484 Mar 03 02:41:00.785939 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1066/2100] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:41:00 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:41:00.791322 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-612855f2-3fda-41b2-8fa5-5d31bc4022d8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:41:00.792241 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-612855f2-3fda-41b2-8fa5-5d31bc4022d8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:41:00.797693 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-612855f2-3fda-41b2-8fa5-5d31bc4022d8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:41:00.798137 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-612855f2-3fda-41b2-8fa5-5d31bc4022d8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:41:00.798909 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-612855f2-3fda-41b2-8fa5-5d31bc4022d8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:41:00.799338 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-612855f2-3fda-41b2-8fa5-5d31bc4022d8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:41:00.826335 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-612855f2-3fda-41b2-8fa5-5d31bc4022d8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039333 Mar 03 02:41:00.826887 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1067/2101] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:41:00 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:41:00.831379 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6de7b6af-5e4c-4eb0-80cd-9808e69d8571 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:41:00.832327 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6de7b6af-5e4c-4eb0-80cd-9808e69d8571 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:41:00.838328 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6de7b6af-5e4c-4eb0-80cd-9808e69d8571 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:41:00.838773 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6de7b6af-5e4c-4eb0-80cd-9808e69d8571 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:41:00.839532 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6de7b6af-5e4c-4eb0-80cd-9808e69d8571 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:41:00.839993 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6de7b6af-5e4c-4eb0-80cd-9808e69d8571 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:41:00.867966 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6de7b6af-5e4c-4eb0-80cd-9808e69d8571 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040096 Mar 03 02:41:00.868500 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1068/2102] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:41:00 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:41:00.872958 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1c920810-3305-4746-92e4-c6f04517b168 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:41:00.873811 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1c920810-3305-4746-92e4-c6f04517b168 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:41:00.878946 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1c920810-3305-4746-92e4-c6f04517b168 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:41:00.879390 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1c920810-3305-4746-92e4-c6f04517b168 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:41:00.880180 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1c920810-3305-4746-92e4-c6f04517b168 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:41:00.880651 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1c920810-3305-4746-92e4-c6f04517b168 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:41:00.907648 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1c920810-3305-4746-92e4-c6f04517b168 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.038189 Mar 03 02:41:00.908181 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1069/2103] 10.222.0.30 () {60 vars in 1342 bytes} [Thu Mar 3 02:41:00 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments => generated 197 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:41:01.803248 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-389b478d-7450-40fc-8780-23cb96b0f5b2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:41:01.803902 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-389b478d-7450-40fc-8780-23cb96b0f5b2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:41:01.810293 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-389b478d-7450-40fc-8780-23cb96b0f5b2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:41:01.810736 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-389b478d-7450-40fc-8780-23cb96b0f5b2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:41:01.811501 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-389b478d-7450-40fc-8780-23cb96b0f5b2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:41:01.811957 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-389b478d-7450-40fc-8780-23cb96b0f5b2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:41:01.870013 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-389b478d-7450-40fc-8780-23cb96b0f5b2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:41:01.877387 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-389b478d-7450-40fc-8780-23cb96b0f5b2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078139 Mar 03 02:41:01.877962 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1070/2104] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:41:01 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:41:01.883903 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3cf71d6b-51c1-4367-a3d1-9659a05f304b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:41:01.884802 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3cf71d6b-51c1-4367-a3d1-9659a05f304b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:41:01.890492 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3cf71d6b-51c1-4367-a3d1-9659a05f304b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:41:01.890932 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3cf71d6b-51c1-4367-a3d1-9659a05f304b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:41:01.891725 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3cf71d6b-51c1-4367-a3d1-9659a05f304b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:41:01.892160 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3cf71d6b-51c1-4367-a3d1-9659a05f304b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:41:01.919971 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3cf71d6b-51c1-4367-a3d1-9659a05f304b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040988 Mar 03 02:41:01.920526 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1071/2105] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:41:01 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:41:01.924909 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8aa3dcc5-40ea-43cb-bebd-85243fbffc57 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:41:01.925812 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8aa3dcc5-40ea-43cb-bebd-85243fbffc57 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:41:01.931736 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8aa3dcc5-40ea-43cb-bebd-85243fbffc57 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:41:01.932184 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8aa3dcc5-40ea-43cb-bebd-85243fbffc57 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:41:01.932998 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8aa3dcc5-40ea-43cb-bebd-85243fbffc57 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:41:01.933458 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8aa3dcc5-40ea-43cb-bebd-85243fbffc57 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:41:01.961808 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8aa3dcc5-40ea-43cb-bebd-85243fbffc57 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040314 Mar 03 02:41:01.962350 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1072/2106] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:41:01 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:41:01.966878 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b5ff7ace-9460-425b-b1fc-8d88949c1d1d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:41:01.967774 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b5ff7ace-9460-425b-b1fc-8d88949c1d1d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:41:01.972892 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b5ff7ace-9460-425b-b1fc-8d88949c1d1d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:41:01.973334 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b5ff7ace-9460-425b-b1fc-8d88949c1d1d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:41:01.974289 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b5ff7ace-9460-425b-b1fc-8d88949c1d1d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:41:01.974922 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b5ff7ace-9460-425b-b1fc-8d88949c1d1d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:41:02.002051 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b5ff7ace-9460-425b-b1fc-8d88949c1d1d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.038689 Mar 03 02:41:02.002595 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1073/2107] 10.222.0.30 () {60 vars in 1342 bytes} [Thu Mar 3 02:41:01 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:41:02.896563 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-801e69e7-4a27-4816-9638-29528c903db9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:41:02.897233 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-801e69e7-4a27-4816-9638-29528c903db9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:41:02.903256 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-801e69e7-4a27-4816-9638-29528c903db9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:41:02.903733 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-801e69e7-4a27-4816-9638-29528c903db9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:41:02.904501 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-801e69e7-4a27-4816-9638-29528c903db9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:41:02.904932 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-801e69e7-4a27-4816-9638-29528c903db9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:41:02.968167 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-801e69e7-4a27-4816-9638-29528c903db9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:41:02.975941 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-801e69e7-4a27-4816-9638-29528c903db9 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.083393 Mar 03 02:41:02.976513 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1074/2108] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:41:02 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:41:02.980931 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-727a48c9-83eb-4b1b-9914-365bf7fd55d6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:41:02.981814 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-727a48c9-83eb-4b1b-9914-365bf7fd55d6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:41:02.987054 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-727a48c9-83eb-4b1b-9914-365bf7fd55d6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:41:02.987505 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-727a48c9-83eb-4b1b-9914-365bf7fd55d6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:41:02.988296 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-727a48c9-83eb-4b1b-9914-365bf7fd55d6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:41:02.988731 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-727a48c9-83eb-4b1b-9914-365bf7fd55d6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:41:03.016997 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-727a48c9-83eb-4b1b-9914-365bf7fd55d6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039481 Mar 03 02:41:03.017542 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1075/2109] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:41:02 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:41:03.022438 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-14f1ec62-59c5-4663-871d-25ff46316963 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:41:03.023308 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-14f1ec62-59c5-4663-871d-25ff46316963 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:41:03.028630 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-14f1ec62-59c5-4663-871d-25ff46316963 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:41:03.029076 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-14f1ec62-59c5-4663-871d-25ff46316963 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:41:03.029839 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-14f1ec62-59c5-4663-871d-25ff46316963 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:41:03.030274 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-14f1ec62-59c5-4663-871d-25ff46316963 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:41:03.059343 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-14f1ec62-59c5-4663-871d-25ff46316963 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040819 Mar 03 02:41:03.059936 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1076/2110] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:41:03 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:41:03.064333 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1093512c-bb76-4f1e-b2c0-1a8e5a661d4a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:41:03.065190 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1093512c-bb76-4f1e-b2c0-1a8e5a661d4a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:41:03.070398 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1093512c-bb76-4f1e-b2c0-1a8e5a661d4a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:41:03.070847 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1093512c-bb76-4f1e-b2c0-1a8e5a661d4a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:41:03.071628 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1093512c-bb76-4f1e-b2c0-1a8e5a661d4a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:41:03.072055 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1093512c-bb76-4f1e-b2c0-1a8e5a661d4a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:41:03.098984 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1093512c-bb76-4f1e-b2c0-1a8e5a661d4a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.038098 Mar 03 02:41:03.100213 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1077/2111] 10.222.0.30 () {60 vars in 1342 bytes} [Thu Mar 3 02:41:03 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:41:03.993100 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7d52eb6e-03d5-4819-9e91-7e41ba702d17 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:41:03.993830 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7d52eb6e-03d5-4819-9e91-7e41ba702d17 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:41:04.000035 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7d52eb6e-03d5-4819-9e91-7e41ba702d17 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:41:04.000486 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7d52eb6e-03d5-4819-9e91-7e41ba702d17 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:41:04.001262 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7d52eb6e-03d5-4819-9e91-7e41ba702d17 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:41:04.001723 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7d52eb6e-03d5-4819-9e91-7e41ba702d17 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:41:04.060587 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-7d52eb6e-03d5-4819-9e91-7e41ba702d17 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:41:04.068082 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7d52eb6e-03d5-4819-9e91-7e41ba702d17 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.078963 Mar 03 02:41:04.068657 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1078/2112] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:41:03 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:41:04.073117 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-492ea03e-0e52-4cce-b980-98c78842b207 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:41:04.074008 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-492ea03e-0e52-4cce-b980-98c78842b207 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:41:04.079465 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-492ea03e-0e52-4cce-b980-98c78842b207 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:41:04.079951 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-492ea03e-0e52-4cce-b980-98c78842b207 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:41:04.080732 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-492ea03e-0e52-4cce-b980-98c78842b207 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:41:04.081183 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-492ea03e-0e52-4cce-b980-98c78842b207 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:41:04.162227 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-492ea03e-0e52-4cce-b980-98c78842b207 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "POST /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/action" status: 200 len: 82686 microversion: 2.1 time: 0.092215 Mar 03 02:41:04.162870 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1079/2113] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Mar 3 02:41:04 2022] POST /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/action => generated 82686 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:41:04.167875 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6a5b8585-fc77-417a-942f-3fd08bfa0210 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:41:04.168857 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6a5b8585-fc77-417a-942f-3fd08bfa0210 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:41:04.175464 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6a5b8585-fc77-417a-942f-3fd08bfa0210 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:41:04.175955 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6a5b8585-fc77-417a-942f-3fd08bfa0210 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:41:04.176729 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6a5b8585-fc77-417a-942f-3fd08bfa0210 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:41:04.177173 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6a5b8585-fc77-417a-942f-3fd08bfa0210 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:41:04.206093 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6a5b8585-fc77-417a-942f-3fd08bfa0210 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042123 Mar 03 02:41:04.206628 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1080/2114] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:41:04 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:41:04.211942 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-eb11481a-82cf-490e-a7e7-39f1a9400deb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:41:04.212797 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-eb11481a-82cf-490e-a7e7-39f1a9400deb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:41:04.218305 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-eb11481a-82cf-490e-a7e7-39f1a9400deb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:41:04.218746 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-eb11481a-82cf-490e-a7e7-39f1a9400deb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:41:04.219504 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-eb11481a-82cf-490e-a7e7-39f1a9400deb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:41:04.219958 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-eb11481a-82cf-490e-a7e7-39f1a9400deb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:41:04.247074 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-eb11481a-82cf-490e-a7e7-39f1a9400deb tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039438 Mar 03 02:41:04.247535 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1081/2115] 10.222.0.30 () {60 vars in 1342 bytes} [Thu Mar 3 02:41:04 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:41:04.251876 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2935c784-a9b1-4e5c-b011-b1c0db25ecfe tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:41:04.252350 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2935c784-a9b1-4e5c-b011-b1c0db25ecfe tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:41:04.258365 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2935c784-a9b1-4e5c-b011-b1c0db25ecfe tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:41:04.258808 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2935c784-a9b1-4e5c-b011-b1c0db25ecfe tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:41:04.259563 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2935c784-a9b1-4e5c-b011-b1c0db25ecfe tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:41:04.260019 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2935c784-a9b1-4e5c-b011-b1c0db25ecfe tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:42:22.964708 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 02:42:22.965429 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: Thu Mar 3 02:42:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments/f2e36cca-2705-4b40-8b08-2a93f505f2f6 (ip 10.222.0.30) !!! Mar 03 02:42:24.140819 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 02:42:24.141277 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: Thu Mar 3 02:42:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d/os-volume_attachments/3ee166b3-4d10-4902-8276-13a90850bf70 (ip 10.222.0.30) !!! Mar 03 02:42:32.488110 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-20a03fcd-354d-4e62-8cae-a6d6d8a14809 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "DELETE /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d/os-volume_attachments/3ee166b3-4d10-4902-8276-13a90850bf70" status: 202 len: 0 microversion: 2.1 time: 120.111517 Mar 03 02:42:32.489075 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1035/2116] 10.222.0.30 () {58 vars in 1415 bytes} [Thu Mar 3 02:40:32 2022] DELETE /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d/os-volume_attachments/3ee166b3-4d10-4902-8276-13a90850bf70 => generated 0 bytes in 120113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 03 02:42:32.566279 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-94ca8de1-b140-4daf-adfb-a54b2e4c52d8 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:42:32.566976 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-94ca8de1-b140-4daf-adfb-a54b2e4c52d8 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:42:32.573863 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-94ca8de1-b140-4daf-adfb-a54b2e4c52d8 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:42:32.574319 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-94ca8de1-b140-4daf-adfb-a54b2e4c52d8 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:42:32.575109 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-94ca8de1-b140-4daf-adfb-a54b2e4c52d8 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:42:32.575543 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-94ca8de1-b140-4daf-adfb-a54b2e4c52d8 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:42:32.637822 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-94ca8de1-b140-4daf-adfb-a54b2e4c52d8 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:42:32.645124 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-94ca8de1-b140-4daf-adfb-a54b2e4c52d8 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.154968 Mar 03 02:42:32.645687 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1036/2117] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:42:32 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:42:32.717786 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c40ca2e1-e0cd-4145-814f-1646cca8f349 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:42:32.718828 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c40ca2e1-e0cd-4145-814f-1646cca8f349 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:42:32.725357 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c40ca2e1-e0cd-4145-814f-1646cca8f349 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:42:32.726035 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c40ca2e1-e0cd-4145-814f-1646cca8f349 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:42:32.726916 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c40ca2e1-e0cd-4145-814f-1646cca8f349 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:42:32.727421 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c40ca2e1-e0cd-4145-814f-1646cca8f349 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:42:32.756937 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c40ca2e1-e0cd-4145-814f-1646cca8f349 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109470 Mar 03 02:42:32.757649 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1037/2118] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:42:32 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:42:32.762165 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-101d22f8-cd91-40e7-b4d1-3bdbc265959d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:42:32.763057 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-101d22f8-cd91-40e7-b4d1-3bdbc265959d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:42:32.769095 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-101d22f8-cd91-40e7-b4d1-3bdbc265959d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:42:32.769507 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.objects.instance [None req-2935c784-a9b1-4e5c-b011-b1c0db25ecfe tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lazy-loading 'services' on Instance uuid 0df5e3af-dfd2-431d-83af-1a2a02019651 {{(pid=116858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 03 02:42:32.769970 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-101d22f8-cd91-40e7-b4d1-3bdbc265959d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:42:32.770521 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-101d22f8-cd91-40e7-b4d1-3bdbc265959d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:42:32.771031 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-101d22f8-cd91-40e7-b4d1-3bdbc265959d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:42:32.802231 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-101d22f8-cd91-40e7-b4d1-3bdbc265959d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043538 Mar 03 02:42:32.802980 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1038/2119] 10.222.0.30 () {60 vars in 1342 bytes} [Thu Mar 3 02:42:32 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:42:32.807985 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a0fa6410-acd4-4bd6-9361-6aaab5ac25fc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:42:32.808463 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a0fa6410-acd4-4bd6-9361-6aaab5ac25fc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:42:32.814050 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a0fa6410-acd4-4bd6-9361-6aaab5ac25fc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:42:32.814496 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a0fa6410-acd4-4bd6-9361-6aaab5ac25fc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:42:32.815265 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a0fa6410-acd4-4bd6-9361-6aaab5ac25fc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:42:32.815723 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a0fa6410-acd4-4bd6-9361-6aaab5ac25fc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:42:34.072019 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 02:42:34.072436 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: Thu Mar 3 02:42:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments/f2e36cca-2705-4b40-8b08-2a93f505f2f6 (ip 10.222.0.30) !!! Mar 03 02:42:48.993704 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.wsgi [None req-2935c784-a9b1-4e5c-b011-b1c0db25ecfe tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2b058349-cf8b-444a-a930-a23835a88f19) Mar 03 02:42:48.994302 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2935c784-a9b1-4e5c-b011-b1c0db25ecfe tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2b058349-cf8b-444a-a930-a23835a88f19) {{(pid=116858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:42:48.995165 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2935c784-a9b1-4e5c-b011-b1c0db25ecfe tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments/f2e36cca-2705-4b40-8b08-2a93f505f2f6" status: 400 len: 269 microversion: 2.1 time: 104.746733 Mar 03 02:42:48.995752 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1082/2120] 10.222.0.30 () {58 vars in 1415 bytes} [Thu Mar 3 02:41:04 2022] DELETE /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments/f2e36cca-2705-4b40-8b08-2a93f505f2f6 => generated 269 bytes in 104748 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 03 02:42:49.001767 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-80eb7cd5-eddb-4df1-a51a-a3aab4ed70ea tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:42:49.002256 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-80eb7cd5-eddb-4df1-a51a-a3aab4ed70ea tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:42:49.008998 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-80eb7cd5-eddb-4df1-a51a-a3aab4ed70ea tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:42:49.009448 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-80eb7cd5-eddb-4df1-a51a-a3aab4ed70ea tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:42:49.010226 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-80eb7cd5-eddb-4df1-a51a-a3aab4ed70ea tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:42:49.010664 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-80eb7cd5-eddb-4df1-a51a-a3aab4ed70ea tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:42:49.042670 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.objects.instance [None req-a0fa6410-acd4-4bd6-9361-6aaab5ac25fc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lazy-loading 'services' on Instance uuid 26ff8756-bd0b-464a-9c28-75b4ee57f99d {{(pid=116859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 03 02:44:12.653491 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 02:44:12.654183 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: Thu Mar 3 02:44:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d/os-volume_attachments/3ee166b3-4d10-4902-8276-13a90850bf70 (ip 10.222.0.30) !!! Mar 03 02:44:20.533866 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 02:44:20.534484 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: Thu Mar 3 02:44:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments/f2e36cca-2705-4b40-8b08-2a93f505f2f6 (ip 10.222.0.30) !!! Mar 03 02:44:33.020959 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.objects.instance [None req-80eb7cd5-eddb-4df1-a51a-a3aab4ed70ea tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lazy-loading 'services' on Instance uuid 0df5e3af-dfd2-431d-83af-1a2a02019651 {{(pid=116858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 03 02:44:33.048182 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.wsgi [None req-a0fa6410-acd4-4bd6-9361-6aaab5ac25fc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-941da69a-39c8-4af3-932b-48e7ca7673db) Mar 03 02:44:33.048809 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a0fa6410-acd4-4bd6-9361-6aaab5ac25fc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-941da69a-39c8-4af3-932b-48e7ca7673db) {{(pid=116859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:44:33.049667 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a0fa6410-acd4-4bd6-9361-6aaab5ac25fc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "DELETE /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d/os-volume_attachments/3ee166b3-4d10-4902-8276-13a90850bf70" status: 400 len: 269 microversion: 2.1 time: 120.245589 Mar 03 02:44:33.050248 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1039/2121] 10.222.0.30 () {58 vars in 1415 bytes} [Thu Mar 3 02:42:32 2022] DELETE /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d/os-volume_attachments/3ee166b3-4d10-4902-8276-13a90850bf70 => generated 269 bytes in 120247 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 03 02:44:33.056769 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1239b452-80d9-4854-9f5b-bbb235864b41 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:44:33.057381 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1239b452-80d9-4854-9f5b-bbb235864b41 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:44:33.064020 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1239b452-80d9-4854-9f5b-bbb235864b41 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:44:33.064255 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1239b452-80d9-4854-9f5b-bbb235864b41 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:44:33.065050 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1239b452-80d9-4854-9f5b-bbb235864b41 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:44:33.065505 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1239b452-80d9-4854-9f5b-bbb235864b41 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:44:33.131035 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1239b452-80d9-4854-9f5b-bbb235864b41 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:44:33.138778 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1239b452-80d9-4854-9f5b-bbb235864b41 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1226 microversion: 2.1 time: 0.087381 Mar 03 02:44:33.139425 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1040/2122] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:44:33 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:44:33.144076 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0b1cf7c5-9763-4946-97a0-8ce0655235b1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:44:33.145097 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0b1cf7c5-9763-4946-97a0-8ce0655235b1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:44:33.150935 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0b1cf7c5-9763-4946-97a0-8ce0655235b1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:44:33.151553 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0b1cf7c5-9763-4946-97a0-8ce0655235b1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:44:33.152429 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0b1cf7c5-9763-4946-97a0-8ce0655235b1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:44:33.152929 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0b1cf7c5-9763-4946-97a0-8ce0655235b1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:44:33.182054 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0b1cf7c5-9763-4946-97a0-8ce0655235b1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041497 Mar 03 02:44:33.182609 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1041/2123] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:44:33 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:44:33.187090 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d6988230-1e00-4861-8d3d-4bbe00fac0dd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:44:33.188006 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d6988230-1e00-4861-8d3d-4bbe00fac0dd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:44:33.193314 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d6988230-1e00-4861-8d3d-4bbe00fac0dd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:44:33.193763 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d6988230-1e00-4861-8d3d-4bbe00fac0dd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:44:33.194532 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d6988230-1e00-4861-8d3d-4bbe00fac0dd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:44:33.195285 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d6988230-1e00-4861-8d3d-4bbe00fac0dd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:44:33.223286 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d6988230-1e00-4861-8d3d-4bbe00fac0dd tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039674 Mar 03 02:44:33.223875 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1042/2124] 10.222.0.30 () {60 vars in 1342 bytes} [Thu Mar 3 02:44:33 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:44:33.228915 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d5873643-cf95-48bb-b9b8-1896d9692cfd tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:44:33.229430 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d5873643-cf95-48bb-b9b8-1896d9692cfd tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:44:33.234803 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d5873643-cf95-48bb-b9b8-1896d9692cfd tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:44:33.235248 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d5873643-cf95-48bb-b9b8-1896d9692cfd tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:44:33.236107 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d5873643-cf95-48bb-b9b8-1896d9692cfd tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:44:33.236509 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d5873643-cf95-48bb-b9b8-1896d9692cfd tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:44:34.189861 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 02:44:34.190533 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: Thu Mar 3 02:44:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d/os-volume_attachments/3ee166b3-4d10-4902-8276-13a90850bf70 (ip 10.222.0.30) !!! Mar 03 02:44:49.182302 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.wsgi [None req-80eb7cd5-eddb-4df1-a51a-a3aab4ed70ea tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8d39b628-0f8d-4a1d-a986-d541937b4976) Mar 03 02:44:49.182795 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-80eb7cd5-eddb-4df1-a51a-a3aab4ed70ea tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8d39b628-0f8d-4a1d-a986-d541937b4976) {{(pid=116858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:44:49.183552 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-80eb7cd5-eddb-4df1-a51a-a3aab4ed70ea tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments/f2e36cca-2705-4b40-8b08-2a93f505f2f6" status: 400 len: 269 microversion: 2.1 time: 120.186920 Mar 03 02:44:49.184430 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1083/2125] 10.222.0.30 () {58 vars in 1415 bytes} [Thu Mar 3 02:42:48 2022] DELETE /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments/f2e36cca-2705-4b40-8b08-2a93f505f2f6 => generated 269 bytes in 120188 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 03 02:44:49.190446 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5e11b34a-7d95-4142-900d-18fe8f34ad40 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:44:49.191725 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5e11b34a-7d95-4142-900d-18fe8f34ad40 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:44:49.200000 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5e11b34a-7d95-4142-900d-18fe8f34ad40 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:44:49.200499 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5e11b34a-7d95-4142-900d-18fe8f34ad40 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:44:49.201523 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5e11b34a-7d95-4142-900d-18fe8f34ad40 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:44:49.201960 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5e11b34a-7d95-4142-900d-18fe8f34ad40 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:44:49.239911 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.objects.instance [None req-d5873643-cf95-48bb-b9b8-1896d9692cfd tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lazy-loading 'services' on Instance uuid 26ff8756-bd0b-464a-9c28-75b4ee57f99d {{(pid=116859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 03 02:45:42.972702 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 02:45:42.973393 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: Thu Mar 3 02:45:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments/f2e36cca-2705-4b40-8b08-2a93f505f2f6 (ip 10.222.0.30) !!! Mar 03 02:45:44.148232 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 02:45:44.148728 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: Thu Mar 3 02:45:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d/os-volume_attachments/3ee166b3-4d10-4902-8276-13a90850bf70 (ip 10.222.0.30) !!! Mar 03 02:45:54.079616 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 02:45:54.080112 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: Thu Mar 3 02:45:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments/f2e36cca-2705-4b40-8b08-2a93f505f2f6 (ip 10.222.0.30) !!! Mar 03 02:46:33.285184 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.objects.instance [None req-5e11b34a-7d95-4142-900d-18fe8f34ad40 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lazy-loading 'services' on Instance uuid 0df5e3af-dfd2-431d-83af-1a2a02019651 {{(pid=116858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 03 02:46:33.513845 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.wsgi [None req-d5873643-cf95-48bb-b9b8-1896d9692cfd tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-53868abc-4bf6-445f-b404-6e1006f765eb) Mar 03 02:46:33.514515 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d5873643-cf95-48bb-b9b8-1896d9692cfd tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-53868abc-4bf6-445f-b404-6e1006f765eb) {{(pid=116859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:46:33.515399 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d5873643-cf95-48bb-b9b8-1896d9692cfd tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "DELETE /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d/os-volume_attachments/3ee166b3-4d10-4902-8276-13a90850bf70" status: 400 len: 269 microversion: 2.1 time: 120.290633 Mar 03 02:46:33.516011 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1043/2126] 10.222.0.30 () {58 vars in 1415 bytes} [Thu Mar 3 02:44:33 2022] DELETE /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d/os-volume_attachments/3ee166b3-4d10-4902-8276-13a90850bf70 => generated 269 bytes in 120292 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 03 02:46:33.521425 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-db25cdb9-55f9-4976-b95c-15c42fb50587 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:46:33.522052 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-db25cdb9-55f9-4976-b95c-15c42fb50587 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:33.528791 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-db25cdb9-55f9-4976-b95c-15c42fb50587 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:33.529340 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-db25cdb9-55f9-4976-b95c-15c42fb50587 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:33.530126 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-db25cdb9-55f9-4976-b95c-15c42fb50587 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:33.530563 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-db25cdb9-55f9-4976-b95c-15c42fb50587 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:33.562967 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-db25cdb9-55f9-4976-b95c-15c42fb50587 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:33.563515 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-db25cdb9-55f9-4976-b95c-15c42fb50587 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:33.564049 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.objects.instance [None req-db25cdb9-55f9-4976-b95c-15c42fb50587 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lazy-loading 'fault' on Instance uuid b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 {{(pid=116859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 03 02:46:33.611117 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-db25cdb9-55f9-4976-b95c-15c42fb50587 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8e9db4620246f1ad87ad65879ed5af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd996560b97427ea1efbf2206d5adb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:46:33.619780 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-db25cdb9-55f9-4976-b95c-15c42fb50587 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 200 len: 1231 microversion: 2.1 time: 0.102620 Mar 03 02:46:33.620466 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1044/2127] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:46:33 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 1231 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:46:33.625919 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0dc2ac90-bb51-49e6-92ed-62eb9924ba7e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:46:33.627075 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0dc2ac90-bb51-49e6-92ed-62eb9924ba7e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:33.633861 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0dc2ac90-bb51-49e6-92ed-62eb9924ba7e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:33.634311 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0dc2ac90-bb51-49e6-92ed-62eb9924ba7e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:33.635270 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0dc2ac90-bb51-49e6-92ed-62eb9924ba7e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:33.635734 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0dc2ac90-bb51-49e6-92ed-62eb9924ba7e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:33.665586 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0dc2ac90-bb51-49e6-92ed-62eb9924ba7e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043893 Mar 03 02:46:33.666455 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1045/2128] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:46:33 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:46:33.794727 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2bcd3549-a85e-4c82-abb5-cd335ff58a39 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:46:33.795798 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2bcd3549-a85e-4c82-abb5-cd335ff58a39 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:33.801925 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2bcd3549-a85e-4c82-abb5-cd335ff58a39 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:33.802403 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2bcd3549-a85e-4c82-abb5-cd335ff58a39 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:33.803191 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2bcd3549-a85e-4c82-abb5-cd335ff58a39 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:33.803819 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2bcd3549-a85e-4c82-abb5-cd335ff58a39 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:33.837228 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2bcd3549-a85e-4c82-abb5-cd335ff58a39 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.169526 Mar 03 02:46:33.837987 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1046/2129] 10.222.0.30 () {60 vars in 1342 bytes} [Thu Mar 3 02:46:33 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:46:33.845284 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5e30cc58-f9f7-495f-9dab-646a8009b096 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:46:33.845777 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5e30cc58-f9f7-495f-9dab-646a8009b096 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:33.852325 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5e30cc58-f9f7-495f-9dab-646a8009b096 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:33.853035 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5e30cc58-f9f7-495f-9dab-646a8009b096 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:33.853550 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5e30cc58-f9f7-495f-9dab-646a8009b096 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:33.853983 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5e30cc58-f9f7-495f-9dab-646a8009b096 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:33.917405 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.wsgi [None req-5e11b34a-7d95-4142-900d-18fe8f34ad40 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-47828dea-0fc3-4521-99ac-cbe47fca5e33) Mar 03 02:46:33.918412 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5e11b34a-7d95-4142-900d-18fe8f34ad40 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-47828dea-0fc3-4521-99ac-cbe47fca5e33) {{(pid=116858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:46:33.919445 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5e11b34a-7d95-4142-900d-18fe8f34ad40 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments/f2e36cca-2705-4b40-8b08-2a93f505f2f6" status: 400 len: 269 microversion: 2.1 time: 104.734258 Mar 03 02:46:33.921256 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1084/2130] 10.222.0.30 () {58 vars in 1415 bytes} [Thu Mar 3 02:44:49 2022] DELETE /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments/f2e36cca-2705-4b40-8b08-2a93f505f2f6 => generated 269 bytes in 104736 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 03 02:46:33.929160 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-159caf94-e2da-4bfe-aa5e-a791fb28fa3a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:46:33.929935 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-159caf94-e2da-4bfe-aa5e-a791fb28fa3a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:33.938560 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-159caf94-e2da-4bfe-aa5e-a791fb28fa3a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:33.939272 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-159caf94-e2da-4bfe-aa5e-a791fb28fa3a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:33.940101 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-159caf94-e2da-4bfe-aa5e-a791fb28fa3a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:33.940683 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-159caf94-e2da-4bfe-aa5e-a791fb28fa3a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:34.008175 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.objects.instance [None req-5e30cc58-f9f7-495f-9dab-646a8009b096 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lazy-loading 'services' on Instance uuid 26ff8756-bd0b-464a-9c28-75b4ee57f99d {{(pid=116859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 03 02:46:34.126855 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.objects.instance [None req-159caf94-e2da-4bfe-aa5e-a791fb28fa3a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lazy-loading 'services' on Instance uuid 0df5e3af-dfd2-431d-83af-1a2a02019651 {{(pid=116858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 03 02:46:34.154757 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.wsgi [None req-5e30cc58-f9f7-495f-9dab-646a8009b096 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b093f1e9-d95d-442c-bf38-001265b4132e) Mar 03 02:46:34.155408 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5e30cc58-f9f7-495f-9dab-646a8009b096 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b093f1e9-d95d-442c-bf38-001265b4132e) {{(pid=116859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:46:34.156288 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5e30cc58-f9f7-495f-9dab-646a8009b096 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "DELETE /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d/os-volume_attachments/3ee166b3-4d10-4902-8276-13a90850bf70" status: 400 len: 269 microversion: 2.1 time: 0.317596 Mar 03 02:46:34.156843 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1047/2131] 10.222.0.30 () {58 vars in 1415 bytes} [Thu Mar 3 02:46:33 2022] DELETE /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d/os-volume_attachments/3ee166b3-4d10-4902-8276-13a90850bf70 => generated 269 bytes in 319 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 03 02:46:34.161324 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6104de63-38bb-401b-ad63-7ab7e135ba34 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:46:34.161916 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6104de63-38bb-401b-ad63-7ab7e135ba34 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:34.167797 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6104de63-38bb-401b-ad63-7ab7e135ba34 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:34.168260 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6104de63-38bb-401b-ad63-7ab7e135ba34 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:34.169041 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6104de63-38bb-401b-ad63-7ab7e135ba34 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:34.169489 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6104de63-38bb-401b-ad63-7ab7e135ba34 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:34.182303 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.wsgi [None req-6104de63-38bb-401b-ad63-7ab7e135ba34 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] HTTP exception thrown: Instance b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 could not be found. Mar 03 02:46:34.182890 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6104de63-38bb-401b-ad63-7ab7e135ba34 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Returning 404 to user: Instance b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 could not be found. {{(pid=116859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:46:34.184310 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6104de63-38bb-401b-ad63-7ab7e135ba34 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 404 len: 111 microversion: 2.1 time: 0.026500 Mar 03 02:46:34.184941 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1048/2132] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:46:34 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 03 02:46:34.189473 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-148bd83a-2b52-4ce5-ba8c-27d385c8e557 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:46:34.190370 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-148bd83a-2b52-4ce5-ba8c-27d385c8e557 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:34.205375 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-148bd83a-2b52-4ce5-ba8c-27d385c8e557 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:34.205834 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-148bd83a-2b52-4ce5-ba8c-27d385c8e557 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:34.206623 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-148bd83a-2b52-4ce5-ba8c-27d385c8e557 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:34.207065 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-148bd83a-2b52-4ce5-ba8c-27d385c8e557 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:34.228837 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.wsgi [None req-159caf94-e2da-4bfe-aa5e-a791fb28fa3a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cae94c24-7235-4cd0-a020-98a6546f4b88) Mar 03 02:46:34.229454 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-159caf94-e2da-4bfe-aa5e-a791fb28fa3a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cae94c24-7235-4cd0-a020-98a6546f4b88) {{(pid=116858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:46:34.230628 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-159caf94-e2da-4bfe-aa5e-a791fb28fa3a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments/f2e36cca-2705-4b40-8b08-2a93f505f2f6" status: 400 len: 269 microversion: 2.1 time: 0.308010 Mar 03 02:46:34.231194 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1085/2133] 10.222.0.30 () {58 vars in 1415 bytes} [Thu Mar 3 02:46:33 2022] DELETE /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments/f2e36cca-2705-4b40-8b08-2a93f505f2f6 => generated 269 bytes in 309 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 03 02:46:34.236830 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-daa5c0bd-e2e9-4c90-a165-91bd43c3a10a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:46:34.236974 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-148bd83a-2b52-4ce5-ba8c-27d385c8e557 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050735 Mar 03 02:46:34.237488 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1049/2134] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:46:34 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:46:34.238079 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-daa5c0bd-e2e9-4c90-a165-91bd43c3a10a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:34.242060 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7386afbd-d457-4e7d-9592-15b27a2bc0f6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:46:34.242497 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7386afbd-d457-4e7d-9592-15b27a2bc0f6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:34.243962 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-daa5c0bd-e2e9-4c90-a165-91bd43c3a10a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:34.244417 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-daa5c0bd-e2e9-4c90-a165-91bd43c3a10a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:34.245200 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-daa5c0bd-e2e9-4c90-a165-91bd43c3a10a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:34.246147 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-daa5c0bd-e2e9-4c90-a165-91bd43c3a10a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:34.249164 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7386afbd-d457-4e7d-9592-15b27a2bc0f6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:34.249619 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7386afbd-d457-4e7d-9592-15b27a2bc0f6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:34.250408 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7386afbd-d457-4e7d-9592-15b27a2bc0f6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:34.250850 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7386afbd-d457-4e7d-9592-15b27a2bc0f6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:34.275852 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-daa5c0bd-e2e9-4c90-a165-91bd43c3a10a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043330 Mar 03 02:46:34.276710 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1086/2135] 10.222.0.30 () {60 vars in 1342 bytes} [Thu Mar 3 02:46:34 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:46:34.281249 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-337fa8c4-525b-42dd-bf65-9da7d14245e6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:46:34.281740 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-337fa8c4-525b-42dd-bf65-9da7d14245e6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:34.287556 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-337fa8c4-525b-42dd-bf65-9da7d14245e6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:34.288092 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-337fa8c4-525b-42dd-bf65-9da7d14245e6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:34.288815 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-337fa8c4-525b-42dd-bf65-9da7d14245e6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:34.289253 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-337fa8c4-525b-42dd-bf65-9da7d14245e6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:34.329123 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.objects.instance [None req-7386afbd-d457-4e7d-9592-15b27a2bc0f6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lazy-loading 'services' on Instance uuid 26ff8756-bd0b-464a-9c28-75b4ee57f99d {{(pid=116859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 03 02:46:34.368262 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.objects.instance [None req-337fa8c4-525b-42dd-bf65-9da7d14245e6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lazy-loading 'services' on Instance uuid 0df5e3af-dfd2-431d-83af-1a2a02019651 {{(pid=116858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 03 02:46:34.395550 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.wsgi [None req-7386afbd-d457-4e7d-9592-15b27a2bc0f6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c8ca0921-2351-41f3-b61a-1c9e520c8379) Mar 03 02:46:34.396189 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7386afbd-d457-4e7d-9592-15b27a2bc0f6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c8ca0921-2351-41f3-b61a-1c9e520c8379) {{(pid=116859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:46:34.397016 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7386afbd-d457-4e7d-9592-15b27a2bc0f6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "DELETE /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d/os-volume_attachments/3ee166b3-4d10-4902-8276-13a90850bf70" status: 400 len: 269 microversion: 2.1 time: 0.158645 Mar 03 02:46:34.397564 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1050/2136] 10.222.0.30 () {58 vars in 1415 bytes} [Thu Mar 3 02:46:34 2022] DELETE /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d/os-volume_attachments/3ee166b3-4d10-4902-8276-13a90850bf70 => generated 269 bytes in 160 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 03 02:46:34.401970 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-92b622df-9040-4258-b3df-fa2e67e2f716 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:46:34.402571 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-92b622df-9040-4258-b3df-fa2e67e2f716 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:34.408216 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-92b622df-9040-4258-b3df-fa2e67e2f716 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:34.408660 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-92b622df-9040-4258-b3df-fa2e67e2f716 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:34.409425 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-92b622df-9040-4258-b3df-fa2e67e2f716 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:34.409857 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-92b622df-9040-4258-b3df-fa2e67e2f716 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:34.423106 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.wsgi [None req-92b622df-9040-4258-b3df-fa2e67e2f716 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] HTTP exception thrown: Instance b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 could not be found. Mar 03 02:46:34.423739 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-92b622df-9040-4258-b3df-fa2e67e2f716 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Returning 404 to user: Instance b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 could not be found. {{(pid=116859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:46:34.424553 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-92b622df-9040-4258-b3df-fa2e67e2f716 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 404 len: 111 microversion: 2.1 time: 0.026107 Mar 03 02:46:34.425089 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1051/2137] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:46:34 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 03 02:46:34.429458 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.wsgi [None req-337fa8c4-525b-42dd-bf65-9da7d14245e6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a626dd91-7169-4e43-a009-423bc6b9fc6a) Mar 03 02:46:34.429606 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7c819c54-e354-4bbe-b1bd-b19633f47df9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:46:34.430216 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-337fa8c4-525b-42dd-bf65-9da7d14245e6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a626dd91-7169-4e43-a009-423bc6b9fc6a) {{(pid=116858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:46:34.430393 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7c819c54-e354-4bbe-b1bd-b19633f47df9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:34.431173 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-337fa8c4-525b-42dd-bf65-9da7d14245e6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments/f2e36cca-2705-4b40-8b08-2a93f505f2f6" status: 400 len: 269 microversion: 2.1 time: 0.153679 Mar 03 02:46:34.431824 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1087/2138] 10.222.0.30 () {58 vars in 1415 bytes} [Thu Mar 3 02:46:34 2022] DELETE /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments/f2e36cca-2705-4b40-8b08-2a93f505f2f6 => generated 269 bytes in 155 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 03 02:46:34.436454 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7c819c54-e354-4bbe-b1bd-b19633f47df9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:34.436900 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7c819c54-e354-4bbe-b1bd-b19633f47df9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:34.437449 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-086a443d-2837-4fc3-98c4-b846e8188abf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:46:34.437666 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7c819c54-e354-4bbe-b1bd-b19633f47df9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:34.438100 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7c819c54-e354-4bbe-b1bd-b19633f47df9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:34.438533 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-086a443d-2837-4fc3-98c4-b846e8188abf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:34.444337 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-086a443d-2837-4fc3-98c4-b846e8188abf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:34.444855 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-086a443d-2837-4fc3-98c4-b846e8188abf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:34.445689 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-086a443d-2837-4fc3-98c4-b846e8188abf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:34.446211 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-086a443d-2837-4fc3-98c4-b846e8188abf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:34.466500 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7c819c54-e354-4bbe-b1bd-b19633f47df9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040416 Mar 03 02:46:34.467063 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1052/2139] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:46:34 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:46:34.471576 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ab6ba898-f81e-4782-b961-3d0dee8c7943 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:46:34.472088 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ab6ba898-f81e-4782-b961-3d0dee8c7943 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:34.474936 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-086a443d-2837-4fc3-98c4-b846e8188abf tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042056 Mar 03 02:46:34.475481 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1088/2140] 10.222.0.30 () {60 vars in 1342 bytes} [Thu Mar 3 02:46:34 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:46:34.477439 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ab6ba898-f81e-4782-b961-3d0dee8c7943 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:34.477894 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ab6ba898-f81e-4782-b961-3d0dee8c7943 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:34.478672 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ab6ba898-f81e-4782-b961-3d0dee8c7943 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:34.479113 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ab6ba898-f81e-4782-b961-3d0dee8c7943 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:34.480418 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7d9d6ca4-4952-41f5-8ddd-2cc61baefc2a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:46:34.480928 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7d9d6ca4-4952-41f5-8ddd-2cc61baefc2a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:34.486205 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7d9d6ca4-4952-41f5-8ddd-2cc61baefc2a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:34.486903 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7d9d6ca4-4952-41f5-8ddd-2cc61baefc2a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:34.487684 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7d9d6ca4-4952-41f5-8ddd-2cc61baefc2a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:34.488116 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7d9d6ca4-4952-41f5-8ddd-2cc61baefc2a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:34.562507 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.objects.instance [None req-ab6ba898-f81e-4782-b961-3d0dee8c7943 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lazy-loading 'services' on Instance uuid 26ff8756-bd0b-464a-9c28-75b4ee57f99d {{(pid=116859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 03 02:46:34.600538 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.objects.instance [None req-7d9d6ca4-4952-41f5-8ddd-2cc61baefc2a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lazy-loading 'services' on Instance uuid 0df5e3af-dfd2-431d-83af-1a2a02019651 {{(pid=116858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 03 02:46:34.628185 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.wsgi [None req-ab6ba898-f81e-4782-b961-3d0dee8c7943 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bd5bce2b-8fd6-44bf-aced-fa90eb11fd14) Mar 03 02:46:34.628877 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ab6ba898-f81e-4782-b961-3d0dee8c7943 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bd5bce2b-8fd6-44bf-aced-fa90eb11fd14) {{(pid=116859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:46:34.629792 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ab6ba898-f81e-4782-b961-3d0dee8c7943 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "DELETE /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d/os-volume_attachments/3ee166b3-4d10-4902-8276-13a90850bf70" status: 400 len: 269 microversion: 2.1 time: 0.161829 Mar 03 02:46:34.630451 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1053/2141] 10.222.0.30 () {58 vars in 1415 bytes} [Thu Mar 3 02:46:34 2022] DELETE /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d/os-volume_attachments/3ee166b3-4d10-4902-8276-13a90850bf70 => generated 269 bytes in 163 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 03 02:46:34.635364 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-59762298-116f-4157-aba9-1ad3e73aa643 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:46:34.636011 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-59762298-116f-4157-aba9-1ad3e73aa643 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] [instance: b4ca9b17-c039-4bdc-9a51-c1351edaf4d3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:34.643105 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-59762298-116f-4157-aba9-1ad3e73aa643 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:34.643565 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-59762298-116f-4157-aba9-1ad3e73aa643 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:34.644812 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-59762298-116f-4157-aba9-1ad3e73aa643 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:34.645282 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-59762298-116f-4157-aba9-1ad3e73aa643 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:34.658369 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.wsgi [None req-59762298-116f-4157-aba9-1ad3e73aa643 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] HTTP exception thrown: Instance b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 could not be found. Mar 03 02:46:34.658966 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-59762298-116f-4157-aba9-1ad3e73aa643 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Returning 404 to user: Instance b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 could not be found. {{(pid=116859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:46:34.659861 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-59762298-116f-4157-aba9-1ad3e73aa643 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3" status: 404 len: 111 microversion: 2.1 time: 0.028423 Mar 03 02:46:34.660397 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1054/2142] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:46:34 2022] GET /compute/v2.1/servers/b4ca9b17-c039-4bdc-9a51-c1351edaf4d3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 03 02:46:34.660957 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.wsgi [None req-7d9d6ca4-4952-41f5-8ddd-2cc61baefc2a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2256a2c8-69c8-4f17-abe2-272a4def2934) Mar 03 02:46:34.661540 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7d9d6ca4-4952-41f5-8ddd-2cc61baefc2a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2256a2c8-69c8-4f17-abe2-272a4def2934) {{(pid=116858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:46:34.662573 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7d9d6ca4-4952-41f5-8ddd-2cc61baefc2a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments/f2e36cca-2705-4b40-8b08-2a93f505f2f6" status: 400 len: 269 microversion: 2.1 time: 0.186186 Mar 03 02:46:34.663151 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1089/2143] 10.222.0.30 () {58 vars in 1415 bytes} [Thu Mar 3 02:46:34 2022] DELETE /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651/os-volume_attachments/f2e36cca-2705-4b40-8b08-2a93f505f2f6 => generated 269 bytes in 187 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 03 02:46:34.665209 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-cdcb84f6-f29d-449d-a9e0-da0788baef4b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:46:34.666103 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-cdcb84f6-f29d-449d-a9e0-da0788baef4b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:34.668546 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-95245ac7-7ecc-4ba5-8cf8-21dd83e66bef tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:46:34.669545 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-95245ac7-7ecc-4ba5-8cf8-21dd83e66bef tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:34.672703 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cdcb84f6-f29d-449d-a9e0-da0788baef4b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:34.673159 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cdcb84f6-f29d-449d-a9e0-da0788baef4b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:34.674588 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cdcb84f6-f29d-449d-a9e0-da0788baef4b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:34.675333 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cdcb84f6-f29d-449d-a9e0-da0788baef4b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:34.676594 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-95245ac7-7ecc-4ba5-8cf8-21dd83e66bef tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:34.677046 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-95245ac7-7ecc-4ba5-8cf8-21dd83e66bef tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:34.677825 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-95245ac7-7ecc-4ba5-8cf8-21dd83e66bef tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:34.678254 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-95245ac7-7ecc-4ba5-8cf8-21dd83e66bef tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:34.712544 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-95245ac7-7ecc-4ba5-8cf8-21dd83e66bef tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044682 Mar 03 02:46:34.713076 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1090/2144] 10.222.0.30 () {60 vars in 1342 bytes} [Thu Mar 3 02:46:34 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:46:34.717378 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-cdcb84f6-f29d-449d-a9e0-da0788baef4b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055762 Mar 03 02:46:34.718040 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1055/2145] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:46:34 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:46:34.721361 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1a16ec84-9e8f-497a-b87e-0b94a874bed7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:46:34.721361 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1a16ec84-9e8f-497a-b87e-0b94a874bed7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:34.724774 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1a16ec84-9e8f-497a-b87e-0b94a874bed7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:34.725288 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1a16ec84-9e8f-497a-b87e-0b94a874bed7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:34.726160 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1a16ec84-9e8f-497a-b87e-0b94a874bed7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:34.726591 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1a16ec84-9e8f-497a-b87e-0b94a874bed7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:34.874986 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.objects.instance [None req-1a16ec84-9e8f-497a-b87e-0b94a874bed7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lazy-loading 'services' on Instance uuid 26ff8756-bd0b-464a-9c28-75b4ee57f99d {{(pid=116858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 03 02:46:34.927513 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.wsgi [None req-1a16ec84-9e8f-497a-b87e-0b94a874bed7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fa152980-7686-435e-b6a9-d43072a4dda8) Mar 03 02:46:34.928160 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1a16ec84-9e8f-497a-b87e-0b94a874bed7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fa152980-7686-435e-b6a9-d43072a4dda8) {{(pid=116858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:46:34.929024 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1a16ec84-9e8f-497a-b87e-0b94a874bed7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "DELETE /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d/os-volume_attachments/3ee166b3-4d10-4902-8276-13a90850bf70" status: 400 len: 269 microversion: 2.1 time: 0.215008 Mar 03 02:46:34.929571 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1091/2146] 10.222.0.30 () {58 vars in 1415 bytes} [Thu Mar 3 02:46:34 2022] DELETE /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d/os-volume_attachments/3ee166b3-4d10-4902-8276-13a90850bf70 => generated 269 bytes in 216 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 03 02:46:35.721111 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-aa30095f-84ac-4d9b-b01c-b8bbbc6f8082 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:46:35.722051 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-aa30095f-84ac-4d9b-b01c-b8bbbc6f8082 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:35.728526 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aa30095f-84ac-4d9b-b01c-b8bbbc6f8082 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:35.729040 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aa30095f-84ac-4d9b-b01c-b8bbbc6f8082 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:35.729578 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ed163aff-731e-4e55-91a1-dbc5ec05d584 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:46:35.730033 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aa30095f-84ac-4d9b-b01c-b8bbbc6f8082 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:35.730415 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aa30095f-84ac-4d9b-b01c-b8bbbc6f8082 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:35.730567 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ed163aff-731e-4e55-91a1-dbc5ec05d584 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:35.737111 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ed163aff-731e-4e55-91a1-dbc5ec05d584 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:35.737554 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ed163aff-731e-4e55-91a1-dbc5ec05d584 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:35.738322 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ed163aff-731e-4e55-91a1-dbc5ec05d584 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:35.738754 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ed163aff-731e-4e55-91a1-dbc5ec05d584 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:35.759358 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-aa30095f-84ac-4d9b-b01c-b8bbbc6f8082 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042175 Mar 03 02:46:35.759947 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1056/2147] 10.222.0.30 () {60 vars in 1342 bytes} [Thu Mar 3 02:46:35 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:46:35.767042 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ed163aff-731e-4e55-91a1-dbc5ec05d584 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042068 Mar 03 02:46:35.767585 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1092/2148] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:46:35 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:46:36.771536 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-cef6760f-3bb8-4257-bbd1-41536ba63602 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:46:36.772378 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-cef6760f-3bb8-4257-bbd1-41536ba63602 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:36.778325 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3ad59188-b68d-4f2a-a920-3f4fab7df30a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:46:36.778820 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cef6760f-3bb8-4257-bbd1-41536ba63602 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:36.779233 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3ad59188-b68d-4f2a-a920-3f4fab7df30a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:36.779381 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cef6760f-3bb8-4257-bbd1-41536ba63602 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:36.780061 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cef6760f-3bb8-4257-bbd1-41536ba63602 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:36.780497 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cef6760f-3bb8-4257-bbd1-41536ba63602 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:36.785397 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3ad59188-b68d-4f2a-a920-3f4fab7df30a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:36.785856 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3ad59188-b68d-4f2a-a920-3f4fab7df30a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:36.786637 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3ad59188-b68d-4f2a-a920-3f4fab7df30a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:36.787075 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3ad59188-b68d-4f2a-a920-3f4fab7df30a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:36.810390 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-cef6760f-3bb8-4257-bbd1-41536ba63602 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042773 Mar 03 02:46:36.810961 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1057/2149] 10.222.0.30 () {60 vars in 1342 bytes} [Thu Mar 3 02:46:36 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:46:36.816202 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3ad59188-b68d-4f2a-a920-3f4fab7df30a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041982 Mar 03 02:46:36.816789 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1093/2150] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:46:36 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:46:37.822299 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-cc9102c6-62e4-43f5-961c-7f53bd99df36 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:46:37.823202 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-cc9102c6-62e4-43f5-961c-7f53bd99df36 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:37.828755 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7cc426d9-f22f-4f4c-8eab-1b07ad6ea411 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:46:37.829526 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7cc426d9-f22f-4f4c-8eab-1b07ad6ea411 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:37.830534 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cc9102c6-62e4-43f5-961c-7f53bd99df36 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:37.830982 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cc9102c6-62e4-43f5-961c-7f53bd99df36 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:37.831800 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cc9102c6-62e4-43f5-961c-7f53bd99df36 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:37.832231 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cc9102c6-62e4-43f5-961c-7f53bd99df36 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:37.835624 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7cc426d9-f22f-4f4c-8eab-1b07ad6ea411 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:37.836077 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7cc426d9-f22f-4f4c-8eab-1b07ad6ea411 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:37.836848 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7cc426d9-f22f-4f4c-8eab-1b07ad6ea411 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:37.837281 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7cc426d9-f22f-4f4c-8eab-1b07ad6ea411 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:37.860140 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-cc9102c6-62e4-43f5-961c-7f53bd99df36 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041857 Mar 03 02:46:37.860697 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1058/2151] 10.222.0.30 () {60 vars in 1342 bytes} [Thu Mar 3 02:46:37 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:46:37.865681 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7cc426d9-f22f-4f4c-8eab-1b07ad6ea411 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041627 Mar 03 02:46:37.866225 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1094/2152] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:46:37 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:46:38.872232 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-baa8621e-d04d-41b4-9716-3b8bad0dff0b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:46:38.873168 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-baa8621e-d04d-41b4-9716-3b8bad0dff0b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:38.876929 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-558711e6-e0fc-49d8-861d-b6cefa4f552c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:46:38.878358 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-558711e6-e0fc-49d8-861d-b6cefa4f552c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:38.879705 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-baa8621e-d04d-41b4-9716-3b8bad0dff0b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:38.880163 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-baa8621e-d04d-41b4-9716-3b8bad0dff0b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:38.880948 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-baa8621e-d04d-41b4-9716-3b8bad0dff0b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:38.881387 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-baa8621e-d04d-41b4-9716-3b8bad0dff0b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:38.884552 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-558711e6-e0fc-49d8-861d-b6cefa4f552c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:38.885013 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-558711e6-e0fc-49d8-861d-b6cefa4f552c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:38.885797 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-558711e6-e0fc-49d8-861d-b6cefa4f552c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:38.886772 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-558711e6-e0fc-49d8-861d-b6cefa4f552c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:38.911896 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-baa8621e-d04d-41b4-9716-3b8bad0dff0b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043635 Mar 03 02:46:38.912458 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1059/2153] 10.222.0.30 () {60 vars in 1342 bytes} [Thu Mar 3 02:46:38 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:46:38.915042 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-558711e6-e0fc-49d8-861d-b6cefa4f552c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041984 Mar 03 02:46:38.915617 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1095/2154] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:46:38 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:46:39.924144 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-10f4a0a9-a964-48f3-ad01-4cba5c0a8e6d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:46:39.925073 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-10f4a0a9-a964-48f3-ad01-4cba5c0a8e6d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:39.926033 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-359c2e18-b875-4afb-935f-34b695bc9f24 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:46:39.926933 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-359c2e18-b875-4afb-935f-34b695bc9f24 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:39.931218 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-10f4a0a9-a964-48f3-ad01-4cba5c0a8e6d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:39.931690 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-10f4a0a9-a964-48f3-ad01-4cba5c0a8e6d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:39.932461 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-10f4a0a9-a964-48f3-ad01-4cba5c0a8e6d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:39.933534 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-10f4a0a9-a964-48f3-ad01-4cba5c0a8e6d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:39.934246 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-359c2e18-b875-4afb-935f-34b695bc9f24 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:39.934663 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-359c2e18-b875-4afb-935f-34b695bc9f24 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:39.935451 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-359c2e18-b875-4afb-935f-34b695bc9f24 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:39.935922 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-359c2e18-b875-4afb-935f-34b695bc9f24 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:39.961706 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-10f4a0a9-a964-48f3-ad01-4cba5c0a8e6d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041532 Mar 03 02:46:39.962269 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1060/2155] 10.222.0.30 () {60 vars in 1342 bytes} [Thu Mar 3 02:46:39 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:46:39.963386 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-359c2e18-b875-4afb-935f-34b695bc9f24 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041183 Mar 03 02:46:39.963961 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1096/2156] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:46:39 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:46:40.975145 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-09ce2557-9463-45b7-8ce3-cda0fe9f9bff tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:46:40.976074 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-09ce2557-9463-45b7-8ce3-cda0fe9f9bff tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:40.976464 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c382fff5-d714-4d52-b5d1-96230e3d1b6c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:46:40.977364 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c382fff5-d714-4d52-b5d1-96230e3d1b6c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:40.982664 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-09ce2557-9463-45b7-8ce3-cda0fe9f9bff tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:40.983116 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-09ce2557-9463-45b7-8ce3-cda0fe9f9bff tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:40.983922 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-09ce2557-9463-45b7-8ce3-cda0fe9f9bff tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:40.984102 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c382fff5-d714-4d52-b5d1-96230e3d1b6c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:40.984359 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-09ce2557-9463-45b7-8ce3-cda0fe9f9bff tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:40.984677 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c382fff5-d714-4d52-b5d1-96230e3d1b6c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:40.985545 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c382fff5-d714-4d52-b5d1-96230e3d1b6c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:40.985756 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c382fff5-d714-4d52-b5d1-96230e3d1b6c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:41.014109 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c382fff5-d714-4d52-b5d1-96230e3d1b6c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041383 Mar 03 02:46:41.014675 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1097/2157] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:46:40 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:46:41.016040 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-09ce2557-9463-45b7-8ce3-cda0fe9f9bff tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045662 Mar 03 02:46:41.016601 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1061/2158] 10.222.0.30 () {60 vars in 1342 bytes} [Thu Mar 3 02:46:40 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:46:42.025499 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-801bc877-21c9-475a-a3f9-04b556d876ec tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:46:42.026412 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-801bc877-21c9-475a-a3f9-04b556d876ec tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:42.028329 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-338033a4-0d9e-4ed8-b4ef-84c09b09dd62 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:46:42.029232 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-338033a4-0d9e-4ed8-b4ef-84c09b09dd62 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:42.033261 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-801bc877-21c9-475a-a3f9-04b556d876ec tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:42.033724 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-801bc877-21c9-475a-a3f9-04b556d876ec tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:42.034534 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-801bc877-21c9-475a-a3f9-04b556d876ec tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:42.034967 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-801bc877-21c9-475a-a3f9-04b556d876ec tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:42.035910 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-338033a4-0d9e-4ed8-b4ef-84c09b09dd62 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:42.036367 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-338033a4-0d9e-4ed8-b4ef-84c09b09dd62 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:42.037150 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-338033a4-0d9e-4ed8-b4ef-84c09b09dd62 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:42.037586 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-338033a4-0d9e-4ed8-b4ef-84c09b09dd62 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:42.064467 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-801bc877-21c9-475a-a3f9-04b556d876ec tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042892 Mar 03 02:46:42.065026 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1098/2159] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:46:42 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:46:42.067000 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-338033a4-0d9e-4ed8-b4ef-84c09b09dd62 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042708 Mar 03 02:46:42.067558 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1062/2160] 10.222.0.30 () {60 vars in 1342 bytes} [Thu Mar 3 02:46:42 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 03 02:46:43.077590 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-524b4d0e-4127-49da-8f63-65be6f3406ed tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:46:43.078500 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-524b4d0e-4127-49da-8f63-65be6f3406ed tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:43.078921 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3a192524-75af-42ce-b554-0718ac472909 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:46:43.079867 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3a192524-75af-42ce-b554-0718ac472909 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:43.084758 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-524b4d0e-4127-49da-8f63-65be6f3406ed tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:43.085210 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-524b4d0e-4127-49da-8f63-65be6f3406ed tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:43.085993 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3a192524-75af-42ce-b554-0718ac472909 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:43.086120 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-524b4d0e-4127-49da-8f63-65be6f3406ed tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:43.086426 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-524b4d0e-4127-49da-8f63-65be6f3406ed tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:43.086539 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3a192524-75af-42ce-b554-0718ac472909 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:43.087201 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3a192524-75af-42ce-b554-0718ac472909 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:43.087663 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3a192524-75af-42ce-b554-0718ac472909 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:43.115231 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-524b4d0e-4127-49da-8f63-65be6f3406ed tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043202 Mar 03 02:46:43.115483 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3a192524-75af-42ce-b554-0718ac472909 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040843 Mar 03 02:46:43.116056 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1099/2161] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:46:43 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:46:43.116182 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1063/2162] 10.222.0.30 () {60 vars in 1342 bytes} [Thu Mar 3 02:46:43 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 03 02:46:44.127188 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8b4f1b6d-ef36-4e8a-9c3a-2e16c639a226 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:46:44.127737 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4eed2653-eec5-45c3-ae6f-aafb9a5971b5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:46:44.128114 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8b4f1b6d-ef36-4e8a-9c3a-2e16c639a226 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:44.128625 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4eed2653-eec5-45c3-ae6f-aafb9a5971b5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:44.134318 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b4f1b6d-ef36-4e8a-9c3a-2e16c639a226 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:44.134758 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4eed2653-eec5-45c3-ae6f-aafb9a5971b5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:44.134866 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b4f1b6d-ef36-4e8a-9c3a-2e16c639a226 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:44.135209 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4eed2653-eec5-45c3-ae6f-aafb9a5971b5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:44.135522 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b4f1b6d-ef36-4e8a-9c3a-2e16c639a226 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:44.135978 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b4f1b6d-ef36-4e8a-9c3a-2e16c639a226 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:44.136313 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4eed2653-eec5-45c3-ae6f-aafb9a5971b5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:44.136755 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4eed2653-eec5-45c3-ae6f-aafb9a5971b5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:44.164803 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4eed2653-eec5-45c3-ae6f-aafb9a5971b5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040991 Mar 03 02:46:44.165049 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8b4f1b6d-ef36-4e8a-9c3a-2e16c639a226 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041503 Mar 03 02:46:44.165354 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1100/2164] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:46:44 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:46:44.165463 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1064/2164] 10.222.0.30 () {60 vars in 1342 bytes} [Thu Mar 3 02:46:44 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 03 02:46:45.176480 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-605d9b29-8c98-4781-b965-0937193ce80a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:46:45.177015 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-fed5f7b1-ee9d-47d9-a78d-f0c694745f19 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:46:45.177404 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-605d9b29-8c98-4781-b965-0937193ce80a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:45.177511 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-fed5f7b1-ee9d-47d9-a78d-f0c694745f19 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:45.183969 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-605d9b29-8c98-4781-b965-0937193ce80a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:45.184252 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fed5f7b1-ee9d-47d9-a78d-f0c694745f19 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:45.184421 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-605d9b29-8c98-4781-b965-0937193ce80a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:45.184700 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fed5f7b1-ee9d-47d9-a78d-f0c694745f19 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:45.185200 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-605d9b29-8c98-4781-b965-0937193ce80a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:45.185474 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fed5f7b1-ee9d-47d9-a78d-f0c694745f19 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:45.185637 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-605d9b29-8c98-4781-b965-0937193ce80a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:45.185914 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fed5f7b1-ee9d-47d9-a78d-f0c694745f19 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:45.214011 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-605d9b29-8c98-4781-b965-0937193ce80a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041416 Mar 03 02:46:45.215272 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1101/2165] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:46:45 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:46:45.216394 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-fed5f7b1-ee9d-47d9-a78d-f0c694745f19 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043483 Mar 03 02:46:45.216981 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1065/2166] 10.222.0.30 () {60 vars in 1342 bytes} [Thu Mar 3 02:46:45 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 03 02:46:46.226203 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1a8a2217-15e4-4cb4-8454-22cd9dad5b5f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:46:46.227104 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1a8a2217-15e4-4cb4-8454-22cd9dad5b5f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:46.227681 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b1314dc4-3843-4a61-b685-6be1ebbc3533 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:46:46.228588 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b1314dc4-3843-4a61-b685-6be1ebbc3533 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:46.234436 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1a8a2217-15e4-4cb4-8454-22cd9dad5b5f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:46.234888 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1a8a2217-15e4-4cb4-8454-22cd9dad5b5f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:46.235285 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b1314dc4-3843-4a61-b685-6be1ebbc3533 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:46.235723 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1a8a2217-15e4-4cb4-8454-22cd9dad5b5f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:46.235834 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b1314dc4-3843-4a61-b685-6be1ebbc3533 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:46.236166 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1a8a2217-15e4-4cb4-8454-22cd9dad5b5f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:46.236834 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b1314dc4-3843-4a61-b685-6be1ebbc3533 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:46.237269 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b1314dc4-3843-4a61-b685-6be1ebbc3533 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:46.265210 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1a8a2217-15e4-4cb4-8454-22cd9dad5b5f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042917 Mar 03 02:46:46.265418 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b1314dc4-3843-4a61-b685-6be1ebbc3533 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041423 Mar 03 02:46:46.265973 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1102/2167] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:46:46 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:46:46.266093 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1066/2168] 10.222.0.30 () {60 vars in 1342 bytes} [Thu Mar 3 02:46:46 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 03 02:46:47.276895 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-72eb082a-fb8c-4ca2-9f21-7d71ccd3dc5c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:46:47.277962 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c28312e0-fa0b-4244-be2c-d6d65307bf5c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:46:47.278640 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-72eb082a-fb8c-4ca2-9f21-7d71ccd3dc5c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:47.278802 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c28312e0-fa0b-4244-be2c-d6d65307bf5c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:47.283748 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-72eb082a-fb8c-4ca2-9f21-7d71ccd3dc5c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:47.284198 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-72eb082a-fb8c-4ca2-9f21-7d71ccd3dc5c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:47.284530 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c28312e0-fa0b-4244-be2c-d6d65307bf5c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:47.284949 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c28312e0-fa0b-4244-be2c-d6d65307bf5c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:47.285148 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-72eb082a-fb8c-4ca2-9f21-7d71ccd3dc5c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:47.285396 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-72eb082a-fb8c-4ca2-9f21-7d71ccd3dc5c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:47.285728 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c28312e0-fa0b-4244-be2c-d6d65307bf5c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:47.286172 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c28312e0-fa0b-4244-be2c-d6d65307bf5c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:47.316663 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-72eb082a-fb8c-4ca2-9f21-7d71ccd3dc5c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043998 Mar 03 02:46:47.317147 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c28312e0-fa0b-4244-be2c-d6d65307bf5c tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044489 Mar 03 02:46:47.317574 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1067/2169] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Mar 3 02:46:47 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:46:47.317790 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1103/2170] 10.222.0.30 () {60 vars in 1342 bytes} [Thu Mar 3 02:46:47 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:46:48.328537 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1c070261-17d4-4aba-97ed-615b8771d065 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:46:48.329443 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1c070261-17d4-4aba-97ed-615b8771d065 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:48.329790 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e19d8544-36f9-4e82-93cc-473a173f5cde tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:46:48.330724 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e19d8544-36f9-4e82-93cc-473a173f5cde tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:46:48.335343 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1c070261-17d4-4aba-97ed-615b8771d065 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:48.335817 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1c070261-17d4-4aba-97ed-615b8771d065 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:48.336590 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1c070261-17d4-4aba-97ed-615b8771d065 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:48.336840 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e19d8544-36f9-4e82-93cc-473a173f5cde tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:48.337021 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1c070261-17d4-4aba-97ed-615b8771d065 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:48.337291 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e19d8544-36f9-4e82-93cc-473a173f5cde tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:48.338069 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e19d8544-36f9-4e82-93cc-473a173f5cde tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:46:48.338504 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e19d8544-36f9-4e82-93cc-473a173f5cde tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:46:48.360059 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.wsgi [None req-e19d8544-36f9-4e82-93cc-473a173f5cde tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] HTTP exception thrown: Instance f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 is not ready Mar 03 02:46:48.360655 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e19d8544-36f9-4e82-93cc-473a173f5cde tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Returning 409 to user: Instance f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 is not ready {{(pid=116858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:46:48.361738 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e19d8544-36f9-4e82-93cc-473a173f5cde tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "POST /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/action" status: 409 len: 110 microversion: 2.20 time: 0.035625 Mar 03 02:46:48.362452 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1104/2171] 10.222.0.30 () {62 vars in 1318 bytes} [Thu Mar 3 02:46:48 2022] POST /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3/action => generated 110 bytes in 37 msecs (HTTP/1.1 409) 9 headers in 380 bytes (1 switches on core 0) Mar 03 02:46:48.417578 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1c070261-17d4-4aba-97ed-615b8771d065 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "POST /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/action" status: 200 len: 76580 microversion: 2.1 time: 0.092621 Mar 03 02:46:48.418162 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1068/2172] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Mar 3 02:46:48 2022] POST /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2/action => generated 76580 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:47:32.661122 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 02:47:32.661738 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: Thu Mar 3 02:47:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 03 02:47:40.542206 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 02:47:40.542716 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: Thu Mar 3 02:47:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 03 02:49:02.980337 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 02:49:02.981015 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: Thu Mar 3 02:49:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 03 02:49:04.156606 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 02:49:04.157108 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: Thu Mar 3 02:49:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 03 02:49:14.086969 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 02:49:14.087450 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: Thu Mar 3 02:49:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 03 02:49:34.200636 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 02:49:34.201175 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: Thu Mar 3 02:49:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 03 02:50:52.669909 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 02:50:52.670551 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: Thu Mar 3 02:50:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 03 02:51:00.550185 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 02:51:00.550680 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: Thu Mar 3 02:51:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 03 02:52:22.988629 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 02:52:22.989353 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: Thu Mar 3 02:52:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 03 02:52:24.164480 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 02:52:24.164969 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: Thu Mar 3 02:52:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 03 02:52:33.918621 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65c0ca50-a6e2-44f5-b568-0d077ab61070] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 03 02:52:33.923506 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e4911e72-28e5-495d-a4c9-a3f95e72a4f9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:33.924034 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e4911e72-28e5-495d-a4c9-a3f95e72a4f9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:33.929716 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e4911e72-28e5-495d-a4c9-a3f95e72a4f9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:33.930165 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e4911e72-28e5-495d-a4c9-a3f95e72a4f9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:33.930928 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e4911e72-28e5-495d-a4c9-a3f95e72a4f9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:33.931367 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e4911e72-28e5-495d-a4c9-a3f95e72a4f9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:33.955966 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e4911e72-28e5-495d-a4c9-a3f95e72a4f9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Going to try to terminate instance {{(pid=116858) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 03 02:52:34.036124 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e4911e72-28e5-495d-a4c9-a3f95e72a4f9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 204 len: 0 microversion: 2.1 time: 0.118960 Mar 03 02:52:34.036805 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1105/2173] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Mar 3 02:52:33 2022] DELETE /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 03 02:52:34.043899 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4fc69935-7c33-4380-8cd5-dece84a3cb28] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 03 02:52:34.047898 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5a83ed0d-c64b-4903-849d-1628acfe33b3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:34.048619 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5a83ed0d-c64b-4903-849d-1628acfe33b3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:34.055681 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5a83ed0d-c64b-4903-849d-1628acfe33b3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:34.056143 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5a83ed0d-c64b-4903-849d-1628acfe33b3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:34.056934 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5a83ed0d-c64b-4903-849d-1628acfe33b3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:34.057376 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5a83ed0d-c64b-4903-849d-1628acfe33b3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:34.095713 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 02:52:34.095927 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: Thu Mar 3 02:52:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 03 02:52:34.241349 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5a83ed0d-c64b-4903-849d-1628acfe33b3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:34.249027 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5a83ed0d-c64b-4903-849d-1628acfe33b3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1558 microversion: 2.1 time: 0.207618 Mar 03 02:52:34.249601 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1069/2174] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:34 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1558 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:52:34.893480 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-06a44c2d-1f91-48ea-a4bf-c12ec83e4447 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:34.894358 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-06a44c2d-1f91-48ea-a4bf-c12ec83e4447 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:34.902595 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-06a44c2d-1f91-48ea-a4bf-c12ec83e4447 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:34.905375 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-06a44c2d-1f91-48ea-a4bf-c12ec83e4447 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:34.907364 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-06a44c2d-1f91-48ea-a4bf-c12ec83e4447 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:34.908240 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-06a44c2d-1f91-48ea-a4bf-c12ec83e4447 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:34.942568 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO oslo.messaging._drivers.impl_rabbit [-] [65c0ca50-a6e2-44f5-b568-0d077ab61070] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 53980. Mar 03 02:52:34.948423 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-06a44c2d-1f91-48ea-a4bf-c12ec83e4447 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Going to try to terminate instance {{(pid=116858) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 03 02:52:35.039114 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-762616ea-71e4-4ce4-9f01-5a045467c1b1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:35.041734 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-762616ea-71e4-4ce4-9f01-5a045467c1b1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:35.050977 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-762616ea-71e4-4ce4-9f01-5a045467c1b1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:35.052581 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-762616ea-71e4-4ce4-9f01-5a045467c1b1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:35.054487 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-762616ea-71e4-4ce4-9f01-5a045467c1b1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:35.055177 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-762616ea-71e4-4ce4-9f01-5a045467c1b1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:35.069054 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-06a44c2d-1f91-48ea-a4bf-c12ec83e4447 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 204 len: 0 microversion: 2.1 time: 0.179760 Mar 03 02:52:35.071964 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1106/2175] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Mar 3 02:52:34 2022] DELETE /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 03 02:52:35.088387 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-627f3aea-39fb-4fad-a33c-63fb83b6cdb2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] Calling method '.version_select at 0x7fb3c80903a0>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:35.090496 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-762616ea-71e4-4ce4-9f01-5a045467c1b1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Going to try to terminate instance {{(pid=116859) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 03 02:52:35.133504 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-627f3aea-39fb-4fad-a33c-63fb83b6cdb2 tempest-TestVolumeBootPattern-1041524726 tempest-TestVolumeBootPattern-1041524726-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2118924064" status: 202 len: 0 microversion: 2.1 time: 0.059131 Mar 03 02:52:35.134483 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO oslo.messaging._drivers.impl_rabbit [-] [4fc69935-7c33-4380-8cd5-dece84a3cb28] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 53986. Mar 03 02:52:35.135356 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1107/2176] 10.222.0.30 () {58 vars in 1262 bytes} [Thu Mar 3 02:52:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2118924064 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 03 02:52:35.153232 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4db16b68-37b9-4853-bd4a-651eed0e2853 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:35.155082 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4db16b68-37b9-4853-bd4a-651eed0e2853 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:35.181151 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4db16b68-37b9-4853-bd4a-651eed0e2853 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:35.186128 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4db16b68-37b9-4853-bd4a-651eed0e2853 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:35.187183 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4db16b68-37b9-4853-bd4a-651eed0e2853 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:35.189183 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4db16b68-37b9-4853-bd4a-651eed0e2853 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:35.210412 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR oslo.messaging._drivers.impl_rabbit [None req-762616ea-71e4-4ce4-9f01-5a045467c1b1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [9e25af40-4d0f-4606-a6a1-23aefd56e4c6] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 03 02:52:35.464567 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4db16b68-37b9-4853-bd4a-651eed0e2853 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:35.473080 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4db16b68-37b9-4853-bd4a-651eed0e2853 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.336323 Mar 03 02:52:35.481262 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1108/2177] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:35 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:52:35.548562 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [req-975bfcc6-a843-4cb4-9215-acaac9192d2a req-b36739fb-37fa-48fa-8125-f0cd865be9b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e1ff924-aedc-41f0-84df-c1ba81e1a936", "name": "network-vif-deleted", "tag": "d0bef6ed-58b8-4206-9b29-ca505fda1e79"}]} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:52:35.557331 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-975bfcc6-a843-4cb4-9215-acaac9192d2a req-b36739fb-37fa-48fa-8125-f0cd865be9b1 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:35.557939 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-975bfcc6-a843-4cb4-9215-acaac9192d2a req-b36739fb-37fa-48fa-8125-f0cd865be9b1 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:35.568947 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.compute.server_external_events [req-975bfcc6-a843-4cb4-9215-acaac9192d2a req-b36739fb-37fa-48fa-8125-f0cd865be9b1 service nova] Creating event network-vif-deleted:d0bef6ed-58b8-4206-9b29-ca505fda1e79 for instance 9e1ff924-aedc-41f0-84df-c1ba81e1a936 on hv-cinder-81977 Mar 03 02:52:35.574227 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [req-975bfcc6-a843-4cb4-9215-acaac9192d2a req-b36739fb-37fa-48fa-8125-f0cd865be9b1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099363 Mar 03 02:52:35.575268 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1109/2178] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:52:35.581237 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7bb3d09e-5d64-4066-ac2e-bc4427c02283 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:35.581943 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7bb3d09e-5d64-4066-ac2e-bc4427c02283 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:35.588048 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7bb3d09e-5d64-4066-ac2e-bc4427c02283 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:35.589066 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7bb3d09e-5d64-4066-ac2e-bc4427c02283 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:35.589987 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7bb3d09e-5d64-4066-ac2e-bc4427c02283 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:35.590562 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7bb3d09e-5d64-4066-ac2e-bc4427c02283 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:35.655252 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-7bb3d09e-5d64-4066-ac2e-bc4427c02283 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:35.663072 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7bb3d09e-5d64-4066-ac2e-bc4427c02283 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.086558 Mar 03 02:52:35.663653 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1110/2179] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:35 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:52:36.218278 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO oslo.messaging._drivers.impl_rabbit [None req-762616ea-71e4-4ce4-9f01-5a045467c1b1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [9e25af40-4d0f-4606-a6a1-23aefd56e4c6] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 54012. Mar 03 02:52:36.239927 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-762616ea-71e4-4ce4-9f01-5a045467c1b1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "DELETE /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 204 len: 0 microversion: 2.1 time: 1.209454 Mar 03 02:52:36.240513 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1070/2180] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Mar 3 02:52:35 2022] DELETE /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 0 bytes in 1211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 03 02:52:36.248735 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-42de74fb-dfd8-4dd4-9b26-9e4d0549fbef tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:36.249350 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-42de74fb-dfd8-4dd4-9b26-9e4d0549fbef tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:36.256780 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-42de74fb-dfd8-4dd4-9b26-9e4d0549fbef tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:36.257226 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-42de74fb-dfd8-4dd4-9b26-9e4d0549fbef tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:36.258022 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-42de74fb-dfd8-4dd4-9b26-9e4d0549fbef tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:36.258459 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-42de74fb-dfd8-4dd4-9b26-9e4d0549fbef tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:36.409513 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-42de74fb-dfd8-4dd4-9b26-9e4d0549fbef tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:36.417658 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-42de74fb-dfd8-4dd4-9b26-9e4d0549fbef tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.172743 Mar 03 02:52:36.418507 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1111/2181] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:36 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:52:36.491620 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-277bedbb-5b73-4629-a44c-0363678136a0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:36.492419 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-277bedbb-5b73-4629-a44c-0363678136a0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:36.498256 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-277bedbb-5b73-4629-a44c-0363678136a0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:36.498779 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-277bedbb-5b73-4629-a44c-0363678136a0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:36.499903 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-277bedbb-5b73-4629-a44c-0363678136a0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:36.500465 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-277bedbb-5b73-4629-a44c-0363678136a0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:36.680125 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-187e729c-1854-44cd-8355-1f60ae1ce5bd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:36.680737 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-187e729c-1854-44cd-8355-1f60ae1ce5bd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:36.686568 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-187e729c-1854-44cd-8355-1f60ae1ce5bd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:36.686946 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-187e729c-1854-44cd-8355-1f60ae1ce5bd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:36.688413 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-187e729c-1854-44cd-8355-1f60ae1ce5bd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:36.688954 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-187e729c-1854-44cd-8355-1f60ae1ce5bd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:36.727109 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-277bedbb-5b73-4629-a44c-0363678136a0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:36.736112 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-277bedbb-5b73-4629-a44c-0363678136a0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.248707 Mar 03 02:52:36.741788 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1071/2182] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:36 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:52:36.750507 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-187e729c-1854-44cd-8355-1f60ae1ce5bd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:36.758588 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-187e729c-1854-44cd-8355-1f60ae1ce5bd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.082511 Mar 03 02:52:36.759352 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1112/2183] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:36 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:52:37.435054 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c0dae400-4982-4564-9321-56e2f5acbad4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:37.435677 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c0dae400-4982-4564-9321-56e2f5acbad4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:37.442933 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c0dae400-4982-4564-9321-56e2f5acbad4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:37.443400 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c0dae400-4982-4564-9321-56e2f5acbad4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:37.444217 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c0dae400-4982-4564-9321-56e2f5acbad4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:37.444853 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c0dae400-4982-4564-9321-56e2f5acbad4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:37.652223 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c0dae400-4982-4564-9321-56e2f5acbad4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:37.660475 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c0dae400-4982-4564-9321-56e2f5acbad4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.229335 Mar 03 02:52:37.661859 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1072/2184] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:37 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:52:37.754001 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-041234b8-8b16-4e0d-847e-55789ff22477 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:37.754617 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-041234b8-8b16-4e0d-847e-55789ff22477 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:37.770265 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-041234b8-8b16-4e0d-847e-55789ff22477 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:37.774540 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-041234b8-8b16-4e0d-847e-55789ff22477 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:37.775420 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-fce2428a-4278-4c3d-aae0-40c7a27e4369 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:37.775582 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-041234b8-8b16-4e0d-847e-55789ff22477 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:37.776069 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-041234b8-8b16-4e0d-847e-55789ff22477 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:37.779288 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-fce2428a-4278-4c3d-aae0-40c7a27e4369 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:37.789352 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fce2428a-4278-4c3d-aae0-40c7a27e4369 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:37.806325 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fce2428a-4278-4c3d-aae0-40c7a27e4369 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:37.807477 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fce2428a-4278-4c3d-aae0-40c7a27e4369 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:37.807952 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fce2428a-4278-4c3d-aae0-40c7a27e4369 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:37.876725 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-fce2428a-4278-4c3d-aae0-40c7a27e4369 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:37.886019 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-fce2428a-4278-4c3d-aae0-40c7a27e4369 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.114846 Mar 03 02:52:37.886609 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1073/2185] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:37 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:52:37.930779 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-041234b8-8b16-4e0d-847e-55789ff22477 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:37.938689 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-041234b8-8b16-4e0d-847e-55789ff22477 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.189304 Mar 03 02:52:37.939269 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1113/2186] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:37 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:52:38.678883 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-fe86bd16-afc6-4ec7-82ed-b236b1c393ba tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:38.679631 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-fe86bd16-afc6-4ec7-82ed-b236b1c393ba tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:38.685954 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fe86bd16-afc6-4ec7-82ed-b236b1c393ba tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:38.686514 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fe86bd16-afc6-4ec7-82ed-b236b1c393ba tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:38.688333 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fe86bd16-afc6-4ec7-82ed-b236b1c393ba tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:38.688965 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fe86bd16-afc6-4ec7-82ed-b236b1c393ba tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:38.905493 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-645634fd-fa98-48f2-80bd-cd70e5c4b4fe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:38.911962 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-645634fd-fa98-48f2-80bd-cd70e5c4b4fe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:38.918856 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-645634fd-fa98-48f2-80bd-cd70e5c4b4fe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:38.919568 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-645634fd-fa98-48f2-80bd-cd70e5c4b4fe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:38.920563 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-645634fd-fa98-48f2-80bd-cd70e5c4b4fe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:38.921265 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-645634fd-fa98-48f2-80bd-cd70e5c4b4fe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:38.989004 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-645634fd-fa98-48f2-80bd-cd70e5c4b4fe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:38.996878 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-645634fd-fa98-48f2-80bd-cd70e5c4b4fe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.098207 Mar 03 02:52:38.997467 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1114/2187] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:38 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:52:39.010071 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-cb0f5417-fb05-4a2e-b68d-c806afdc8fee tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:39.010702 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-cb0f5417-fb05-4a2e-b68d-c806afdc8fee tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:39.017820 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cb0f5417-fb05-4a2e-b68d-c806afdc8fee tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:39.018276 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cb0f5417-fb05-4a2e-b68d-c806afdc8fee tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:39.019076 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cb0f5417-fb05-4a2e-b68d-c806afdc8fee tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:39.019518 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cb0f5417-fb05-4a2e-b68d-c806afdc8fee tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:39.164674 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-cb0f5417-fb05-4a2e-b68d-c806afdc8fee tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:39.172727 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-cb0f5417-fb05-4a2e-b68d-c806afdc8fee tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.173876 Mar 03 02:52:39.173226 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1115/2188] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:38 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:52:39.342977 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-fe86bd16-afc6-4ec7-82ed-b236b1c393ba tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:39.351410 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-fe86bd16-afc6-4ec7-82ed-b236b1c393ba tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.677369 Mar 03 02:52:39.352024 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1074/2189] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:38 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:52:40.013835 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-12cab7fa-72a0-4ce4-bc64-39b4d0c81266 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:40.014447 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-12cab7fa-72a0-4ce4-bc64-39b4d0c81266 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:40.020926 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-12cab7fa-72a0-4ce4-bc64-39b4d0c81266 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:40.021381 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-12cab7fa-72a0-4ce4-bc64-39b4d0c81266 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:40.022166 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-12cab7fa-72a0-4ce4-bc64-39b4d0c81266 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:40.022613 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-12cab7fa-72a0-4ce4-bc64-39b4d0c81266 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:40.082475 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-12cab7fa-72a0-4ce4-bc64-39b4d0c81266 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:40.090696 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-12cab7fa-72a0-4ce4-bc64-39b4d0c81266 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080707 Mar 03 02:52:40.091276 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1116/2190] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:40 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:52:40.191127 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3c66a93f-acc8-4e75-9f1f-51fbc3d1b26a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:40.191778 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3c66a93f-acc8-4e75-9f1f-51fbc3d1b26a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:40.198213 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3c66a93f-acc8-4e75-9f1f-51fbc3d1b26a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:40.198661 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3c66a93f-acc8-4e75-9f1f-51fbc3d1b26a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:40.199441 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3c66a93f-acc8-4e75-9f1f-51fbc3d1b26a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:40.199904 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3c66a93f-acc8-4e75-9f1f-51fbc3d1b26a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:40.369735 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7c1969a6-e69b-4b77-95fe-0cff1de4f2b0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:40.370563 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7c1969a6-e69b-4b77-95fe-0cff1de4f2b0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:40.376930 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c1969a6-e69b-4b77-95fe-0cff1de4f2b0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:40.377380 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c1969a6-e69b-4b77-95fe-0cff1de4f2b0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:40.378170 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c1969a6-e69b-4b77-95fe-0cff1de4f2b0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:40.378605 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c1969a6-e69b-4b77-95fe-0cff1de4f2b0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:40.457340 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3c66a93f-acc8-4e75-9f1f-51fbc3d1b26a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:40.465486 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3c66a93f-acc8-4e75-9f1f-51fbc3d1b26a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.278908 Mar 03 02:52:40.466467 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1075/2191] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:40 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:52:40.528771 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-7c1969a6-e69b-4b77-95fe-0cff1de4f2b0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:40.537472 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7c1969a6-e69b-4b77-95fe-0cff1de4f2b0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.171470 Mar 03 02:52:40.538062 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1117/2192] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:40 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:52:41.107960 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ae25f26b-4335-4a70-9bb7-18615396efdc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:41.108568 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ae25f26b-4335-4a70-9bb7-18615396efdc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:41.115982 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ae25f26b-4335-4a70-9bb7-18615396efdc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:41.116443 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ae25f26b-4335-4a70-9bb7-18615396efdc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:41.117234 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ae25f26b-4335-4a70-9bb7-18615396efdc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:41.117671 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ae25f26b-4335-4a70-9bb7-18615396efdc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:41.202320 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ae25f26b-4335-4a70-9bb7-18615396efdc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:41.210745 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ae25f26b-4335-4a70-9bb7-18615396efdc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.106842 Mar 03 02:52:41.211319 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1076/2193] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:41 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:52:41.482860 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-77b1b544-d077-4383-9d32-290fb80b9217 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:41.483442 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-77b1b544-d077-4383-9d32-290fb80b9217 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:41.490247 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-77b1b544-d077-4383-9d32-290fb80b9217 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:41.490694 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-77b1b544-d077-4383-9d32-290fb80b9217 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:41.491472 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-77b1b544-d077-4383-9d32-290fb80b9217 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:41.491963 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-77b1b544-d077-4383-9d32-290fb80b9217 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:41.554519 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-fcf8523b-eb5a-4204-9618-f549436ebb33 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:41.555430 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-fcf8523b-eb5a-4204-9618-f549436ebb33 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:41.561614 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fcf8523b-eb5a-4204-9618-f549436ebb33 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:41.562077 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fcf8523b-eb5a-4204-9618-f549436ebb33 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:41.563398 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fcf8523b-eb5a-4204-9618-f549436ebb33 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:41.563927 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fcf8523b-eb5a-4204-9618-f549436ebb33 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:41.632162 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-77b1b544-d077-4383-9d32-290fb80b9217 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:41.643330 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-77b1b544-d077-4383-9d32-290fb80b9217 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.164525 Mar 03 02:52:41.644030 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1118/2194] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:41 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:52:41.743858 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-fcf8523b-eb5a-4204-9618-f549436ebb33 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:41.752053 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-fcf8523b-eb5a-4204-9618-f549436ebb33 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.201519 Mar 03 02:52:41.752629 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1077/2195] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:41 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:52:42.227851 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-157fbd12-131d-4c63-97dd-0367b3d786e7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:42.228417 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-157fbd12-131d-4c63-97dd-0367b3d786e7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:42.234565 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-157fbd12-131d-4c63-97dd-0367b3d786e7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:42.235010 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-157fbd12-131d-4c63-97dd-0367b3d786e7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:42.235892 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-157fbd12-131d-4c63-97dd-0367b3d786e7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:42.236330 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-157fbd12-131d-4c63-97dd-0367b3d786e7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:42.304155 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-157fbd12-131d-4c63-97dd-0367b3d786e7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:42.313781 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-157fbd12-131d-4c63-97dd-0367b3d786e7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.089472 Mar 03 02:52:42.325924 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1119/2196] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:42 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:52:42.661655 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d01ce6a9-29dc-444d-8f39-a8b3838dbd97 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:42.662261 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d01ce6a9-29dc-444d-8f39-a8b3838dbd97 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:42.668369 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d01ce6a9-29dc-444d-8f39-a8b3838dbd97 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:42.668813 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d01ce6a9-29dc-444d-8f39-a8b3838dbd97 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:42.669580 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d01ce6a9-29dc-444d-8f39-a8b3838dbd97 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:42.670010 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d01ce6a9-29dc-444d-8f39-a8b3838dbd97 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:42.769987 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d024d0cf-c685-4d8c-bbf7-5d4a45718070 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:42.770604 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d024d0cf-c685-4d8c-bbf7-5d4a45718070 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:42.776945 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d024d0cf-c685-4d8c-bbf7-5d4a45718070 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:42.777397 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d024d0cf-c685-4d8c-bbf7-5d4a45718070 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:42.778186 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d024d0cf-c685-4d8c-bbf7-5d4a45718070 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:42.778620 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d024d0cf-c685-4d8c-bbf7-5d4a45718070 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:42.836123 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d01ce6a9-29dc-444d-8f39-a8b3838dbd97 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:42.844827 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d01ce6a9-29dc-444d-8f39-a8b3838dbd97 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.188434 Mar 03 02:52:42.845471 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1078/2197] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:42 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:52:42.914619 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d024d0cf-c685-4d8c-bbf7-5d4a45718070 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:42.923489 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d024d0cf-c685-4d8c-bbf7-5d4a45718070 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.157863 Mar 03 02:52:42.924177 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1120/2198] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:42 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:52:43.330735 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7e4e5407-f671-4859-b3f5-2b80fde0e39a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:43.331347 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7e4e5407-f671-4859-b3f5-2b80fde0e39a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:43.337046 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7e4e5407-f671-4859-b3f5-2b80fde0e39a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:43.337504 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7e4e5407-f671-4859-b3f5-2b80fde0e39a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:43.338291 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7e4e5407-f671-4859-b3f5-2b80fde0e39a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:43.338735 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7e4e5407-f671-4859-b3f5-2b80fde0e39a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:43.400597 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-7e4e5407-f671-4859-b3f5-2b80fde0e39a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:43.409661 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7e4e5407-f671-4859-b3f5-2b80fde0e39a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.083311 Mar 03 02:52:43.410245 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1079/2199] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:43 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:52:43.862689 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7c65caa6-1bbc-4619-97a9-b0203098efc6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:43.863283 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7c65caa6-1bbc-4619-97a9-b0203098efc6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:43.869596 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c65caa6-1bbc-4619-97a9-b0203098efc6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:43.870047 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c65caa6-1bbc-4619-97a9-b0203098efc6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:43.870851 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c65caa6-1bbc-4619-97a9-b0203098efc6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:43.871348 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c65caa6-1bbc-4619-97a9-b0203098efc6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:43.940199 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f50fc7ef-dd53-4472-8412-1df2aa718344 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:43.940911 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f50fc7ef-dd53-4472-8412-1df2aa718344 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:43.947092 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f50fc7ef-dd53-4472-8412-1df2aa718344 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:43.947793 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f50fc7ef-dd53-4472-8412-1df2aa718344 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:43.948751 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f50fc7ef-dd53-4472-8412-1df2aa718344 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:43.949197 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f50fc7ef-dd53-4472-8412-1df2aa718344 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:44.016231 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-7c65caa6-1bbc-4619-97a9-b0203098efc6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:44.024073 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7c65caa6-1bbc-4619-97a9-b0203098efc6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.166258 Mar 03 02:52:44.024648 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1121/2200] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:43 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:52:44.089446 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f50fc7ef-dd53-4472-8412-1df2aa718344 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:44.097567 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f50fc7ef-dd53-4472-8412-1df2aa718344 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.161229 Mar 03 02:52:44.098210 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1080/2201] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:43 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:52:44.426126 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d93d3e0b-4160-4258-baea-7a19c1134016 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:44.426731 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d93d3e0b-4160-4258-baea-7a19c1134016 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:44.432522 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d93d3e0b-4160-4258-baea-7a19c1134016 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:44.432967 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d93d3e0b-4160-4258-baea-7a19c1134016 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:44.433734 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d93d3e0b-4160-4258-baea-7a19c1134016 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:44.434167 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d93d3e0b-4160-4258-baea-7a19c1134016 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:44.495151 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d93d3e0b-4160-4258-baea-7a19c1134016 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:44.503769 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d93d3e0b-4160-4258-baea-7a19c1134016 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.081457 Mar 03 02:52:44.504323 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1122/2202] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:44 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:52:45.042026 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-800ac967-7b5e-40c6-b7c5-70956dea27cb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:45.042644 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-800ac967-7b5e-40c6-b7c5-70956dea27cb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:45.049704 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-800ac967-7b5e-40c6-b7c5-70956dea27cb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:45.050150 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-800ac967-7b5e-40c6-b7c5-70956dea27cb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:45.051016 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-800ac967-7b5e-40c6-b7c5-70956dea27cb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:45.051471 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-800ac967-7b5e-40c6-b7c5-70956dea27cb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:45.115294 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5e6c8f98-6965-4f1b-9fe9-e2b4e5d49a51 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:45.115928 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5e6c8f98-6965-4f1b-9fe9-e2b4e5d49a51 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:45.122309 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5e6c8f98-6965-4f1b-9fe9-e2b4e5d49a51 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:45.122757 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5e6c8f98-6965-4f1b-9fe9-e2b4e5d49a51 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:45.123531 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5e6c8f98-6965-4f1b-9fe9-e2b4e5d49a51 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:45.123990 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5e6c8f98-6965-4f1b-9fe9-e2b4e5d49a51 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:45.182051 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-800ac967-7b5e-40c6-b7c5-70956dea27cb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:45.190687 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-800ac967-7b5e-40c6-b7c5-70956dea27cb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.152472 Mar 03 02:52:45.191347 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1081/2203] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:45 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:52:45.256948 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5e6c8f98-6965-4f1b-9fe9-e2b4e5d49a51 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:45.264537 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5e6c8f98-6965-4f1b-9fe9-e2b4e5d49a51 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.153202 Mar 03 02:52:45.265105 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1123/2204] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:45 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:52:45.519643 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e3a04958-0e00-4ad7-8469-3eb7b75fa02e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:45.520262 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e3a04958-0e00-4ad7-8469-3eb7b75fa02e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:45.526122 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e3a04958-0e00-4ad7-8469-3eb7b75fa02e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:45.526581 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e3a04958-0e00-4ad7-8469-3eb7b75fa02e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:45.527355 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e3a04958-0e00-4ad7-8469-3eb7b75fa02e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:45.527894 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e3a04958-0e00-4ad7-8469-3eb7b75fa02e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:45.591072 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e3a04958-0e00-4ad7-8469-3eb7b75fa02e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:45.599325 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e3a04958-0e00-4ad7-8469-3eb7b75fa02e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.083548 Mar 03 02:52:45.599917 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1082/2205] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:45 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:52:46.208854 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ee741a15-a4da-4d7c-bfb2-378e7837b367 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:46.209390 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ee741a15-a4da-4d7c-bfb2-378e7837b367 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:46.215551 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ee741a15-a4da-4d7c-bfb2-378e7837b367 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:46.216032 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ee741a15-a4da-4d7c-bfb2-378e7837b367 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:46.216801 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ee741a15-a4da-4d7c-bfb2-378e7837b367 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:46.217232 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ee741a15-a4da-4d7c-bfb2-378e7837b367 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:46.280545 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-cdf7dc92-4087-4557-92f5-254cb2c4b5f4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:46.281702 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-cdf7dc92-4087-4557-92f5-254cb2c4b5f4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:46.288010 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cdf7dc92-4087-4557-92f5-254cb2c4b5f4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:46.288467 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cdf7dc92-4087-4557-92f5-254cb2c4b5f4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:46.289266 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cdf7dc92-4087-4557-92f5-254cb2c4b5f4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:46.289708 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cdf7dc92-4087-4557-92f5-254cb2c4b5f4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:46.348898 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ee741a15-a4da-4d7c-bfb2-378e7837b367 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:46.356567 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ee741a15-a4da-4d7c-bfb2-378e7837b367 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.151756 Mar 03 02:52:46.357133 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1124/2206] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:46 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:52:46.422285 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-cdf7dc92-4087-4557-92f5-254cb2c4b5f4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:46.429984 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-cdf7dc92-4087-4557-92f5-254cb2c4b5f4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.153323 Mar 03 02:52:46.430554 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1083/2207] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:46 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:52:46.617120 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0c3ec2b3-2aaf-45c4-9a6e-32b6cde79f01 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:46.617723 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0c3ec2b3-2aaf-45c4-9a6e-32b6cde79f01 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:46.623563 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0c3ec2b3-2aaf-45c4-9a6e-32b6cde79f01 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:46.624058 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0c3ec2b3-2aaf-45c4-9a6e-32b6cde79f01 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:46.624838 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0c3ec2b3-2aaf-45c4-9a6e-32b6cde79f01 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:46.625278 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0c3ec2b3-2aaf-45c4-9a6e-32b6cde79f01 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:46.685670 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0c3ec2b3-2aaf-45c4-9a6e-32b6cde79f01 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:46.693509 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0c3ec2b3-2aaf-45c4-9a6e-32b6cde79f01 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.081301 Mar 03 02:52:46.694072 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1125/2208] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:46 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:52:47.375664 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-add90f2e-8bec-4997-9d9f-96de0ccb6307 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:47.376284 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-add90f2e-8bec-4997-9d9f-96de0ccb6307 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:47.382486 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-add90f2e-8bec-4997-9d9f-96de0ccb6307 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:47.382937 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-add90f2e-8bec-4997-9d9f-96de0ccb6307 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:47.383812 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-add90f2e-8bec-4997-9d9f-96de0ccb6307 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:47.384252 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-add90f2e-8bec-4997-9d9f-96de0ccb6307 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:47.447076 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c41482f0-28c9-431d-8e9d-949205a05f61 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:47.447699 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c41482f0-28c9-431d-8e9d-949205a05f61 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:47.453888 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c41482f0-28c9-431d-8e9d-949205a05f61 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:47.454347 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c41482f0-28c9-431d-8e9d-949205a05f61 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:47.455131 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c41482f0-28c9-431d-8e9d-949205a05f61 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:47.455573 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c41482f0-28c9-431d-8e9d-949205a05f61 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:47.513728 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-add90f2e-8bec-4997-9d9f-96de0ccb6307 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:47.521608 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-add90f2e-8bec-4997-9d9f-96de0ccb6307 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.150459 Mar 03 02:52:47.522176 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1084/2209] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:47 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:52:47.585984 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c41482f0-28c9-431d-8e9d-949205a05f61 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:47.594449 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c41482f0-28c9-431d-8e9d-949205a05f61 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.150386 Mar 03 02:52:47.594879 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1126/2210] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:47 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:52:47.710099 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-82e430b1-d5db-40ef-8015-0d616cd7206d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:47.710630 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-82e430b1-d5db-40ef-8015-0d616cd7206d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:47.716428 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-82e430b1-d5db-40ef-8015-0d616cd7206d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:47.716869 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-82e430b1-d5db-40ef-8015-0d616cd7206d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:47.717633 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-82e430b1-d5db-40ef-8015-0d616cd7206d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:47.718060 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-82e430b1-d5db-40ef-8015-0d616cd7206d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:47.779716 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-82e430b1-d5db-40ef-8015-0d616cd7206d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:47.787844 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-82e430b1-d5db-40ef-8015-0d616cd7206d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.081677 Mar 03 02:52:47.788398 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1085/2211] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:47 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:52:48.539382 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-bd2cd9fb-3312-4a47-bf01-ba1775cd775e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:48.540051 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-bd2cd9fb-3312-4a47-bf01-ba1775cd775e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:48.546309 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bd2cd9fb-3312-4a47-bf01-ba1775cd775e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:48.546889 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bd2cd9fb-3312-4a47-bf01-ba1775cd775e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:48.547805 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bd2cd9fb-3312-4a47-bf01-ba1775cd775e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:48.548311 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bd2cd9fb-3312-4a47-bf01-ba1775cd775e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:48.611568 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4fa80582-d964-4d5c-a164-5c7fb61ffeb5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:48.612267 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4fa80582-d964-4d5c-a164-5c7fb61ffeb5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:48.618420 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4fa80582-d964-4d5c-a164-5c7fb61ffeb5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:48.618881 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4fa80582-d964-4d5c-a164-5c7fb61ffeb5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:48.619695 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4fa80582-d964-4d5c-a164-5c7fb61ffeb5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:48.620138 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4fa80582-d964-4d5c-a164-5c7fb61ffeb5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:48.679517 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-bd2cd9fb-3312-4a47-bf01-ba1775cd775e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:48.687263 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-bd2cd9fb-3312-4a47-bf01-ba1775cd775e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.151679 Mar 03 02:52:48.688636 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1127/2212] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:48 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:52:48.760856 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4fa80582-d964-4d5c-a164-5c7fb61ffeb5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:48.768596 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4fa80582-d964-4d5c-a164-5c7fb61ffeb5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.162258 Mar 03 02:52:48.769168 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1086/2213] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:48 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:52:48.804810 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9203de5f-f13c-449c-ba73-01a8d51efd23 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:48.805349 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9203de5f-f13c-449c-ba73-01a8d51efd23 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:48.811090 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9203de5f-f13c-449c-ba73-01a8d51efd23 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:48.811532 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9203de5f-f13c-449c-ba73-01a8d51efd23 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:48.812978 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9203de5f-f13c-449c-ba73-01a8d51efd23 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:48.813411 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9203de5f-f13c-449c-ba73-01a8d51efd23 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:48.876091 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9203de5f-f13c-449c-ba73-01a8d51efd23 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:48.883702 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9203de5f-f13c-449c-ba73-01a8d51efd23 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.082737 Mar 03 02:52:48.884259 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1128/2214] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:48 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:52:49.706126 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b3c9136a-6167-4082-9561-95a2b43ab919 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:49.706734 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b3c9136a-6167-4082-9561-95a2b43ab919 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:49.713240 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b3c9136a-6167-4082-9561-95a2b43ab919 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:49.713701 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b3c9136a-6167-4082-9561-95a2b43ab919 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:49.714478 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b3c9136a-6167-4082-9561-95a2b43ab919 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:49.715683 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b3c9136a-6167-4082-9561-95a2b43ab919 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:49.785338 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-88343e5b-d319-46a3-b1aa-08eab6783323 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:49.785939 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-88343e5b-d319-46a3-b1aa-08eab6783323 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:49.792466 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-88343e5b-d319-46a3-b1aa-08eab6783323 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:49.792912 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-88343e5b-d319-46a3-b1aa-08eab6783323 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:49.793685 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-88343e5b-d319-46a3-b1aa-08eab6783323 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:49.794113 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-88343e5b-d319-46a3-b1aa-08eab6783323 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:49.847953 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b3c9136a-6167-4082-9561-95a2b43ab919 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:49.855755 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b3c9136a-6167-4082-9561-95a2b43ab919 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.154451 Mar 03 02:52:49.856329 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1087/2215] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:49 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:52:49.899896 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8e75a8da-ddbf-4f66-8d28-bd978e3d8669 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:49.900504 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8e75a8da-ddbf-4f66-8d28-bd978e3d8669 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:49.906453 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8e75a8da-ddbf-4f66-8d28-bd978e3d8669 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:49.906904 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8e75a8da-ddbf-4f66-8d28-bd978e3d8669 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:49.907712 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8e75a8da-ddbf-4f66-8d28-bd978e3d8669 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:49.908150 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8e75a8da-ddbf-4f66-8d28-bd978e3d8669 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:49.927249 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-88343e5b-d319-46a3-b1aa-08eab6783323 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:49.934982 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-88343e5b-d319-46a3-b1aa-08eab6783323 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.153450 Mar 03 02:52:49.935555 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1129/2216] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:49 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:52:49.970879 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8e75a8da-ddbf-4f66-8d28-bd978e3d8669 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:49.978589 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8e75a8da-ddbf-4f66-8d28-bd978e3d8669 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.082497 Mar 03 02:52:49.979150 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1088/2217] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:49 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:52:50.164057 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0228bed2-ffdb-4490-b1cb-d6efdc4bef0e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:50.164549 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0228bed2-ffdb-4490-b1cb-d6efdc4bef0e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:50.170218 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0228bed2-ffdb-4490-b1cb-d6efdc4bef0e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:50.170669 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0228bed2-ffdb-4490-b1cb-d6efdc4bef0e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:50.172002 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0228bed2-ffdb-4490-b1cb-d6efdc4bef0e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:50.172592 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0228bed2-ffdb-4490-b1cb-d6efdc4bef0e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:50.196301 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0228bed2-ffdb-4490-b1cb-d6efdc4bef0e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Going to try to terminate instance {{(pid=116858) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 03 02:52:50.203716 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-563adb8b-9ff6-4f70-b314-d7bb9f239a34 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:50.204212 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-563adb8b-9ff6-4f70-b314-d7bb9f239a34 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:50.210204 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-563adb8b-9ff6-4f70-b314-d7bb9f239a34 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:50.211771 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-563adb8b-9ff6-4f70-b314-d7bb9f239a34 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:50.211771 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-563adb8b-9ff6-4f70-b314-d7bb9f239a34 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:50.211771 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-563adb8b-9ff6-4f70-b314-d7bb9f239a34 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:50.236647 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-563adb8b-9ff6-4f70-b314-d7bb9f239a34 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Going to try to terminate instance {{(pid=116859) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 03 02:52:50.242883 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.compute.api [None req-563adb8b-9ff6-4f70-b314-d7bb9f239a34 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Working on deleting snapshot 2f948944-33ce-4200-b673-40eb8ceb9e37 from shelved instance... Mar 03 02:52:50.273141 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0228bed2-ffdb-4490-b1cb-d6efdc4bef0e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "DELETE /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 204 len: 0 microversion: 2.1 time: 0.112523 Mar 03 02:52:50.276797 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1130/2218] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Mar 3 02:52:50 2022] DELETE /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 03 02:52:50.282476 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-fa24cb2e-5400-4d0a-8aaf-c6b2946c0ae7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:50.283827 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-fa24cb2e-5400-4d0a-8aaf-c6b2946c0ae7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:50.289255 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fa24cb2e-5400-4d0a-8aaf-c6b2946c0ae7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:50.289715 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fa24cb2e-5400-4d0a-8aaf-c6b2946c0ae7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:50.290503 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fa24cb2e-5400-4d0a-8aaf-c6b2946c0ae7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:50.290944 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fa24cb2e-5400-4d0a-8aaf-c6b2946c0ae7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:50.423140 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-fa24cb2e-5400-4d0a-8aaf-c6b2946c0ae7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:50.431012 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-fa24cb2e-5400-4d0a-8aaf-c6b2946c0ae7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.152907 Mar 03 02:52:50.431619 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1131/2219] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:50 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:52:50.873526 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0c6776dd-9850-463d-9fa5-d5544b544c72 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:50.874245 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0c6776dd-9850-463d-9fa5-d5544b544c72 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:50.881698 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0c6776dd-9850-463d-9fa5-d5544b544c72 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:50.882335 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0c6776dd-9850-463d-9fa5-d5544b544c72 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:50.883501 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0c6776dd-9850-463d-9fa5-d5544b544c72 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:50.884087 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0c6776dd-9850-463d-9fa5-d5544b544c72 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:50.892883 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-563adb8b-9ff6-4f70-b314-d7bb9f239a34 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Doing local delete in cell 056eea21-8cd3-453b-8bc6-a26b173c51c8(cell1) {{(pid=116859) _delete /opt/stack/nova/nova/compute/api.py:2489}} Mar 03 02:52:50.893694 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-563adb8b-9ff6-4f70-b314-d7bb9f239a34 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:50.894140 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-563adb8b-9ff6-4f70-b314-d7bb9f239a34 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:50.894566 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.compute.api [None req-563adb8b-9ff6-4f70-b314-d7bb9f239a34 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Mar 03 02:52:50.901218 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.network.neutron [None req-563adb8b-9ff6-4f70-b314-d7bb9f239a34 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] deallocate_for_instance() {{(pid=116859) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1789}} Mar 03 02:52:51.026494 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0c6776dd-9850-463d-9fa5-d5544b544c72 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:51.035082 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0c6776dd-9850-463d-9fa5-d5544b544c72 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.165374 Mar 03 02:52:51.035669 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1132/2220] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:50 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:52:51.040978 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ef9af27a-5d9f-42ef-90a5-b3ffeac398df tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:51.041578 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ef9af27a-5d9f-42ef-90a5-b3ffeac398df tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:51.047933 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ef9af27a-5d9f-42ef-90a5-b3ffeac398df tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:51.048372 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ef9af27a-5d9f-42ef-90a5-b3ffeac398df tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:51.049152 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ef9af27a-5d9f-42ef-90a5-b3ffeac398df tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:51.049586 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ef9af27a-5d9f-42ef-90a5-b3ffeac398df tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:51.186163 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ef9af27a-5d9f-42ef-90a5-b3ffeac398df tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:51.195850 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ef9af27a-5d9f-42ef-90a5-b3ffeac398df tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.158955 Mar 03 02:52:51.196441 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1133/2221] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:51 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:52:51.200986 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-80579373-6544-4282-afbb-e0626e2b416a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:51.201602 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-80579373-6544-4282-afbb-e0626e2b416a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:51.208244 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-80579373-6544-4282-afbb-e0626e2b416a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:51.208697 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-80579373-6544-4282-afbb-e0626e2b416a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:51.209489 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-80579373-6544-4282-afbb-e0626e2b416a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:51.209928 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-80579373-6544-4282-afbb-e0626e2b416a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:51.271592 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-80579373-6544-4282-afbb-e0626e2b416a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:51.279430 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-80579373-6544-4282-afbb-e0626e2b416a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.082014 Mar 03 02:52:51.280031 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1134/2222] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:51 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:52:51.449265 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-60f460c0-5773-4aa9-ab10-35e3bb60ab45 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:51.449797 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-60f460c0-5773-4aa9-ab10-35e3bb60ab45 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:51.455570 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-60f460c0-5773-4aa9-ab10-35e3bb60ab45 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:51.456061 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-60f460c0-5773-4aa9-ab10-35e3bb60ab45 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:51.456837 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-60f460c0-5773-4aa9-ab10-35e3bb60ab45 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:51.457272 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-60f460c0-5773-4aa9-ab10-35e3bb60ab45 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:51.852590 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-60f460c0-5773-4aa9-ab10-35e3bb60ab45 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:51.861135 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-60f460c0-5773-4aa9-ab10-35e3bb60ab45 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.415708 Mar 03 02:52:51.861940 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1135/2223] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:51 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:52:52.053012 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e2b055ba-1fe4-4062-8280-d33dcfc045bc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:52.054267 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e2b055ba-1fe4-4062-8280-d33dcfc045bc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:52.061165 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e2b055ba-1fe4-4062-8280-d33dcfc045bc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:52.061617 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e2b055ba-1fe4-4062-8280-d33dcfc045bc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:52.062972 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e2b055ba-1fe4-4062-8280-d33dcfc045bc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:52.063720 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e2b055ba-1fe4-4062-8280-d33dcfc045bc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:52.087122 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.network.neutron [None req-563adb8b-9ff6-4f70-b314-d7bb9f239a34 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Updating instance_info_cache with network_info: [] {{(pid=116859) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Mar 03 02:52:52.205175 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e2b055ba-1fe4-4062-8280-d33dcfc045bc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:52.213504 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e2b055ba-1fe4-4062-8280-d33dcfc045bc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.164404 Mar 03 02:52:52.214076 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1136/2224] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:52 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:52:52.334567 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [req-db100ec1-2706-473c-8cfa-9622f955a0b7 req-44b2a729-867d-450d-84b9-5dcd40d96763 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7a0db60-ea15-44e4-a1ca-41531a1aa5c3", "name": "network-vif-deleted", "tag": "9d68d852-474d-4287-a7c4-83666d7f71d4"}]} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:52:52.342406 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-db100ec1-2706-473c-8cfa-9622f955a0b7 req-44b2a729-867d-450d-84b9-5dcd40d96763 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:52.342856 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-db100ec1-2706-473c-8cfa-9622f955a0b7 req-44b2a729-867d-450d-84b9-5dcd40d96763 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:52.353862 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.compute.server_external_events [req-db100ec1-2706-473c-8cfa-9622f955a0b7 req-44b2a729-867d-450d-84b9-5dcd40d96763 service nova] Unable to find a host for instance f7a0db60-ea15-44e4-a1ca-41531a1aa5c3. Dropping event network-vif-deleted {{(pid=116858) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Mar 03 02:52:52.354738 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [req-db100ec1-2706-473c-8cfa-9622f955a0b7 req-44b2a729-867d-450d-84b9-5dcd40d96763 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.139756 Mar 03 02:52:52.355388 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1137/2225] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 141 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Mar 03 02:52:52.360753 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5203686d-68cd-4c66-adae-b8b4c4bace1d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:52.361355 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5203686d-68cd-4c66-adae-b8b4c4bace1d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:52.366862 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5203686d-68cd-4c66-adae-b8b4c4bace1d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:52.367311 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5203686d-68cd-4c66-adae-b8b4c4bace1d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:52.368127 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5203686d-68cd-4c66-adae-b8b4c4bace1d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:52.368571 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5203686d-68cd-4c66-adae-b8b4c4bace1d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:52.504127 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5203686d-68cd-4c66-adae-b8b4c4bace1d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:52.511912 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5203686d-68cd-4c66-adae-b8b4c4bace1d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.155460 Mar 03 02:52:52.512469 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1138/2226] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:52 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:52:52.517479 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-196ab34e-6ae1-44e9-b37e-b55e640ba0c8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:52.518436 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-196ab34e-6ae1-44e9-b37e-b55e640ba0c8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:52.524963 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-196ab34e-6ae1-44e9-b37e-b55e640ba0c8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:52.525437 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-196ab34e-6ae1-44e9-b37e-b55e640ba0c8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:52.526221 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-196ab34e-6ae1-44e9-b37e-b55e640ba0c8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:52.526665 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-196ab34e-6ae1-44e9-b37e-b55e640ba0c8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:52.586969 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-196ab34e-6ae1-44e9-b37e-b55e640ba0c8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:52.595625 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-196ab34e-6ae1-44e9-b37e-b55e640ba0c8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.082207 Mar 03 02:52:52.596198 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1139/2227] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:52 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:52:52.878973 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a1fba853-593a-4be9-bac0-0a09af34d6fa tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:52.879638 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a1fba853-593a-4be9-bac0-0a09af34d6fa tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:52.885634 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a1fba853-593a-4be9-bac0-0a09af34d6fa tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:52.886090 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a1fba853-593a-4be9-bac0-0a09af34d6fa tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:52.886899 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a1fba853-593a-4be9-bac0-0a09af34d6fa tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:52.887342 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a1fba853-593a-4be9-bac0-0a09af34d6fa tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:53.028771 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a1fba853-593a-4be9-bac0-0a09af34d6fa tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:53.036733 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a1fba853-593a-4be9-bac0-0a09af34d6fa tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.162248 Mar 03 02:52:53.037303 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1140/2228] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:52 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:52:53.230802 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0d6908e3-eca9-4827-95f6-70ba375b71a5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:53.231387 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0d6908e3-eca9-4827-95f6-70ba375b71a5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:53.238498 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0d6908e3-eca9-4827-95f6-70ba375b71a5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:53.238939 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0d6908e3-eca9-4827-95f6-70ba375b71a5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:53.239730 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0d6908e3-eca9-4827-95f6-70ba375b71a5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:53.240164 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0d6908e3-eca9-4827-95f6-70ba375b71a5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:53.374337 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0d6908e3-eca9-4827-95f6-70ba375b71a5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:53.382606 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0d6908e3-eca9-4827-95f6-70ba375b71a5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.155675 Mar 03 02:52:53.383172 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1141/2229] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:53 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:52:53.529657 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-be036029-2ca9-4c7d-8758-3149748b06ea tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:53.530266 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-be036029-2ca9-4c7d-8758-3149748b06ea tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:53.536615 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-be036029-2ca9-4c7d-8758-3149748b06ea tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:53.537070 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-be036029-2ca9-4c7d-8758-3149748b06ea tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:53.537846 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-be036029-2ca9-4c7d-8758-3149748b06ea tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:53.538286 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-be036029-2ca9-4c7d-8758-3149748b06ea tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:53.668971 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-be036029-2ca9-4c7d-8758-3149748b06ea tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:53.677715 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-be036029-2ca9-4c7d-8758-3149748b06ea tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.151860 Mar 03 02:52:53.678285 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1142/2230] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:53 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:52:53.682605 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-92904793-2f1d-4919-a2a1-b57574afd747 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:53.683202 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-92904793-2f1d-4919-a2a1-b57574afd747 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:53.689133 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-92904793-2f1d-4919-a2a1-b57574afd747 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:53.689604 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-92904793-2f1d-4919-a2a1-b57574afd747 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:53.690423 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-92904793-2f1d-4919-a2a1-b57574afd747 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:53.690863 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-92904793-2f1d-4919-a2a1-b57574afd747 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:53.753007 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-92904793-2f1d-4919-a2a1-b57574afd747 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:53.760643 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-92904793-2f1d-4919-a2a1-b57574afd747 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.081438 Mar 03 02:52:53.761203 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1143/2231] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:53 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:52:54.053167 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1acddd1e-b660-4a14-a2e6-f47a9a8906c0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:54.053653 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1acddd1e-b660-4a14-a2e6-f47a9a8906c0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:54.059813 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1acddd1e-b660-4a14-a2e6-f47a9a8906c0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:54.060258 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1acddd1e-b660-4a14-a2e6-f47a9a8906c0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:54.061054 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1acddd1e-b660-4a14-a2e6-f47a9a8906c0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:54.061485 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1acddd1e-b660-4a14-a2e6-f47a9a8906c0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:54.188762 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1acddd1e-b660-4a14-a2e6-f47a9a8906c0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:54.196300 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1acddd1e-b660-4a14-a2e6-f47a9a8906c0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.147060 Mar 03 02:52:54.196851 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1144/2232] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:54 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:52:54.398851 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e1bfb375-6064-44a1-bc07-428481232c23 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:54.399486 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e1bfb375-6064-44a1-bc07-428481232c23 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:54.405645 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e1bfb375-6064-44a1-bc07-428481232c23 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:54.406092 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e1bfb375-6064-44a1-bc07-428481232c23 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:54.406888 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e1bfb375-6064-44a1-bc07-428481232c23 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:54.407319 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e1bfb375-6064-44a1-bc07-428481232c23 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:54.535303 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e1bfb375-6064-44a1-bc07-428481232c23 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:54.542912 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e1bfb375-6064-44a1-bc07-428481232c23 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.147861 Mar 03 02:52:54.543475 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1145/2233] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:54 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:52:54.694558 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b241a8dc-4bbf-4ce5-80fd-1a222fd84172 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:54.695086 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b241a8dc-4bbf-4ce5-80fd-1a222fd84172 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:54.700800 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b241a8dc-4bbf-4ce5-80fd-1a222fd84172 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:54.701246 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b241a8dc-4bbf-4ce5-80fd-1a222fd84172 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:54.702008 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b241a8dc-4bbf-4ce5-80fd-1a222fd84172 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:54.702440 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b241a8dc-4bbf-4ce5-80fd-1a222fd84172 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:54.835729 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b241a8dc-4bbf-4ce5-80fd-1a222fd84172 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:54.843372 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b241a8dc-4bbf-4ce5-80fd-1a222fd84172 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.152592 Mar 03 02:52:54.844132 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1146/2234] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:54 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:52:54.848433 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4d8f5474-4ac5-40f6-8e15-004d8e54be91 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:54.849022 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4d8f5474-4ac5-40f6-8e15-004d8e54be91 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:54.854670 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4d8f5474-4ac5-40f6-8e15-004d8e54be91 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:54.855119 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4d8f5474-4ac5-40f6-8e15-004d8e54be91 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:54.855921 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4d8f5474-4ac5-40f6-8e15-004d8e54be91 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:54.856359 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4d8f5474-4ac5-40f6-8e15-004d8e54be91 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:54.914624 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4d8f5474-4ac5-40f6-8e15-004d8e54be91 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:54.922860 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4d8f5474-4ac5-40f6-8e15-004d8e54be91 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.077768 Mar 03 02:52:54.923426 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1147/2235] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:54 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:52:55.213989 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-45e7b206-72bc-4f8b-9373-b09f649ef9c5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:55.214595 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-45e7b206-72bc-4f8b-9373-b09f649ef9c5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:55.221291 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-45e7b206-72bc-4f8b-9373-b09f649ef9c5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:55.221744 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-45e7b206-72bc-4f8b-9373-b09f649ef9c5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:55.222519 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-45e7b206-72bc-4f8b-9373-b09f649ef9c5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:55.222957 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-45e7b206-72bc-4f8b-9373-b09f649ef9c5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:55.352107 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-45e7b206-72bc-4f8b-9373-b09f649ef9c5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:55.363410 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-45e7b206-72bc-4f8b-9373-b09f649ef9c5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.152144 Mar 03 02:52:55.364209 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1148/2236] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:55 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:52:55.560252 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2b07bd4c-85e0-445d-bafb-1c999d0044ec tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:55.560887 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2b07bd4c-85e0-445d-bafb-1c999d0044ec tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:55.566973 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2b07bd4c-85e0-445d-bafb-1c999d0044ec tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:55.567424 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2b07bd4c-85e0-445d-bafb-1c999d0044ec tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:55.568226 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2b07bd4c-85e0-445d-bafb-1c999d0044ec tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:55.568663 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2b07bd4c-85e0-445d-bafb-1c999d0044ec tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:55.700340 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2b07bd4c-85e0-445d-bafb-1c999d0044ec tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:55.708598 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2b07bd4c-85e0-445d-bafb-1c999d0044ec tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.152265 Mar 03 02:52:55.709155 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1149/2237] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:55 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:52:55.861201 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f99d3c08-4ecc-4467-b7e1-34fd43f5b6fa tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:55.861806 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f99d3c08-4ecc-4467-b7e1-34fd43f5b6fa tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:55.867730 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f99d3c08-4ecc-4467-b7e1-34fd43f5b6fa tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:55.868184 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f99d3c08-4ecc-4467-b7e1-34fd43f5b6fa tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:55.868969 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f99d3c08-4ecc-4467-b7e1-34fd43f5b6fa tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:55.869385 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f99d3c08-4ecc-4467-b7e1-34fd43f5b6fa tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:56.000142 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f99d3c08-4ecc-4467-b7e1-34fd43f5b6fa tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:56.008023 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f99d3c08-4ecc-4467-b7e1-34fd43f5b6fa tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.151524 Mar 03 02:52:56.008584 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1150/2238] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:55 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:52:56.013067 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f84cc1af-50b9-4f9d-83b7-6f7b284d397e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:56.013667 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f84cc1af-50b9-4f9d-83b7-6f7b284d397e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:56.019669 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f84cc1af-50b9-4f9d-83b7-6f7b284d397e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:56.020120 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f84cc1af-50b9-4f9d-83b7-6f7b284d397e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:56.020886 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f84cc1af-50b9-4f9d-83b7-6f7b284d397e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:56.021322 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f84cc1af-50b9-4f9d-83b7-6f7b284d397e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:56.084000 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f84cc1af-50b9-4f9d-83b7-6f7b284d397e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:56.091691 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f84cc1af-50b9-4f9d-83b7-6f7b284d397e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.082158 Mar 03 02:52:56.092266 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1151/2239] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:56 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:52:56.381791 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a297fc84-446b-43be-bfc6-ff0b2eb17a65 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:56.382438 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a297fc84-446b-43be-bfc6-ff0b2eb17a65 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:56.388259 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a297fc84-446b-43be-bfc6-ff0b2eb17a65 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:56.388712 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a297fc84-446b-43be-bfc6-ff0b2eb17a65 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:56.389484 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a297fc84-446b-43be-bfc6-ff0b2eb17a65 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:56.389929 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a297fc84-446b-43be-bfc6-ff0b2eb17a65 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:56.519529 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a297fc84-446b-43be-bfc6-ff0b2eb17a65 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:56.527176 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a297fc84-446b-43be-bfc6-ff0b2eb17a65 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.149217 Mar 03 02:52:56.527768 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1152/2240] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:56 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:52:56.725644 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d3fd4423-e8c8-44c1-be63-e7c2b54ce57d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:56.726256 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d3fd4423-e8c8-44c1-be63-e7c2b54ce57d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:56.732636 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d3fd4423-e8c8-44c1-be63-e7c2b54ce57d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:56.733089 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d3fd4423-e8c8-44c1-be63-e7c2b54ce57d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:56.734006 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d3fd4423-e8c8-44c1-be63-e7c2b54ce57d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:56.734452 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d3fd4423-e8c8-44c1-be63-e7c2b54ce57d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:56.865481 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d3fd4423-e8c8-44c1-be63-e7c2b54ce57d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:56.877358 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d3fd4423-e8c8-44c1-be63-e7c2b54ce57d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.155564 Mar 03 02:52:56.877928 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1153/2241] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:56 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:52:57.024838 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-76ed787f-d6e6-4767-9198-f1ffb6afc785 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:57.025368 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-76ed787f-d6e6-4767-9198-f1ffb6afc785 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:57.032141 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-76ed787f-d6e6-4767-9198-f1ffb6afc785 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:57.032592 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-76ed787f-d6e6-4767-9198-f1ffb6afc785 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:57.033396 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-76ed787f-d6e6-4767-9198-f1ffb6afc785 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:57.033830 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-76ed787f-d6e6-4767-9198-f1ffb6afc785 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:57.166288 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-76ed787f-d6e6-4767-9198-f1ffb6afc785 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:57.174414 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-76ed787f-d6e6-4767-9198-f1ffb6afc785 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.153424 Mar 03 02:52:57.174974 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1154/2242] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:57 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:52:57.179226 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-28cff54f-9b77-4404-a467-cf521b8b7018 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:57.179842 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-28cff54f-9b77-4404-a467-cf521b8b7018 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:57.185022 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-28cff54f-9b77-4404-a467-cf521b8b7018 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:57.185466 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-28cff54f-9b77-4404-a467-cf521b8b7018 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:57.186221 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-28cff54f-9b77-4404-a467-cf521b8b7018 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:57.186652 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-28cff54f-9b77-4404-a467-cf521b8b7018 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:57.244778 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-28cff54f-9b77-4404-a467-cf521b8b7018 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:57.252884 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-28cff54f-9b77-4404-a467-cf521b8b7018 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.076998 Mar 03 02:52:57.253444 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1155/2243] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:57 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:52:57.545377 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-645054ea-5109-431c-a02c-c3e88bb547e2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:57.545986 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-645054ea-5109-431c-a02c-c3e88bb547e2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:57.552872 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-645054ea-5109-431c-a02c-c3e88bb547e2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:57.553322 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-645054ea-5109-431c-a02c-c3e88bb547e2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:57.554097 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-645054ea-5109-431c-a02c-c3e88bb547e2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:57.554533 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-645054ea-5109-431c-a02c-c3e88bb547e2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:57.682423 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-645054ea-5109-431c-a02c-c3e88bb547e2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:57.690130 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-645054ea-5109-431c-a02c-c3e88bb547e2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.148657 Mar 03 02:52:57.690728 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1156/2244] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:57 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:52:57.893949 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7c761964-88d4-4c19-a6b2-dc024b5f5396 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:57.894555 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7c761964-88d4-4c19-a6b2-dc024b5f5396 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:57.900778 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c761964-88d4-4c19-a6b2-dc024b5f5396 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:57.901229 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c761964-88d4-4c19-a6b2-dc024b5f5396 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:57.902002 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c761964-88d4-4c19-a6b2-dc024b5f5396 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:57.902439 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c761964-88d4-4c19-a6b2-dc024b5f5396 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:58.037326 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-7c761964-88d4-4c19-a6b2-dc024b5f5396 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:58.045091 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7c761964-88d4-4c19-a6b2-dc024b5f5396 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.155676 Mar 03 02:52:58.045658 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1157/2245] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:57 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:52:58.191849 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e53a984e-178a-4d43-a933-78532f05d47c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:58.192385 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e53a984e-178a-4d43-a933-78532f05d47c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:58.198120 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e53a984e-178a-4d43-a933-78532f05d47c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:58.198570 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e53a984e-178a-4d43-a933-78532f05d47c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:58.199341 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e53a984e-178a-4d43-a933-78532f05d47c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:58.199808 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e53a984e-178a-4d43-a933-78532f05d47c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:58.329772 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e53a984e-178a-4d43-a933-78532f05d47c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:58.337374 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e53a984e-178a-4d43-a933-78532f05d47c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.149444 Mar 03 02:52:58.337940 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1158/2246] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:58 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:52:58.342441 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-815131d9-5520-43d3-9a5f-c15f9c83ff08 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:58.343067 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-815131d9-5520-43d3-9a5f-c15f9c83ff08 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:58.348421 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-815131d9-5520-43d3-9a5f-c15f9c83ff08 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:58.348889 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-815131d9-5520-43d3-9a5f-c15f9c83ff08 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:58.349649 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-815131d9-5520-43d3-9a5f-c15f9c83ff08 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:58.350076 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-815131d9-5520-43d3-9a5f-c15f9c83ff08 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:58.411840 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-815131d9-5520-43d3-9a5f-c15f9c83ff08 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:58.419502 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-815131d9-5520-43d3-9a5f-c15f9c83ff08 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080621 Mar 03 02:52:58.420091 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1159/2247] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:58 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:52:58.707338 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-da14fc40-b8f0-4fac-9162-1958839cb185 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:58.708014 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-da14fc40-b8f0-4fac-9162-1958839cb185 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:58.715811 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-da14fc40-b8f0-4fac-9162-1958839cb185 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:58.716270 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-da14fc40-b8f0-4fac-9162-1958839cb185 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:58.717050 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-da14fc40-b8f0-4fac-9162-1958839cb185 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:58.717489 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-da14fc40-b8f0-4fac-9162-1958839cb185 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:58.849629 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-da14fc40-b8f0-4fac-9162-1958839cb185 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:58.857213 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-da14fc40-b8f0-4fac-9162-1958839cb185 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.153844 Mar 03 02:52:58.858021 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1160/2248] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:58 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:52:59.062822 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-74778e75-91fd-49b2-bba3-b9cd5c591844 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:59.063431 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-74778e75-91fd-49b2-bba3-b9cd5c591844 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:59.069768 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-74778e75-91fd-49b2-bba3-b9cd5c591844 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:59.070220 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-74778e75-91fd-49b2-bba3-b9cd5c591844 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:59.070997 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-74778e75-91fd-49b2-bba3-b9cd5c591844 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:59.071431 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-74778e75-91fd-49b2-bba3-b9cd5c591844 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:59.199771 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-74778e75-91fd-49b2-bba3-b9cd5c591844 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:59.208312 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-74778e75-91fd-49b2-bba3-b9cd5c591844 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.149914 Mar 03 02:52:59.208879 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1161/2249] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:59 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:52:59.354158 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5e62b2c5-3de4-4f79-b5d8-c8b34d985b48 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:59.354776 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5e62b2c5-3de4-4f79-b5d8-c8b34d985b48 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:59.360832 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5e62b2c5-3de4-4f79-b5d8-c8b34d985b48 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:59.361285 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5e62b2c5-3de4-4f79-b5d8-c8b34d985b48 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:59.362059 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5e62b2c5-3de4-4f79-b5d8-c8b34d985b48 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:59.362501 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5e62b2c5-3de4-4f79-b5d8-c8b34d985b48 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:59.496577 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5e62b2c5-3de4-4f79-b5d8-c8b34d985b48 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:59.504768 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5e62b2c5-3de4-4f79-b5d8-c8b34d985b48 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.154461 Mar 03 02:52:59.505344 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1162/2250] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:59 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:52:59.509685 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b0563598-31e0-4d9f-88ec-194921ad80b5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:59.510287 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b0563598-31e0-4d9f-88ec-194921ad80b5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:59.516821 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b0563598-31e0-4d9f-88ec-194921ad80b5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:59.517279 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b0563598-31e0-4d9f-88ec-194921ad80b5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:59.518066 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b0563598-31e0-4d9f-88ec-194921ad80b5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:59.518511 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b0563598-31e0-4d9f-88ec-194921ad80b5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:59.576056 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b0563598-31e0-4d9f-88ec-194921ad80b5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:52:59.584580 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b0563598-31e0-4d9f-88ec-194921ad80b5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.078254 Mar 03 02:52:59.585165 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1163/2251] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:59 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:52:59.875252 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8a7503eb-8b6d-45d6-a849-992d7872d360 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:52:59.876085 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8a7503eb-8b6d-45d6-a849-992d7872d360 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:52:59.881944 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8a7503eb-8b6d-45d6-a849-992d7872d360 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:59.882386 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8a7503eb-8b6d-45d6-a849-992d7872d360 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:52:59.883194 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8a7503eb-8b6d-45d6-a849-992d7872d360 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:52:59.883647 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8a7503eb-8b6d-45d6-a849-992d7872d360 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:00.012050 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8a7503eb-8b6d-45d6-a849-992d7872d360 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:00.020047 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8a7503eb-8b6d-45d6-a849-992d7872d360 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.149078 Mar 03 02:53:00.020610 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1164/2252] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:52:59 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:00.225813 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-79292ea2-1db0-42ca-adb7-6b741448a0ee tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:00.226423 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-79292ea2-1db0-42ca-adb7-6b741448a0ee tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:00.232745 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-79292ea2-1db0-42ca-adb7-6b741448a0ee tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:00.233190 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-79292ea2-1db0-42ca-adb7-6b741448a0ee tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:00.234548 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-79292ea2-1db0-42ca-adb7-6b741448a0ee tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:00.234987 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-79292ea2-1db0-42ca-adb7-6b741448a0ee tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:00.367094 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-79292ea2-1db0-42ca-adb7-6b741448a0ee tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:00.374708 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-79292ea2-1db0-42ca-adb7-6b741448a0ee tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.152995 Mar 03 02:53:00.375260 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1165/2253] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:00 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:00.521825 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d62e43ef-97e9-4e3e-b45d-3bc7f6c7e952 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:00.522357 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d62e43ef-97e9-4e3e-b45d-3bc7f6c7e952 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:00.528327 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d62e43ef-97e9-4e3e-b45d-3bc7f6c7e952 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:00.528777 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d62e43ef-97e9-4e3e-b45d-3bc7f6c7e952 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:00.529555 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d62e43ef-97e9-4e3e-b45d-3bc7f6c7e952 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:00.529993 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d62e43ef-97e9-4e3e-b45d-3bc7f6c7e952 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:00.660935 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d62e43ef-97e9-4e3e-b45d-3bc7f6c7e952 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:00.668510 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d62e43ef-97e9-4e3e-b45d-3bc7f6c7e952 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.150461 Mar 03 02:53:00.669064 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1166/2254] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:00 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:00.673516 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-cf14bb72-08a4-4065-89e5-055a4d13ab83 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:00.674104 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-cf14bb72-08a4-4065-89e5-055a4d13ab83 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:00.679335 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cf14bb72-08a4-4065-89e5-055a4d13ab83 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:00.679822 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cf14bb72-08a4-4065-89e5-055a4d13ab83 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:00.680587 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cf14bb72-08a4-4065-89e5-055a4d13ab83 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:00.681017 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cf14bb72-08a4-4065-89e5-055a4d13ab83 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:00.742647 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-cf14bb72-08a4-4065-89e5-055a4d13ab83 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:00.750253 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-cf14bb72-08a4-4065-89e5-055a4d13ab83 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080266 Mar 03 02:53:00.750812 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1167/2255] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:00 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:01.037235 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f79b2dc0-9d0a-4559-a7d1-66df23e96f51 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:01.037853 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f79b2dc0-9d0a-4559-a7d1-66df23e96f51 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:01.043725 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f79b2dc0-9d0a-4559-a7d1-66df23e96f51 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:01.044181 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f79b2dc0-9d0a-4559-a7d1-66df23e96f51 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:01.044958 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f79b2dc0-9d0a-4559-a7d1-66df23e96f51 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:01.045401 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f79b2dc0-9d0a-4559-a7d1-66df23e96f51 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:01.174249 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f79b2dc0-9d0a-4559-a7d1-66df23e96f51 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:01.182298 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f79b2dc0-9d0a-4559-a7d1-66df23e96f51 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.148953 Mar 03 02:53:01.182868 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1168/2256] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:01 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:01.390895 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-fbf11489-ef63-4e24-9c6a-4ce470c3b1c1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:01.391530 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-fbf11489-ef63-4e24-9c6a-4ce470c3b1c1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:01.397736 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fbf11489-ef63-4e24-9c6a-4ce470c3b1c1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:01.398181 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fbf11489-ef63-4e24-9c6a-4ce470c3b1c1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:01.398951 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fbf11489-ef63-4e24-9c6a-4ce470c3b1c1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:01.399384 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fbf11489-ef63-4e24-9c6a-4ce470c3b1c1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:01.530733 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-fbf11489-ef63-4e24-9c6a-4ce470c3b1c1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:01.538549 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-fbf11489-ef63-4e24-9c6a-4ce470c3b1c1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.151772 Mar 03 02:53:01.539115 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1169/2257] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:01 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:01.685667 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-44e620be-713a-46f5-bc97-d1d13950b4df tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:01.686193 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-44e620be-713a-46f5-bc97-d1d13950b4df tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:01.692483 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-44e620be-713a-46f5-bc97-d1d13950b4df tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:01.692933 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-44e620be-713a-46f5-bc97-d1d13950b4df tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:01.693701 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-44e620be-713a-46f5-bc97-d1d13950b4df tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:01.694138 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-44e620be-713a-46f5-bc97-d1d13950b4df tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:01.831475 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-44e620be-713a-46f5-bc97-d1d13950b4df tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:01.839181 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-44e620be-713a-46f5-bc97-d1d13950b4df tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.157448 Mar 03 02:53:01.839785 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1170/2258] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:01 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:01.847774 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ad14d782-4284-422e-826a-5c4c42c7b8d6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:01.848377 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ad14d782-4284-422e-826a-5c4c42c7b8d6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:01.853788 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ad14d782-4284-422e-826a-5c4c42c7b8d6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:01.854230 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ad14d782-4284-422e-826a-5c4c42c7b8d6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:01.855035 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ad14d782-4284-422e-826a-5c4c42c7b8d6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:01.855496 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ad14d782-4284-422e-826a-5c4c42c7b8d6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:01.916420 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ad14d782-4284-422e-826a-5c4c42c7b8d6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:01.924385 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ad14d782-4284-422e-826a-5c4c42c7b8d6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.083672 Mar 03 02:53:01.924942 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1171/2259] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:01 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:02.200435 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-35f560c9-5a3a-41d0-956a-ddc903921c3a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:02.201037 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-35f560c9-5a3a-41d0-956a-ddc903921c3a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:02.206965 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-35f560c9-5a3a-41d0-956a-ddc903921c3a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:02.207410 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-35f560c9-5a3a-41d0-956a-ddc903921c3a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:02.208202 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-35f560c9-5a3a-41d0-956a-ddc903921c3a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:02.208639 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-35f560c9-5a3a-41d0-956a-ddc903921c3a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:02.335461 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-35f560c9-5a3a-41d0-956a-ddc903921c3a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:02.343566 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-35f560c9-5a3a-41d0-956a-ddc903921c3a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.146526 Mar 03 02:53:02.344147 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1172/2260] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:02 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:02.556245 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-dbd1092b-0b7c-4382-919d-1f657ac98c16 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:02.556882 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-dbd1092b-0b7c-4382-919d-1f657ac98c16 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:02.563767 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dbd1092b-0b7c-4382-919d-1f657ac98c16 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:02.564224 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dbd1092b-0b7c-4382-919d-1f657ac98c16 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:02.565003 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dbd1092b-0b7c-4382-919d-1f657ac98c16 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:02.565441 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dbd1092b-0b7c-4382-919d-1f657ac98c16 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:02.703718 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-dbd1092b-0b7c-4382-919d-1f657ac98c16 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:02.711516 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-dbd1092b-0b7c-4382-919d-1f657ac98c16 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.159137 Mar 03 02:53:02.712327 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1173/2261] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:02 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:02.855199 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0ec3356b-f5e0-4448-ab4d-95a593bc455f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:02.855835 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0ec3356b-f5e0-4448-ab4d-95a593bc455f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:02.862420 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0ec3356b-f5e0-4448-ab4d-95a593bc455f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:02.862864 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0ec3356b-f5e0-4448-ab4d-95a593bc455f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:02.863649 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0ec3356b-f5e0-4448-ab4d-95a593bc455f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:02.864086 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0ec3356b-f5e0-4448-ab4d-95a593bc455f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:02.993008 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0ec3356b-f5e0-4448-ab4d-95a593bc455f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:03.001503 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0ec3356b-f5e0-4448-ab4d-95a593bc455f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.150055 Mar 03 02:53:03.002242 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1174/2262] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:02 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:03.006717 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-12d3ad21-b118-42b3-973c-cab7c3674604 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:03.007316 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-12d3ad21-b118-42b3-973c-cab7c3674604 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:03.013125 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-12d3ad21-b118-42b3-973c-cab7c3674604 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:03.013578 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-12d3ad21-b118-42b3-973c-cab7c3674604 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:03.014358 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-12d3ad21-b118-42b3-973c-cab7c3674604 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:03.014810 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-12d3ad21-b118-42b3-973c-cab7c3674604 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:03.077370 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-12d3ad21-b118-42b3-973c-cab7c3674604 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:03.085207 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-12d3ad21-b118-42b3-973c-cab7c3674604 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.082031 Mar 03 02:53:03.085764 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1175/2263] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:03 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:03.360380 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-24339b82-b5d1-4048-ba62-e641536bc239 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:03.360985 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-24339b82-b5d1-4048-ba62-e641536bc239 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:03.367401 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-24339b82-b5d1-4048-ba62-e641536bc239 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:03.367887 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-24339b82-b5d1-4048-ba62-e641536bc239 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:03.368654 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-24339b82-b5d1-4048-ba62-e641536bc239 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:03.369084 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-24339b82-b5d1-4048-ba62-e641536bc239 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:03.496203 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-24339b82-b5d1-4048-ba62-e641536bc239 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:03.503872 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-24339b82-b5d1-4048-ba62-e641536bc239 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.147518 Mar 03 02:53:03.504434 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1176/2264] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:03 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:03.729114 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-07c8d614-0383-4c4e-b2df-7d69fee1387a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:03.729749 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-07c8d614-0383-4c4e-b2df-7d69fee1387a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:03.736075 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-07c8d614-0383-4c4e-b2df-7d69fee1387a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:03.736517 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-07c8d614-0383-4c4e-b2df-7d69fee1387a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:03.737281 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-07c8d614-0383-4c4e-b2df-7d69fee1387a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:03.737711 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-07c8d614-0383-4c4e-b2df-7d69fee1387a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:03.868670 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-07c8d614-0383-4c4e-b2df-7d69fee1387a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:03.876499 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-07c8d614-0383-4c4e-b2df-7d69fee1387a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.151340 Mar 03 02:53:03.877297 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1177/2265] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:03 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:04.019009 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e2fb43cc-8392-4765-a766-8336e7ef3695 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:04.019526 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e2fb43cc-8392-4765-a766-8336e7ef3695 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:04.025321 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e2fb43cc-8392-4765-a766-8336e7ef3695 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:04.025766 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e2fb43cc-8392-4765-a766-8336e7ef3695 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:04.026528 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e2fb43cc-8392-4765-a766-8336e7ef3695 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:04.026964 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e2fb43cc-8392-4765-a766-8336e7ef3695 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:04.160220 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e2fb43cc-8392-4765-a766-8336e7ef3695 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:04.168096 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e2fb43cc-8392-4765-a766-8336e7ef3695 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.153728 Mar 03 02:53:04.168667 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1178/2266] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:04 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:04.173433 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d484382f-fa26-44b2-af98-d33154a1217b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:04.174035 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d484382f-fa26-44b2-af98-d33154a1217b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:04.179323 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d484382f-fa26-44b2-af98-d33154a1217b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:04.179818 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d484382f-fa26-44b2-af98-d33154a1217b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:04.180597 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d484382f-fa26-44b2-af98-d33154a1217b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:04.181030 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d484382f-fa26-44b2-af98-d33154a1217b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:04.239242 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d484382f-fa26-44b2-af98-d33154a1217b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:04.246842 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d484382f-fa26-44b2-af98-d33154a1217b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.077252 Mar 03 02:53:04.247399 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1179/2267] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:04 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:04.520802 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f385310b-912c-46dd-9915-65d877372e1d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:04.521401 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f385310b-912c-46dd-9915-65d877372e1d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:04.527227 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f385310b-912c-46dd-9915-65d877372e1d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:04.527708 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f385310b-912c-46dd-9915-65d877372e1d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:04.528484 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f385310b-912c-46dd-9915-65d877372e1d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:04.528921 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f385310b-912c-46dd-9915-65d877372e1d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:04.660300 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f385310b-912c-46dd-9915-65d877372e1d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:04.668008 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f385310b-912c-46dd-9915-65d877372e1d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.150977 Mar 03 02:53:04.668569 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1180/2268] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:04 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:04.893918 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b55c1d2c-078b-4bc2-8dd1-70e22e3d8db5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:04.894597 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b55c1d2c-078b-4bc2-8dd1-70e22e3d8db5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:04.901137 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b55c1d2c-078b-4bc2-8dd1-70e22e3d8db5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:04.901591 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b55c1d2c-078b-4bc2-8dd1-70e22e3d8db5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:04.902529 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b55c1d2c-078b-4bc2-8dd1-70e22e3d8db5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:04.902972 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b55c1d2c-078b-4bc2-8dd1-70e22e3d8db5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:05.037651 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b55c1d2c-078b-4bc2-8dd1-70e22e3d8db5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:05.045327 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b55c1d2c-078b-4bc2-8dd1-70e22e3d8db5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.155823 Mar 03 02:53:05.045885 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1181/2269] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:04 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:05.185382 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-82a0e467-2a71-4068-bda7-79774aece4af tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:05.185910 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-82a0e467-2a71-4068-bda7-79774aece4af tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:05.194951 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-82a0e467-2a71-4068-bda7-79774aece4af tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:05.195410 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-82a0e467-2a71-4068-bda7-79774aece4af tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:05.196246 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-82a0e467-2a71-4068-bda7-79774aece4af tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:05.196698 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-82a0e467-2a71-4068-bda7-79774aece4af tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:05.325780 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-82a0e467-2a71-4068-bda7-79774aece4af tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:05.333416 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-82a0e467-2a71-4068-bda7-79774aece4af tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.152018 Mar 03 02:53:05.333982 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1182/2270] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:05 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:05.338252 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-32d7dd0b-f177-43e4-967f-77f60feb34ba tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:05.338839 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-32d7dd0b-f177-43e4-967f-77f60feb34ba tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:05.344135 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-32d7dd0b-f177-43e4-967f-77f60feb34ba tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:05.344578 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-32d7dd0b-f177-43e4-967f-77f60feb34ba tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:05.345338 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-32d7dd0b-f177-43e4-967f-77f60feb34ba tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:05.345766 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-32d7dd0b-f177-43e4-967f-77f60feb34ba tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:05.407059 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-32d7dd0b-f177-43e4-967f-77f60feb34ba tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:05.414587 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-32d7dd0b-f177-43e4-967f-77f60feb34ba tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079692 Mar 03 02:53:05.415150 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1183/2271] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:05 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:05.690884 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0117aa48-5303-4793-beee-55198a8c50e2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:05.691488 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0117aa48-5303-4793-beee-55198a8c50e2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:05.697284 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0117aa48-5303-4793-beee-55198a8c50e2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:05.697737 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0117aa48-5303-4793-beee-55198a8c50e2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:05.698507 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0117aa48-5303-4793-beee-55198a8c50e2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:05.698944 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0117aa48-5303-4793-beee-55198a8c50e2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:05.829122 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0117aa48-5303-4793-beee-55198a8c50e2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:05.836824 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0117aa48-5303-4793-beee-55198a8c50e2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.149916 Mar 03 02:53:05.837388 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1184/2272] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:05 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:06.063082 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4d500cd0-e8c0-4bc7-9297-03f743a88cfe tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:06.063702 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4d500cd0-e8c0-4bc7-9297-03f743a88cfe tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:06.069875 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4d500cd0-e8c0-4bc7-9297-03f743a88cfe tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:06.070319 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4d500cd0-e8c0-4bc7-9297-03f743a88cfe tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:06.071089 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4d500cd0-e8c0-4bc7-9297-03f743a88cfe tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:06.071522 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4d500cd0-e8c0-4bc7-9297-03f743a88cfe tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:06.199695 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4d500cd0-e8c0-4bc7-9297-03f743a88cfe tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:06.207339 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4d500cd0-e8c0-4bc7-9297-03f743a88cfe tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.148773 Mar 03 02:53:06.207939 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1185/2273] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:06 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:06.349908 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8059e486-0427-48c0-9f1a-48ac751b965d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:06.350514 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8059e486-0427-48c0-9f1a-48ac751b965d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:06.356267 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8059e486-0427-48c0-9f1a-48ac751b965d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:06.356718 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8059e486-0427-48c0-9f1a-48ac751b965d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:06.357769 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8059e486-0427-48c0-9f1a-48ac751b965d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:06.358203 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8059e486-0427-48c0-9f1a-48ac751b965d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:06.496229 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8059e486-0427-48c0-9f1a-48ac751b965d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:06.504416 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8059e486-0427-48c0-9f1a-48ac751b965d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.158204 Mar 03 02:53:06.505009 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1186/2274] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:06 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:06.509463 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-077a6768-ee11-4619-9fe6-76f0a8585671 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:06.510059 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-077a6768-ee11-4619-9fe6-76f0a8585671 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:06.515406 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-077a6768-ee11-4619-9fe6-76f0a8585671 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:06.515882 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-077a6768-ee11-4619-9fe6-76f0a8585671 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:06.516655 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-077a6768-ee11-4619-9fe6-76f0a8585671 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:06.517090 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-077a6768-ee11-4619-9fe6-76f0a8585671 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:06.575580 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-077a6768-ee11-4619-9fe6-76f0a8585671 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:06.583247 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-077a6768-ee11-4619-9fe6-76f0a8585671 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.077247 Mar 03 02:53:06.583916 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1187/2275] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:06 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:06.854454 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-055058f5-51a6-4e12-b9c7-f2e0cf61231c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:06.855087 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-055058f5-51a6-4e12-b9c7-f2e0cf61231c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:06.861918 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-055058f5-51a6-4e12-b9c7-f2e0cf61231c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:06.862365 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-055058f5-51a6-4e12-b9c7-f2e0cf61231c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:06.863128 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-055058f5-51a6-4e12-b9c7-f2e0cf61231c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:06.863563 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-055058f5-51a6-4e12-b9c7-f2e0cf61231c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:06.992035 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-055058f5-51a6-4e12-b9c7-f2e0cf61231c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:07.000439 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-055058f5-51a6-4e12-b9c7-f2e0cf61231c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.149810 Mar 03 02:53:07.001005 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1188/2276] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:06 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:07.224256 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8360d11d-9257-4749-8e37-faac96ae889a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:07.224842 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8360d11d-9257-4749-8e37-faac96ae889a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:07.230992 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8360d11d-9257-4749-8e37-faac96ae889a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:07.231448 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8360d11d-9257-4749-8e37-faac96ae889a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:07.232504 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8360d11d-9257-4749-8e37-faac96ae889a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:07.232943 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8360d11d-9257-4749-8e37-faac96ae889a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:07.368344 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8360d11d-9257-4749-8e37-faac96ae889a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:07.376603 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8360d11d-9257-4749-8e37-faac96ae889a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.156228 Mar 03 02:53:07.377171 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1189/2277] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:07 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:07.521144 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-21eadd36-92b7-4392-8f36-561e54504391 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:07.521678 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-21eadd36-92b7-4392-8f36-561e54504391 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:07.527392 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-21eadd36-92b7-4392-8f36-561e54504391 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:07.527870 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-21eadd36-92b7-4392-8f36-561e54504391 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:07.528632 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-21eadd36-92b7-4392-8f36-561e54504391 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:07.529065 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-21eadd36-92b7-4392-8f36-561e54504391 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:07.656739 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-21eadd36-92b7-4392-8f36-561e54504391 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:07.664388 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-21eadd36-92b7-4392-8f36-561e54504391 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.146957 Mar 03 02:53:07.665447 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1190/2278] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:07 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:07.669746 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-90591922-4aa7-40d4-a61a-4dba93151f2d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:07.670341 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-90591922-4aa7-40d4-a61a-4dba93151f2d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:07.676697 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-90591922-4aa7-40d4-a61a-4dba93151f2d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:07.677148 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-90591922-4aa7-40d4-a61a-4dba93151f2d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:07.677920 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-90591922-4aa7-40d4-a61a-4dba93151f2d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:07.678355 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-90591922-4aa7-40d4-a61a-4dba93151f2d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:07.741599 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-90591922-4aa7-40d4-a61a-4dba93151f2d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:07.750525 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-90591922-4aa7-40d4-a61a-4dba93151f2d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.083103 Mar 03 02:53:07.751087 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1191/2279] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:07 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:08.017754 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7c7d289b-6c64-4abc-86dd-b47a98f26813 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:08.018355 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7c7d289b-6c64-4abc-86dd-b47a98f26813 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:08.024207 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c7d289b-6c64-4abc-86dd-b47a98f26813 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:08.024656 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c7d289b-6c64-4abc-86dd-b47a98f26813 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:08.025420 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c7d289b-6c64-4abc-86dd-b47a98f26813 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:08.025851 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c7d289b-6c64-4abc-86dd-b47a98f26813 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:08.154661 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-7c7d289b-6c64-4abc-86dd-b47a98f26813 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:08.162909 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7c7d289b-6c64-4abc-86dd-b47a98f26813 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.149036 Mar 03 02:53:08.163471 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1192/2280] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:08 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:08.393982 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4c93bf3e-2509-4bbb-98ca-c51d9f13e6ef tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:08.394655 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4c93bf3e-2509-4bbb-98ca-c51d9f13e6ef tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:08.400796 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4c93bf3e-2509-4bbb-98ca-c51d9f13e6ef tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:08.401252 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4c93bf3e-2509-4bbb-98ca-c51d9f13e6ef tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:08.402030 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4c93bf3e-2509-4bbb-98ca-c51d9f13e6ef tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:08.402468 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4c93bf3e-2509-4bbb-98ca-c51d9f13e6ef tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:08.530199 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4c93bf3e-2509-4bbb-98ca-c51d9f13e6ef tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:08.537859 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4c93bf3e-2509-4bbb-98ca-c51d9f13e6ef tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.148256 Mar 03 02:53:08.538417 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1193/2281] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:08 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:08.682241 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b1ff5917-560b-49a3-be98-55cd7ce6a6f5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:08.682771 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b1ff5917-560b-49a3-be98-55cd7ce6a6f5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:08.689581 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b1ff5917-560b-49a3-be98-55cd7ce6a6f5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:08.690034 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b1ff5917-560b-49a3-be98-55cd7ce6a6f5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:08.690808 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b1ff5917-560b-49a3-be98-55cd7ce6a6f5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:08.691248 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b1ff5917-560b-49a3-be98-55cd7ce6a6f5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:08.824432 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b1ff5917-560b-49a3-be98-55cd7ce6a6f5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:08.832821 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b1ff5917-560b-49a3-be98-55cd7ce6a6f5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.154516 Mar 03 02:53:08.833384 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1194/2282] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:08 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:08.837855 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6b7c7489-50a2-4a72-b13c-b0522743e4b3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:08.838453 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6b7c7489-50a2-4a72-b13c-b0522743e4b3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:08.843805 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6b7c7489-50a2-4a72-b13c-b0522743e4b3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:08.844262 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6b7c7489-50a2-4a72-b13c-b0522743e4b3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:08.845035 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6b7c7489-50a2-4a72-b13c-b0522743e4b3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:08.845478 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6b7c7489-50a2-4a72-b13c-b0522743e4b3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:08.903516 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6b7c7489-50a2-4a72-b13c-b0522743e4b3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:08.911305 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6b7c7489-50a2-4a72-b13c-b0522743e4b3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.076995 Mar 03 02:53:08.911893 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1195/2283] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:08 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:09.180353 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f89bd010-604b-4b80-bd0e-7ba0677016c8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:09.180956 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f89bd010-604b-4b80-bd0e-7ba0677016c8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:09.187479 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f89bd010-604b-4b80-bd0e-7ba0677016c8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:09.187947 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f89bd010-604b-4b80-bd0e-7ba0677016c8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:09.188718 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f89bd010-604b-4b80-bd0e-7ba0677016c8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:09.189155 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f89bd010-604b-4b80-bd0e-7ba0677016c8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:09.319986 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f89bd010-604b-4b80-bd0e-7ba0677016c8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:09.328137 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f89bd010-604b-4b80-bd0e-7ba0677016c8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.151049 Mar 03 02:53:09.328707 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1196/2284] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:09 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:09.555305 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-06414666-eb5c-4246-b20d-2b53556d2cca tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:09.555966 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-06414666-eb5c-4246-b20d-2b53556d2cca tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:09.562456 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-06414666-eb5c-4246-b20d-2b53556d2cca tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:09.562911 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-06414666-eb5c-4246-b20d-2b53556d2cca tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:09.563727 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-06414666-eb5c-4246-b20d-2b53556d2cca tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:09.564164 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-06414666-eb5c-4246-b20d-2b53556d2cca tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:09.695351 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-06414666-eb5c-4246-b20d-2b53556d2cca tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:09.703938 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-06414666-eb5c-4246-b20d-2b53556d2cca tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.152318 Mar 03 02:53:09.704504 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1197/2285] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:09 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:09.849499 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ea329b17-e232-4579-a4e2-aeeb09d7486f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:09.850102 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ea329b17-e232-4579-a4e2-aeeb09d7486f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:09.855892 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ea329b17-e232-4579-a4e2-aeeb09d7486f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:09.856339 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ea329b17-e232-4579-a4e2-aeeb09d7486f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:09.857107 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ea329b17-e232-4579-a4e2-aeeb09d7486f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:09.857800 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ea329b17-e232-4579-a4e2-aeeb09d7486f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:09.987785 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ea329b17-e232-4579-a4e2-aeeb09d7486f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:09.995278 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ea329b17-e232-4579-a4e2-aeeb09d7486f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.149725 Mar 03 02:53:09.995891 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1198/2286] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:09 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:10.002526 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-be0097a1-a7c2-4d2a-a9e9-18302da3db21 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:10.003125 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-be0097a1-a7c2-4d2a-a9e9-18302da3db21 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:10.008966 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-be0097a1-a7c2-4d2a-a9e9-18302da3db21 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:10.009419 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-be0097a1-a7c2-4d2a-a9e9-18302da3db21 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:10.010225 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-be0097a1-a7c2-4d2a-a9e9-18302da3db21 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:10.010691 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-be0097a1-a7c2-4d2a-a9e9-18302da3db21 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:10.073973 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-be0097a1-a7c2-4d2a-a9e9-18302da3db21 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:10.082255 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-be0097a1-a7c2-4d2a-a9e9-18302da3db21 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.083974 Mar 03 02:53:10.082802 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1199/2287] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:09 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:10.345500 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2f8c0447-c079-481f-bea4-b252c36af9c9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:10.346113 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2f8c0447-c079-481f-bea4-b252c36af9c9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:10.352019 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2f8c0447-c079-481f-bea4-b252c36af9c9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:10.352471 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2f8c0447-c079-481f-bea4-b252c36af9c9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:10.353231 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2f8c0447-c079-481f-bea4-b252c36af9c9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:10.353666 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2f8c0447-c079-481f-bea4-b252c36af9c9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:10.484586 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2f8c0447-c079-481f-bea4-b252c36af9c9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:10.492200 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2f8c0447-c079-481f-bea4-b252c36af9c9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.150640 Mar 03 02:53:10.492764 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1200/2288] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:10 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:10.720838 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-00243054-7333-487f-b7fe-125cd43796c9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:10.721490 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-00243054-7333-487f-b7fe-125cd43796c9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:10.727702 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-00243054-7333-487f-b7fe-125cd43796c9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:10.728148 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-00243054-7333-487f-b7fe-125cd43796c9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:10.728912 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-00243054-7333-487f-b7fe-125cd43796c9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:10.729344 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-00243054-7333-487f-b7fe-125cd43796c9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:10.859627 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-00243054-7333-487f-b7fe-125cd43796c9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:10.867243 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-00243054-7333-487f-b7fe-125cd43796c9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.150799 Mar 03 02:53:10.867848 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1201/2289] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:10 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:11.012874 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-457b508d-9438-4bd9-bc43-829bb20cf6da tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:11.013410 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-457b508d-9438-4bd9-bc43-829bb20cf6da tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:11.019884 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-457b508d-9438-4bd9-bc43-829bb20cf6da tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:11.020333 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-457b508d-9438-4bd9-bc43-829bb20cf6da tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:11.021107 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-457b508d-9438-4bd9-bc43-829bb20cf6da tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:11.021544 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-457b508d-9438-4bd9-bc43-829bb20cf6da tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:11.153293 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-457b508d-9438-4bd9-bc43-829bb20cf6da tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:11.161461 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-457b508d-9438-4bd9-bc43-829bb20cf6da tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.152428 Mar 03 02:53:11.162023 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1202/2290] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:11 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:11.166462 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b1ea7718-246f-41e6-84b3-9d2663307d5c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:11.167060 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b1ea7718-246f-41e6-84b3-9d2663307d5c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:11.173383 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b1ea7718-246f-41e6-84b3-9d2663307d5c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:11.173835 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b1ea7718-246f-41e6-84b3-9d2663307d5c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:11.174604 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b1ea7718-246f-41e6-84b3-9d2663307d5c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:11.175039 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b1ea7718-246f-41e6-84b3-9d2663307d5c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:11.235288 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b1ea7718-246f-41e6-84b3-9d2663307d5c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:11.243200 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b1ea7718-246f-41e6-84b3-9d2663307d5c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080242 Mar 03 02:53:11.243794 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1203/2291] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:11 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:11.509044 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-890b3520-0cb1-40e6-a227-ee459e5ca80e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:11.509638 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-890b3520-0cb1-40e6-a227-ee459e5ca80e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:11.516085 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-890b3520-0cb1-40e6-a227-ee459e5ca80e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:11.516532 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-890b3520-0cb1-40e6-a227-ee459e5ca80e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:11.517297 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-890b3520-0cb1-40e6-a227-ee459e5ca80e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:11.517727 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-890b3520-0cb1-40e6-a227-ee459e5ca80e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:11.644956 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-890b3520-0cb1-40e6-a227-ee459e5ca80e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:11.652674 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-890b3520-0cb1-40e6-a227-ee459e5ca80e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.147372 Mar 03 02:53:11.653240 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1204/2292] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:11 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:11.884817 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-bb73011c-952b-417d-bb0c-cb68fced10bd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:11.885429 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-bb73011c-952b-417d-bb0c-cb68fced10bd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:11.892081 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bb73011c-952b-417d-bb0c-cb68fced10bd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:11.892536 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bb73011c-952b-417d-bb0c-cb68fced10bd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:11.893311 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bb73011c-952b-417d-bb0c-cb68fced10bd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:11.893758 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bb73011c-952b-417d-bb0c-cb68fced10bd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:12.024716 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-bb73011c-952b-417d-bb0c-cb68fced10bd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:12.032485 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-bb73011c-952b-417d-bb0c-cb68fced10bd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.151433 Mar 03 02:53:12.033053 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1205/2293] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:11 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:12.178255 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-690c0050-48b1-4648-a06a-4f6062d297d9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:12.178791 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-690c0050-48b1-4648-a06a-4f6062d297d9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:12.184580 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-690c0050-48b1-4648-a06a-4f6062d297d9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:12.185033 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-690c0050-48b1-4648-a06a-4f6062d297d9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:12.185803 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-690c0050-48b1-4648-a06a-4f6062d297d9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:12.186237 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-690c0050-48b1-4648-a06a-4f6062d297d9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:12.316064 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-690c0050-48b1-4648-a06a-4f6062d297d9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:12.323711 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-690c0050-48b1-4648-a06a-4f6062d297d9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.149382 Mar 03 02:53:12.324274 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1206/2294] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:12 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:12.329680 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-338da2e2-e5a0-437b-9270-1c1fe002ab46 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:12.330288 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-338da2e2-e5a0-437b-9270-1c1fe002ab46 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:12.335583 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-338da2e2-e5a0-437b-9270-1c1fe002ab46 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:12.336064 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-338da2e2-e5a0-437b-9270-1c1fe002ab46 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:12.336840 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-338da2e2-e5a0-437b-9270-1c1fe002ab46 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:12.337307 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-338da2e2-e5a0-437b-9270-1c1fe002ab46 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:12.398356 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-338da2e2-e5a0-437b-9270-1c1fe002ab46 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:12.407042 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-338da2e2-e5a0-437b-9270-1c1fe002ab46 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.081808 Mar 03 02:53:12.407623 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1207/2295] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:12 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:12.669857 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a8768f49-f6db-476e-91e6-9ce6c4e84278 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:12.670492 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a8768f49-f6db-476e-91e6-9ce6c4e84278 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:12.676314 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a8768f49-f6db-476e-91e6-9ce6c4e84278 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:12.676758 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a8768f49-f6db-476e-91e6-9ce6c4e84278 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:12.677518 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a8768f49-f6db-476e-91e6-9ce6c4e84278 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:12.677949 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a8768f49-f6db-476e-91e6-9ce6c4e84278 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:12.806395 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a8768f49-f6db-476e-91e6-9ce6c4e84278 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:12.814034 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a8768f49-f6db-476e-91e6-9ce6c4e84278 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.147988 Mar 03 02:53:12.814590 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1208/2296] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:12 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:13.050246 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d4d20ebe-81f6-4be8-8bdd-1a24dfc8dccc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:13.050879 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d4d20ebe-81f6-4be8-8bdd-1a24dfc8dccc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:13.056637 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d4d20ebe-81f6-4be8-8bdd-1a24dfc8dccc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:13.057094 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d4d20ebe-81f6-4be8-8bdd-1a24dfc8dccc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:13.057872 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d4d20ebe-81f6-4be8-8bdd-1a24dfc8dccc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:13.058308 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d4d20ebe-81f6-4be8-8bdd-1a24dfc8dccc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:13.186325 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d4d20ebe-81f6-4be8-8bdd-1a24dfc8dccc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:13.194665 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d4d20ebe-81f6-4be8-8bdd-1a24dfc8dccc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.148964 Mar 03 02:53:13.195229 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1209/2297] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:13 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:13.341021 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-930bf007-348d-4faf-920f-8bf99e5acfa1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:13.341635 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-930bf007-348d-4faf-920f-8bf99e5acfa1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:13.347490 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-930bf007-348d-4faf-920f-8bf99e5acfa1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:13.347977 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-930bf007-348d-4faf-920f-8bf99e5acfa1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:13.348752 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-930bf007-348d-4faf-920f-8bf99e5acfa1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:13.349196 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-930bf007-348d-4faf-920f-8bf99e5acfa1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:13.481790 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-930bf007-348d-4faf-920f-8bf99e5acfa1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:13.490166 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-930bf007-348d-4faf-920f-8bf99e5acfa1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.152929 Mar 03 02:53:13.490726 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1210/2298] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:13 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:13.494975 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-cdd29a37-3a5c-4b7e-8888-e29b4b64f940 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:13.495566 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-cdd29a37-3a5c-4b7e-8888-e29b4b64f940 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:13.501476 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cdd29a37-3a5c-4b7e-8888-e29b4b64f940 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:13.501951 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cdd29a37-3a5c-4b7e-8888-e29b4b64f940 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:13.502711 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cdd29a37-3a5c-4b7e-8888-e29b4b64f940 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:13.503144 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cdd29a37-3a5c-4b7e-8888-e29b4b64f940 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:13.560773 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-cdd29a37-3a5c-4b7e-8888-e29b4b64f940 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:13.568899 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-cdd29a37-3a5c-4b7e-8888-e29b4b64f940 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.077237 Mar 03 02:53:13.569460 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1211/2299] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:13 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:13.831350 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d2a8ff42-8b5f-40f2-aa8d-221931460d4b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:13.832876 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d2a8ff42-8b5f-40f2-aa8d-221931460d4b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:13.839623 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d2a8ff42-8b5f-40f2-aa8d-221931460d4b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:13.840077 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d2a8ff42-8b5f-40f2-aa8d-221931460d4b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:13.840897 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d2a8ff42-8b5f-40f2-aa8d-221931460d4b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:13.841437 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d2a8ff42-8b5f-40f2-aa8d-221931460d4b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:13.971263 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d2a8ff42-8b5f-40f2-aa8d-221931460d4b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:13.978922 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d2a8ff42-8b5f-40f2-aa8d-221931460d4b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.151513 Mar 03 02:53:13.979516 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1212/2300] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:13 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:14.212586 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-92101c02-5488-4e56-bc89-02d71b76ee3c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:14.213210 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-92101c02-5488-4e56-bc89-02d71b76ee3c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:14.220105 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-92101c02-5488-4e56-bc89-02d71b76ee3c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:14.220550 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-92101c02-5488-4e56-bc89-02d71b76ee3c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:14.221315 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-92101c02-5488-4e56-bc89-02d71b76ee3c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:14.221748 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-92101c02-5488-4e56-bc89-02d71b76ee3c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:14.354882 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-92101c02-5488-4e56-bc89-02d71b76ee3c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:14.362855 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-92101c02-5488-4e56-bc89-02d71b76ee3c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.154175 Mar 03 02:53:14.363425 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1213/2301] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:14 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:14.507397 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e07d3dad-79df-4b82-aea6-96e8e1bcc411 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:14.507966 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e07d3dad-79df-4b82-aea6-96e8e1bcc411 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:14.513617 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e07d3dad-79df-4b82-aea6-96e8e1bcc411 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:14.514086 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e07d3dad-79df-4b82-aea6-96e8e1bcc411 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:14.515582 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e07d3dad-79df-4b82-aea6-96e8e1bcc411 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:14.516080 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e07d3dad-79df-4b82-aea6-96e8e1bcc411 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:14.647246 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e07d3dad-79df-4b82-aea6-96e8e1bcc411 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:14.654978 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e07d3dad-79df-4b82-aea6-96e8e1bcc411 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.151383 Mar 03 02:53:14.655548 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1214/2302] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:14 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:14.659980 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5d9a4781-1460-45ff-bd13-a2c5e8e41450 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:14.660582 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5d9a4781-1460-45ff-bd13-a2c5e8e41450 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:14.665933 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5d9a4781-1460-45ff-bd13-a2c5e8e41450 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:14.666382 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5d9a4781-1460-45ff-bd13-a2c5e8e41450 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:14.667156 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5d9a4781-1460-45ff-bd13-a2c5e8e41450 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:14.667615 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5d9a4781-1460-45ff-bd13-a2c5e8e41450 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:14.730213 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5d9a4781-1460-45ff-bd13-a2c5e8e41450 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:14.738261 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5d9a4781-1460-45ff-bd13-a2c5e8e41450 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.081765 Mar 03 02:53:14.738829 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1215/2303] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:14 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:14.996710 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-43304953-5b2e-40c5-8535-00a3aca5e50b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:14.997321 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-43304953-5b2e-40c5-8535-00a3aca5e50b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:15.003906 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-43304953-5b2e-40c5-8535-00a3aca5e50b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:15.004358 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-43304953-5b2e-40c5-8535-00a3aca5e50b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:15.005135 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-43304953-5b2e-40c5-8535-00a3aca5e50b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:15.005576 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-43304953-5b2e-40c5-8535-00a3aca5e50b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:15.134643 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-43304953-5b2e-40c5-8535-00a3aca5e50b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:15.142608 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-43304953-5b2e-40c5-8535-00a3aca5e50b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.149695 Mar 03 02:53:15.143183 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1216/2304] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:14 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:15.380081 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8721b04a-1ab1-407c-bdd1-935c0944548a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:15.380899 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8721b04a-1ab1-407c-bdd1-935c0944548a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:15.386922 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8721b04a-1ab1-407c-bdd1-935c0944548a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:15.387366 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8721b04a-1ab1-407c-bdd1-935c0944548a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:15.388175 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8721b04a-1ab1-407c-bdd1-935c0944548a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:15.388607 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8721b04a-1ab1-407c-bdd1-935c0944548a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:15.516532 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8721b04a-1ab1-407c-bdd1-935c0944548a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:15.524193 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8721b04a-1ab1-407c-bdd1-935c0944548a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.147991 Mar 03 02:53:15.524733 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1217/2305] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:15 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:15.671929 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2187da12-3089-47d2-8163-c055131c3afc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:15.672473 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2187da12-3089-47d2-8163-c055131c3afc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:15.678486 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2187da12-3089-47d2-8163-c055131c3afc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:15.678929 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2187da12-3089-47d2-8163-c055131c3afc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:15.679724 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2187da12-3089-47d2-8163-c055131c3afc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:15.680157 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2187da12-3089-47d2-8163-c055131c3afc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:15.813080 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2187da12-3089-47d2-8163-c055131c3afc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:15.820920 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2187da12-3089-47d2-8163-c055131c3afc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.152981 Mar 03 02:53:15.821485 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1218/2306] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:15 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:15.825814 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-948e6ce1-d6ed-434d-97f2-3d5238780759 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:15.826415 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-948e6ce1-d6ed-434d-97f2-3d5238780759 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:15.832600 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-948e6ce1-d6ed-434d-97f2-3d5238780759 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:15.833050 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-948e6ce1-d6ed-434d-97f2-3d5238780759 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:15.833830 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-948e6ce1-d6ed-434d-97f2-3d5238780759 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:15.834272 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-948e6ce1-d6ed-434d-97f2-3d5238780759 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:15.893273 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-948e6ce1-d6ed-434d-97f2-3d5238780759 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:15.901075 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-948e6ce1-d6ed-434d-97f2-3d5238780759 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.078656 Mar 03 02:53:15.901640 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1219/2307] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:15 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:16.159686 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5d2feb4c-f9f2-4d39-ac0f-be1fac5a22d6 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:16.160289 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5d2feb4c-f9f2-4d39-ac0f-be1fac5a22d6 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:16.166067 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5d2feb4c-f9f2-4d39-ac0f-be1fac5a22d6 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:16.166509 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5d2feb4c-f9f2-4d39-ac0f-be1fac5a22d6 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:16.167269 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5d2feb4c-f9f2-4d39-ac0f-be1fac5a22d6 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:16.167724 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5d2feb4c-f9f2-4d39-ac0f-be1fac5a22d6 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:16.296716 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5d2feb4c-f9f2-4d39-ac0f-be1fac5a22d6 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:16.304340 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5d2feb4c-f9f2-4d39-ac0f-be1fac5a22d6 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.148426 Mar 03 02:53:16.304842 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1220/2308] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:16 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:16.541222 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-96f3988c-5dd3-42e0-8d0f-796db95e90c8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:16.541901 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-96f3988c-5dd3-42e0-8d0f-796db95e90c8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:16.548757 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-96f3988c-5dd3-42e0-8d0f-796db95e90c8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:16.549250 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-96f3988c-5dd3-42e0-8d0f-796db95e90c8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:16.550065 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-96f3988c-5dd3-42e0-8d0f-796db95e90c8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:16.550507 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-96f3988c-5dd3-42e0-8d0f-796db95e90c8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:16.682294 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-96f3988c-5dd3-42e0-8d0f-796db95e90c8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:16.690785 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-96f3988c-5dd3-42e0-8d0f-796db95e90c8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.153378 Mar 03 02:53:16.691434 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1221/2309] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:16 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:16.839341 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-24d55432-9b83-4170-802d-b622d1f6c49d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:16.839986 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-24d55432-9b83-4170-802d-b622d1f6c49d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:16.846391 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-24d55432-9b83-4170-802d-b622d1f6c49d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:16.846848 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-24d55432-9b83-4170-802d-b622d1f6c49d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:16.847653 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-24d55432-9b83-4170-802d-b622d1f6c49d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:16.848098 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-24d55432-9b83-4170-802d-b622d1f6c49d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:16.976841 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-24d55432-9b83-4170-802d-b622d1f6c49d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:16.985530 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-24d55432-9b83-4170-802d-b622d1f6c49d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.150003 Mar 03 02:53:16.986106 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1222/2310] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:16 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:16.990426 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f1a044d9-e558-4813-aebe-c355d1e7babe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:16.991028 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f1a044d9-e558-4813-aebe-c355d1e7babe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:16.996439 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f1a044d9-e558-4813-aebe-c355d1e7babe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:16.996895 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f1a044d9-e558-4813-aebe-c355d1e7babe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:16.997678 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f1a044d9-e558-4813-aebe-c355d1e7babe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:16.998120 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f1a044d9-e558-4813-aebe-c355d1e7babe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:17.061278 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f1a044d9-e558-4813-aebe-c355d1e7babe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:17.069209 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f1a044d9-e558-4813-aebe-c355d1e7babe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.082164 Mar 03 02:53:17.069776 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1223/2311] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:16 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:17.322208 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4a1fea99-067a-4b0b-af68-894c66d961cc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:17.322734 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4a1fea99-067a-4b0b-af68-894c66d961cc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:17.329141 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4a1fea99-067a-4b0b-af68-894c66d961cc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:17.329593 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4a1fea99-067a-4b0b-af68-894c66d961cc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:17.330365 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4a1fea99-067a-4b0b-af68-894c66d961cc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:17.330804 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4a1fea99-067a-4b0b-af68-894c66d961cc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:17.459578 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4a1fea99-067a-4b0b-af68-894c66d961cc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:17.467190 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4a1fea99-067a-4b0b-af68-894c66d961cc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.148850 Mar 03 02:53:17.468908 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1224/2312] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:17 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:17.707737 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9bcbd458-d740-46c8-8755-bb22e1abe4e9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:17.708359 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9bcbd458-d740-46c8-8755-bb22e1abe4e9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:17.714629 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9bcbd458-d740-46c8-8755-bb22e1abe4e9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:17.715072 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9bcbd458-d740-46c8-8755-bb22e1abe4e9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:17.715857 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9bcbd458-d740-46c8-8755-bb22e1abe4e9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:17.716292 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9bcbd458-d740-46c8-8755-bb22e1abe4e9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:17.848712 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9bcbd458-d740-46c8-8755-bb22e1abe4e9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:17.856372 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9bcbd458-d740-46c8-8755-bb22e1abe4e9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.152437 Mar 03 02:53:17.856930 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1225/2313] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:17 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:18.002741 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-dc1bc9b3-270f-4853-96be-75d72bae1ce5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:18.003364 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-dc1bc9b3-270f-4853-96be-75d72bae1ce5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:18.009118 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dc1bc9b3-270f-4853-96be-75d72bae1ce5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:18.009564 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dc1bc9b3-270f-4853-96be-75d72bae1ce5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:18.010330 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dc1bc9b3-270f-4853-96be-75d72bae1ce5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:18.010759 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dc1bc9b3-270f-4853-96be-75d72bae1ce5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:18.143472 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-dc1bc9b3-270f-4853-96be-75d72bae1ce5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:18.151059 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-dc1bc9b3-270f-4853-96be-75d72bae1ce5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.152801 Mar 03 02:53:18.151637 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1226/2314] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:17 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:18.156219 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d26fd6f9-2c01-4805-a497-e8b1282c9885 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:18.156844 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d26fd6f9-2c01-4805-a497-e8b1282c9885 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:18.162059 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d26fd6f9-2c01-4805-a497-e8b1282c9885 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:18.162497 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d26fd6f9-2c01-4805-a497-e8b1282c9885 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:18.163254 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d26fd6f9-2c01-4805-a497-e8b1282c9885 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:18.163709 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d26fd6f9-2c01-4805-a497-e8b1282c9885 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:18.221866 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d26fd6f9-2c01-4805-a497-e8b1282c9885 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:18.229448 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d26fd6f9-2c01-4805-a497-e8b1282c9885 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.076888 Mar 03 02:53:18.230008 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1227/2315] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:18 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:18.486112 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6fccc347-fa0e-49a8-bc3b-7f0acca248ad tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:18.486792 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6fccc347-fa0e-49a8-bc3b-7f0acca248ad tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:18.492568 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6fccc347-fa0e-49a8-bc3b-7f0acca248ad tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:18.493014 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6fccc347-fa0e-49a8-bc3b-7f0acca248ad tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:18.493779 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6fccc347-fa0e-49a8-bc3b-7f0acca248ad tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:18.494208 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6fccc347-fa0e-49a8-bc3b-7f0acca248ad tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:18.623362 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6fccc347-fa0e-49a8-bc3b-7f0acca248ad tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:18.631171 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6fccc347-fa0e-49a8-bc3b-7f0acca248ad tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.149613 Mar 03 02:53:18.631765 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1228/2316] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:18 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:18.873572 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-184105a5-159b-474a-ad0b-ef288e1c78bf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:18.874913 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-184105a5-159b-474a-ad0b-ef288e1c78bf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:18.880914 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-184105a5-159b-474a-ad0b-ef288e1c78bf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:18.881354 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-184105a5-159b-474a-ad0b-ef288e1c78bf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:18.882118 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-184105a5-159b-474a-ad0b-ef288e1c78bf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:18.882550 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-184105a5-159b-474a-ad0b-ef288e1c78bf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:19.015595 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-184105a5-159b-474a-ad0b-ef288e1c78bf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:19.023247 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-184105a5-159b-474a-ad0b-ef288e1c78bf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.153488 Mar 03 02:53:19.023828 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1229/2317] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:18 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:19.167741 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b9f7ceec-6255-4a3d-803f-42607bb3477a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:19.168282 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b9f7ceec-6255-4a3d-803f-42607bb3477a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:19.174298 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b9f7ceec-6255-4a3d-803f-42607bb3477a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:19.174745 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b9f7ceec-6255-4a3d-803f-42607bb3477a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:19.175521 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b9f7ceec-6255-4a3d-803f-42607bb3477a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:19.175987 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b9f7ceec-6255-4a3d-803f-42607bb3477a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:19.305926 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b9f7ceec-6255-4a3d-803f-42607bb3477a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:19.314284 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b9f7ceec-6255-4a3d-803f-42607bb3477a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.150393 Mar 03 02:53:19.314869 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1230/2318] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:19 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:19.319169 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0e3d253a-b21f-4f0c-bc84-46da5fa13d59 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:19.319795 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0e3d253a-b21f-4f0c-bc84-46da5fa13d59 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:19.325229 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0e3d253a-b21f-4f0c-bc84-46da5fa13d59 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:19.325682 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0e3d253a-b21f-4f0c-bc84-46da5fa13d59 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:19.326460 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0e3d253a-b21f-4f0c-bc84-46da5fa13d59 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:19.327019 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0e3d253a-b21f-4f0c-bc84-46da5fa13d59 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:19.388685 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0e3d253a-b21f-4f0c-bc84-46da5fa13d59 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:19.396306 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0e3d253a-b21f-4f0c-bc84-46da5fa13d59 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080515 Mar 03 02:53:19.396871 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1231/2319] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:19 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:19.648387 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-895b44df-c970-411a-82fe-bfb1c92ea6d4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:19.648996 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-895b44df-c970-411a-82fe-bfb1c92ea6d4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:19.654764 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-895b44df-c970-411a-82fe-bfb1c92ea6d4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:19.655596 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-895b44df-c970-411a-82fe-bfb1c92ea6d4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:19.656418 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-895b44df-c970-411a-82fe-bfb1c92ea6d4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:19.656854 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-895b44df-c970-411a-82fe-bfb1c92ea6d4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:19.786713 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-895b44df-c970-411a-82fe-bfb1c92ea6d4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:19.794336 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-895b44df-c970-411a-82fe-bfb1c92ea6d4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.149814 Mar 03 02:53:19.794896 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1232/2320] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:19 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:20.041041 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d041a16b-0098-4c71-bc9e-46004d77f21f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:20.041662 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d041a16b-0098-4c71-bc9e-46004d77f21f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:20.048519 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d041a16b-0098-4c71-bc9e-46004d77f21f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:20.048966 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d041a16b-0098-4c71-bc9e-46004d77f21f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:20.049740 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d041a16b-0098-4c71-bc9e-46004d77f21f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:20.050171 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d041a16b-0098-4c71-bc9e-46004d77f21f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:20.178537 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d041a16b-0098-4c71-bc9e-46004d77f21f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:20.186172 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d041a16b-0098-4c71-bc9e-46004d77f21f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.149055 Mar 03 02:53:20.186859 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1233/2321] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:20 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:20.332034 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9314e631-d041-4150-959d-bf3468069b13 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:20.332640 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9314e631-d041-4150-959d-bf3468069b13 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:20.338320 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9314e631-d041-4150-959d-bf3468069b13 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:20.338776 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9314e631-d041-4150-959d-bf3468069b13 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:20.339538 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9314e631-d041-4150-959d-bf3468069b13 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:20.340000 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9314e631-d041-4150-959d-bf3468069b13 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:20.471240 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9314e631-d041-4150-959d-bf3468069b13 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:20.478877 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9314e631-d041-4150-959d-bf3468069b13 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.150646 Mar 03 02:53:20.479438 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1234/2322] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:20 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:20.484428 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-423c838c-3ad3-4e26-b027-a14f6bffce53 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:20.485030 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-423c838c-3ad3-4e26-b027-a14f6bffce53 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:20.490369 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-423c838c-3ad3-4e26-b027-a14f6bffce53 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:20.490822 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-423c838c-3ad3-4e26-b027-a14f6bffce53 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:20.491591 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-423c838c-3ad3-4e26-b027-a14f6bffce53 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:20.492054 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-423c838c-3ad3-4e26-b027-a14f6bffce53 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:20.550500 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-423c838c-3ad3-4e26-b027-a14f6bffce53 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:20.558142 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-423c838c-3ad3-4e26-b027-a14f6bffce53 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.077756 Mar 03 02:53:20.558705 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1235/2323] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:20 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:20.813048 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ace6469f-3fc2-4506-b39b-815f9256fb0e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:20.813574 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ace6469f-3fc2-4506-b39b-815f9256fb0e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:20.819300 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ace6469f-3fc2-4506-b39b-815f9256fb0e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:20.819790 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ace6469f-3fc2-4506-b39b-815f9256fb0e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:20.820561 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ace6469f-3fc2-4506-b39b-815f9256fb0e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:20.821002 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ace6469f-3fc2-4506-b39b-815f9256fb0e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:20.951218 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ace6469f-3fc2-4506-b39b-815f9256fb0e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:20.959179 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ace6469f-3fc2-4506-b39b-815f9256fb0e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.150781 Mar 03 02:53:20.959782 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1236/2324] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:20 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:21.203695 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d932d1d5-a8b1-4b12-8a0a-a5ab5172a9fb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:21.204334 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d932d1d5-a8b1-4b12-8a0a-a5ab5172a9fb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:21.210612 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d932d1d5-a8b1-4b12-8a0a-a5ab5172a9fb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:21.211057 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d932d1d5-a8b1-4b12-8a0a-a5ab5172a9fb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:21.211859 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d932d1d5-a8b1-4b12-8a0a-a5ab5172a9fb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:21.212299 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d932d1d5-a8b1-4b12-8a0a-a5ab5172a9fb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:21.345979 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d932d1d5-a8b1-4b12-8a0a-a5ab5172a9fb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:21.353619 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d932d1d5-a8b1-4b12-8a0a-a5ab5172a9fb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.154025 Mar 03 02:53:21.354184 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1237/2325] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:21 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:21.496124 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d926ab35-d8cc-40bd-91d0-5c341fcd0787 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:21.496653 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d926ab35-d8cc-40bd-91d0-5c341fcd0787 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:21.502468 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d926ab35-d8cc-40bd-91d0-5c341fcd0787 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:21.502922 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d926ab35-d8cc-40bd-91d0-5c341fcd0787 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:21.503854 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d926ab35-d8cc-40bd-91d0-5c341fcd0787 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:21.504300 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d926ab35-d8cc-40bd-91d0-5c341fcd0787 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:21.631911 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d926ab35-d8cc-40bd-91d0-5c341fcd0787 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:21.640199 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d926ab35-d8cc-40bd-91d0-5c341fcd0787 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.147335 Mar 03 02:53:21.640726 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1238/2326] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:21 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:21.644974 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ad6c0fca-07e4-4d7e-92e5-6a34eeea5829 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:21.645564 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ad6c0fca-07e4-4d7e-92e5-6a34eeea5829 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:21.651073 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ad6c0fca-07e4-4d7e-92e5-6a34eeea5829 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:21.651512 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ad6c0fca-07e4-4d7e-92e5-6a34eeea5829 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:21.652306 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ad6c0fca-07e4-4d7e-92e5-6a34eeea5829 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:21.652770 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ad6c0fca-07e4-4d7e-92e5-6a34eeea5829 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:21.715900 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ad6c0fca-07e4-4d7e-92e5-6a34eeea5829 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:21.724392 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ad6c0fca-07e4-4d7e-92e5-6a34eeea5829 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.082719 Mar 03 02:53:21.724956 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1239/2327] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:21 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:21.975475 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b1d9b29c-d150-453d-9ed4-ce30474349d2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:21.976130 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b1d9b29c-d150-453d-9ed4-ce30474349d2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:21.981936 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b1d9b29c-d150-453d-9ed4-ce30474349d2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:21.982641 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b1d9b29c-d150-453d-9ed4-ce30474349d2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:21.983954 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b1d9b29c-d150-453d-9ed4-ce30474349d2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:21.984400 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b1d9b29c-d150-453d-9ed4-ce30474349d2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:22.114010 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b1d9b29c-d150-453d-9ed4-ce30474349d2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:22.121644 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b1d9b29c-d150-453d-9ed4-ce30474349d2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.149976 Mar 03 02:53:22.122208 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1240/2328] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:21 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:22.372045 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f48f8b56-ea38-43e6-b84a-cf2822f563af tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:22.372671 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f48f8b56-ea38-43e6-b84a-cf2822f563af tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:22.379453 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f48f8b56-ea38-43e6-b84a-cf2822f563af tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:22.379929 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f48f8b56-ea38-43e6-b84a-cf2822f563af tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:22.380698 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f48f8b56-ea38-43e6-b84a-cf2822f563af tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:22.381125 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f48f8b56-ea38-43e6-b84a-cf2822f563af tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:22.508900 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f48f8b56-ea38-43e6-b84a-cf2822f563af tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:22.517138 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f48f8b56-ea38-43e6-b84a-cf2822f563af tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.148854 Mar 03 02:53:22.517706 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1241/2329] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:22 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:22.657118 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ad571976-2acd-4db8-80a2-49286f44472f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:22.657634 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ad571976-2acd-4db8-80a2-49286f44472f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:22.663209 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ad571976-2acd-4db8-80a2-49286f44472f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:22.663687 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ad571976-2acd-4db8-80a2-49286f44472f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:22.664451 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ad571976-2acd-4db8-80a2-49286f44472f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:22.664879 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ad571976-2acd-4db8-80a2-49286f44472f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:22.797909 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ad571976-2acd-4db8-80a2-49286f44472f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:22.805520 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ad571976-2acd-4db8-80a2-49286f44472f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.152469 Mar 03 02:53:22.806093 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1242/2330] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:22 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:22.810540 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1fb6ba46-2a4a-4a30-9df1-4c88f975a0e3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:22.811140 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1fb6ba46-2a4a-4a30-9df1-4c88f975a0e3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:22.817122 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1fb6ba46-2a4a-4a30-9df1-4c88f975a0e3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:22.817594 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1fb6ba46-2a4a-4a30-9df1-4c88f975a0e3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:22.818364 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1fb6ba46-2a4a-4a30-9df1-4c88f975a0e3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:22.818803 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1fb6ba46-2a4a-4a30-9df1-4c88f975a0e3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:22.878710 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1fb6ba46-2a4a-4a30-9df1-4c88f975a0e3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:22.886298 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1fb6ba46-2a4a-4a30-9df1-4c88f975a0e3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079290 Mar 03 02:53:22.886867 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1243/2331] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:22 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:23.139159 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-85ca316e-5d64-46f0-9322-dfe957232b42 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:23.140405 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-85ca316e-5d64-46f0-9322-dfe957232b42 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:23.146211 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-85ca316e-5d64-46f0-9322-dfe957232b42 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:23.146659 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-85ca316e-5d64-46f0-9322-dfe957232b42 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:23.147423 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-85ca316e-5d64-46f0-9322-dfe957232b42 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:23.147895 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-85ca316e-5d64-46f0-9322-dfe957232b42 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:23.274911 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-85ca316e-5d64-46f0-9322-dfe957232b42 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:23.283317 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-85ca316e-5d64-46f0-9322-dfe957232b42 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.147936 Mar 03 02:53:23.283925 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1244/2332] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:23 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:23.533401 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-49e40544-cb43-46c5-b864-64fdcb1bae2a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:23.534077 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-49e40544-cb43-46c5-b864-64fdcb1bae2a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:23.540189 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-49e40544-cb43-46c5-b864-64fdcb1bae2a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:23.540628 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-49e40544-cb43-46c5-b864-64fdcb1bae2a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:23.541390 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-49e40544-cb43-46c5-b864-64fdcb1bae2a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:23.541819 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-49e40544-cb43-46c5-b864-64fdcb1bae2a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:23.675411 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-49e40544-cb43-46c5-b864-64fdcb1bae2a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:23.684256 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-49e40544-cb43-46c5-b864-64fdcb1bae2a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.154593 Mar 03 02:53:23.685618 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1245/2333] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:23 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:23.822381 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0ccf8ebe-e32b-4ffd-b88f-7755a807274d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:23.822968 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0ccf8ebe-e32b-4ffd-b88f-7755a807274d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:23.829444 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0ccf8ebe-e32b-4ffd-b88f-7755a807274d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:23.829891 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0ccf8ebe-e32b-4ffd-b88f-7755a807274d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:23.830659 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0ccf8ebe-e32b-4ffd-b88f-7755a807274d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:23.831125 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0ccf8ebe-e32b-4ffd-b88f-7755a807274d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:23.970804 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0ccf8ebe-e32b-4ffd-b88f-7755a807274d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:23.978925 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0ccf8ebe-e32b-4ffd-b88f-7755a807274d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.160609 Mar 03 02:53:23.979495 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1246/2334] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:23 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:23.985005 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-519dcb80-4bcb-49fc-ad2b-b838d1cd983c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:23.985602 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-519dcb80-4bcb-49fc-ad2b-b838d1cd983c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:23.991787 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-519dcb80-4bcb-49fc-ad2b-b838d1cd983c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:23.992244 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-519dcb80-4bcb-49fc-ad2b-b838d1cd983c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:23.993031 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-519dcb80-4bcb-49fc-ad2b-b838d1cd983c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:23.993469 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-519dcb80-4bcb-49fc-ad2b-b838d1cd983c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:24.063987 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-519dcb80-4bcb-49fc-ad2b-b838d1cd983c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:24.071906 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-519dcb80-4bcb-49fc-ad2b-b838d1cd983c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.091415 Mar 03 02:53:24.072707 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1247/2335] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:23 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:24.301718 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c86f5c5e-93e9-40fa-8391-77e946def2c8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:24.302309 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c86f5c5e-93e9-40fa-8391-77e946def2c8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:24.308405 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c86f5c5e-93e9-40fa-8391-77e946def2c8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:24.308863 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c86f5c5e-93e9-40fa-8391-77e946def2c8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:24.309654 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c86f5c5e-93e9-40fa-8391-77e946def2c8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:24.310096 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c86f5c5e-93e9-40fa-8391-77e946def2c8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:24.455316 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c86f5c5e-93e9-40fa-8391-77e946def2c8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:24.463376 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c86f5c5e-93e9-40fa-8391-77e946def2c8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.165668 Mar 03 02:53:24.463981 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1248/2336] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:24 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:24.707514 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c0fd54e9-6178-4abc-b313-ab852a38184d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:24.708194 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c0fd54e9-6178-4abc-b313-ab852a38184d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:24.714260 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c0fd54e9-6178-4abc-b313-ab852a38184d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:24.714708 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c0fd54e9-6178-4abc-b313-ab852a38184d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:24.715479 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c0fd54e9-6178-4abc-b313-ab852a38184d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:24.715936 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c0fd54e9-6178-4abc-b313-ab852a38184d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:24.848082 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c0fd54e9-6178-4abc-b313-ab852a38184d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:24.855881 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c0fd54e9-6178-4abc-b313-ab852a38184d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.152242 Mar 03 02:53:24.856447 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1249/2337] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:24 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:24.997384 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a3a38b2a-510f-4cfb-912c-c921ad510671 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:24.997895 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a3a38b2a-510f-4cfb-912c-c921ad510671 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:25.005646 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a3a38b2a-510f-4cfb-912c-c921ad510671 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:25.006093 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a3a38b2a-510f-4cfb-912c-c921ad510671 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:25.006873 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a3a38b2a-510f-4cfb-912c-c921ad510671 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:25.007337 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a3a38b2a-510f-4cfb-912c-c921ad510671 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:25.140409 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a3a38b2a-510f-4cfb-912c-c921ad510671 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:25.148046 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a3a38b2a-510f-4cfb-912c-c921ad510671 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.154634 Mar 03 02:53:25.148608 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1250/2338] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:24 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:25.152898 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ddfac873-d652-4700-9b29-4e67bb760f9b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:25.153488 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ddfac873-d652-4700-9b29-4e67bb760f9b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:25.159086 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ddfac873-d652-4700-9b29-4e67bb760f9b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:25.159533 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ddfac873-d652-4700-9b29-4e67bb760f9b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:25.160327 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ddfac873-d652-4700-9b29-4e67bb760f9b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:25.160757 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ddfac873-d652-4700-9b29-4e67bb760f9b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:25.218384 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ddfac873-d652-4700-9b29-4e67bb760f9b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:25.226148 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ddfac873-d652-4700-9b29-4e67bb760f9b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.076622 Mar 03 02:53:25.226711 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1251/2339] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:25 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:25.481178 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-15a1251c-780d-4a54-bbf2-fdb1a4e1a442 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:25.481778 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-15a1251c-780d-4a54-bbf2-fdb1a4e1a442 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:25.488279 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-15a1251c-780d-4a54-bbf2-fdb1a4e1a442 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:25.488730 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-15a1251c-780d-4a54-bbf2-fdb1a4e1a442 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:25.489494 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-15a1251c-780d-4a54-bbf2-fdb1a4e1a442 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:25.489929 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-15a1251c-780d-4a54-bbf2-fdb1a4e1a442 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:25.618082 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-15a1251c-780d-4a54-bbf2-fdb1a4e1a442 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:25.626397 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-15a1251c-780d-4a54-bbf2-fdb1a4e1a442 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.148966 Mar 03 02:53:25.626950 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1252/2340] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:25 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:25.873189 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b4ee842c-0b21-43d2-9b04-12ccc66843cd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:25.874342 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b4ee842c-0b21-43d2-9b04-12ccc66843cd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:25.880419 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b4ee842c-0b21-43d2-9b04-12ccc66843cd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:25.880903 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b4ee842c-0b21-43d2-9b04-12ccc66843cd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:25.881678 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b4ee842c-0b21-43d2-9b04-12ccc66843cd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:25.882112 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b4ee842c-0b21-43d2-9b04-12ccc66843cd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:26.014791 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b4ee842c-0b21-43d2-9b04-12ccc66843cd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:26.022722 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b4ee842c-0b21-43d2-9b04-12ccc66843cd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.153323 Mar 03 02:53:26.023293 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1253/2341] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:25 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:26.165354 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-cf4df9aa-68ad-465c-b218-80b24eb1a5e2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:26.165872 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-cf4df9aa-68ad-465c-b218-80b24eb1a5e2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:26.171756 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cf4df9aa-68ad-465c-b218-80b24eb1a5e2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:26.172199 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cf4df9aa-68ad-465c-b218-80b24eb1a5e2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:26.172998 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cf4df9aa-68ad-465c-b218-80b24eb1a5e2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:26.173428 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cf4df9aa-68ad-465c-b218-80b24eb1a5e2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:26.301715 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-cf4df9aa-68ad-465c-b218-80b24eb1a5e2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:26.309294 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-cf4df9aa-68ad-465c-b218-80b24eb1a5e2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.147837 Mar 03 02:53:26.309861 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1254/2342] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:26 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:26.314838 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-75191b39-0020-46a0-bd54-c464b225f57e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:26.315437 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-75191b39-0020-46a0-bd54-c464b225f57e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:26.320757 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-75191b39-0020-46a0-bd54-c464b225f57e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:26.321203 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-75191b39-0020-46a0-bd54-c464b225f57e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:26.321973 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-75191b39-0020-46a0-bd54-c464b225f57e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:26.322406 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-75191b39-0020-46a0-bd54-c464b225f57e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:26.383474 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-75191b39-0020-46a0-bd54-c464b225f57e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:26.391557 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-75191b39-0020-46a0-bd54-c464b225f57e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080771 Mar 03 02:53:26.392131 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1255/2343] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:26 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:26.644150 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-00d1b4d9-0783-465c-920f-9674a722f419 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:26.645042 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-00d1b4d9-0783-465c-920f-9674a722f419 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:26.650874 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-00d1b4d9-0783-465c-920f-9674a722f419 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:26.651324 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-00d1b4d9-0783-465c-920f-9674a722f419 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:26.652128 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-00d1b4d9-0783-465c-920f-9674a722f419 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:26.652567 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-00d1b4d9-0783-465c-920f-9674a722f419 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:26.780584 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-00d1b4d9-0783-465c-920f-9674a722f419 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:26.788220 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-00d1b4d9-0783-465c-920f-9674a722f419 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.148701 Mar 03 02:53:26.788775 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1256/2344] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:26 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:27.040493 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e1a2b3b4-a08e-4e68-8925-535d6f618f1f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:27.041110 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e1a2b3b4-a08e-4e68-8925-535d6f618f1f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:27.047987 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e1a2b3b4-a08e-4e68-8925-535d6f618f1f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:27.048441 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e1a2b3b4-a08e-4e68-8925-535d6f618f1f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:27.049226 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e1a2b3b4-a08e-4e68-8925-535d6f618f1f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:27.049660 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e1a2b3b4-a08e-4e68-8925-535d6f618f1f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:27.177235 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e1a2b3b4-a08e-4e68-8925-535d6f618f1f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:27.185162 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e1a2b3b4-a08e-4e68-8925-535d6f618f1f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.148535 Mar 03 02:53:27.185763 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1257/2345] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:27 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:27.325882 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-59d59742-8cfd-476e-ae8e-58df49c0d5b7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:27.326494 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-59d59742-8cfd-476e-ae8e-58df49c0d5b7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:27.332292 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-59d59742-8cfd-476e-ae8e-58df49c0d5b7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:27.332740 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-59d59742-8cfd-476e-ae8e-58df49c0d5b7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:27.333508 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-59d59742-8cfd-476e-ae8e-58df49c0d5b7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:27.333968 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-59d59742-8cfd-476e-ae8e-58df49c0d5b7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:27.689313 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-59d59742-8cfd-476e-ae8e-58df49c0d5b7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:27.696883 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-59d59742-8cfd-476e-ae8e-58df49c0d5b7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.374671 Mar 03 02:53:27.697440 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1258/2346] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:27 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:27.702335 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5c1d7633-06bb-4c7b-80d1-6b9eb494b265 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:27.703178 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5c1d7633-06bb-4c7b-80d1-6b9eb494b265 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:27.708473 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5c1d7633-06bb-4c7b-80d1-6b9eb494b265 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:27.708917 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5c1d7633-06bb-4c7b-80d1-6b9eb494b265 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:27.709676 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5c1d7633-06bb-4c7b-80d1-6b9eb494b265 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:27.710104 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5c1d7633-06bb-4c7b-80d1-6b9eb494b265 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:27.766894 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5c1d7633-06bb-4c7b-80d1-6b9eb494b265 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:27.774437 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5c1d7633-06bb-4c7b-80d1-6b9eb494b265 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.076084 Mar 03 02:53:27.774990 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1259/2347] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:27 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:27.804733 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e05e93df-1c8a-4e13-b42a-8cbb19b541bc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:27.805325 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e05e93df-1c8a-4e13-b42a-8cbb19b541bc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:27.810803 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e05e93df-1c8a-4e13-b42a-8cbb19b541bc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:27.811428 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e05e93df-1c8a-4e13-b42a-8cbb19b541bc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:27.812298 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e05e93df-1c8a-4e13-b42a-8cbb19b541bc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:27.812735 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e05e93df-1c8a-4e13-b42a-8cbb19b541bc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:27.941166 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e05e93df-1c8a-4e13-b42a-8cbb19b541bc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:27.948906 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e05e93df-1c8a-4e13-b42a-8cbb19b541bc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.147620 Mar 03 02:53:27.949477 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1260/2348] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:27 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:28.203245 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1c6af750-ac31-471b-8be2-0beceadcf0d3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:28.203930 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1c6af750-ac31-471b-8be2-0beceadcf0d3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:28.210036 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1c6af750-ac31-471b-8be2-0beceadcf0d3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:28.210502 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1c6af750-ac31-471b-8be2-0beceadcf0d3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:28.211269 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1c6af750-ac31-471b-8be2-0beceadcf0d3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:28.211741 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1c6af750-ac31-471b-8be2-0beceadcf0d3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:28.341029 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1c6af750-ac31-471b-8be2-0beceadcf0d3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:28.348838 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1c6af750-ac31-471b-8be2-0beceadcf0d3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.150232 Mar 03 02:53:28.349403 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1261/2349] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:28 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:28.714202 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2c3e1938-6226-4505-9b76-39cd36b8f576 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:28.714793 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2c3e1938-6226-4505-9b76-39cd36b8f576 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:28.720967 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2c3e1938-6226-4505-9b76-39cd36b8f576 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:28.721425 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2c3e1938-6226-4505-9b76-39cd36b8f576 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:28.722202 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2c3e1938-6226-4505-9b76-39cd36b8f576 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:28.722644 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2c3e1938-6226-4505-9b76-39cd36b8f576 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:28.851562 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2c3e1938-6226-4505-9b76-39cd36b8f576 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:28.860326 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2c3e1938-6226-4505-9b76-39cd36b8f576 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.149983 Mar 03 02:53:28.860894 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1262/2350] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:28 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:28.865199 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-df020b5c-c21f-47d6-b6a4-7e0176e6a515 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:28.865798 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-df020b5c-c21f-47d6-b6a4-7e0176e6a515 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:28.871181 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-df020b5c-c21f-47d6-b6a4-7e0176e6a515 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:28.871660 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-df020b5c-c21f-47d6-b6a4-7e0176e6a515 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:28.872435 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-df020b5c-c21f-47d6-b6a4-7e0176e6a515 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:28.872904 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-df020b5c-c21f-47d6-b6a4-7e0176e6a515 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:28.933493 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-df020b5c-c21f-47d6-b6a4-7e0176e6a515 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:28.941159 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-df020b5c-c21f-47d6-b6a4-7e0176e6a515 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079334 Mar 03 02:53:28.941735 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1263/2351] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:28 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:28.965898 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4d519ad4-9a69-413e-b4ee-19820ceb4570 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:28.966440 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4d519ad4-9a69-413e-b4ee-19820ceb4570 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:28.972661 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4d519ad4-9a69-413e-b4ee-19820ceb4570 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:28.973112 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4d519ad4-9a69-413e-b4ee-19820ceb4570 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:28.973888 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4d519ad4-9a69-413e-b4ee-19820ceb4570 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:28.974328 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4d519ad4-9a69-413e-b4ee-19820ceb4570 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:29.102298 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4d519ad4-9a69-413e-b4ee-19820ceb4570 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:29.111022 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4d519ad4-9a69-413e-b4ee-19820ceb4570 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.148663 Mar 03 02:53:29.111588 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1264/2352] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:28 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:29.366146 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-968ac572-faf2-4235-9043-fd94658dedb1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:29.366789 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-968ac572-faf2-4235-9043-fd94658dedb1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:29.372928 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-968ac572-faf2-4235-9043-fd94658dedb1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:29.373386 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-968ac572-faf2-4235-9043-fd94658dedb1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:29.375302 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-968ac572-faf2-4235-9043-fd94658dedb1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:29.375781 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-968ac572-faf2-4235-9043-fd94658dedb1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:29.506162 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-968ac572-faf2-4235-9043-fd94658dedb1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:29.513815 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-968ac572-faf2-4235-9043-fd94658dedb1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.151503 Mar 03 02:53:29.514464 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1265/2353] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:29 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:29.877065 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-583a6288-4716-4854-864b-07e3d4d9c3cd tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:29.877667 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-583a6288-4716-4854-864b-07e3d4d9c3cd tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:29.883533 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-583a6288-4716-4854-864b-07e3d4d9c3cd tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:29.884006 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-583a6288-4716-4854-864b-07e3d4d9c3cd tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:29.884769 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-583a6288-4716-4854-864b-07e3d4d9c3cd tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:29.885202 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-583a6288-4716-4854-864b-07e3d4d9c3cd tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:30.017612 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-583a6288-4716-4854-864b-07e3d4d9c3cd tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:30.025651 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-583a6288-4716-4854-864b-07e3d4d9c3cd tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.152404 Mar 03 02:53:30.026212 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1266/2354] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:29 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:30.032291 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a94516cc-4480-4654-9ab5-767d50b9b864 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:30.032902 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a94516cc-4480-4654-9ab5-767d50b9b864 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:30.038352 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a94516cc-4480-4654-9ab5-767d50b9b864 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:30.038801 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a94516cc-4480-4654-9ab5-767d50b9b864 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:30.039570 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a94516cc-4480-4654-9ab5-767d50b9b864 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:30.040038 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a94516cc-4480-4654-9ab5-767d50b9b864 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:30.099334 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a94516cc-4480-4654-9ab5-767d50b9b864 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:30.107219 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a94516cc-4480-4654-9ab5-767d50b9b864 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079806 Mar 03 02:53:30.107807 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1267/2355] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:30 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:30.127773 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-45dc196b-6ac2-403f-97fa-c0c8d5923859 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:30.128317 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-45dc196b-6ac2-403f-97fa-c0c8d5923859 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:30.133849 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-45dc196b-6ac2-403f-97fa-c0c8d5923859 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:30.134332 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-45dc196b-6ac2-403f-97fa-c0c8d5923859 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:30.135108 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-45dc196b-6ac2-403f-97fa-c0c8d5923859 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:30.135542 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-45dc196b-6ac2-403f-97fa-c0c8d5923859 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:30.265556 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-45dc196b-6ac2-403f-97fa-c0c8d5923859 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:30.273157 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-45dc196b-6ac2-403f-97fa-c0c8d5923859 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.149097 Mar 03 02:53:30.273717 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1268/2356] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:30 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:30.531166 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b5f7b843-db7c-443d-8b70-e72ef33cbcea tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:30.531818 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b5f7b843-db7c-443d-8b70-e72ef33cbcea tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:30.537860 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b5f7b843-db7c-443d-8b70-e72ef33cbcea tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:30.538342 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b5f7b843-db7c-443d-8b70-e72ef33cbcea tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:30.539119 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b5f7b843-db7c-443d-8b70-e72ef33cbcea tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:30.539553 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b5f7b843-db7c-443d-8b70-e72ef33cbcea tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:30.671972 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b5f7b843-db7c-443d-8b70-e72ef33cbcea tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:30.679629 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b5f7b843-db7c-443d-8b70-e72ef33cbcea tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.152783 Mar 03 02:53:30.680267 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1269/2357] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:30 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:31.043347 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-32362bbd-9475-4762-a83b-a409c141724f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:31.043980 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-32362bbd-9475-4762-a83b-a409c141724f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:31.050137 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-32362bbd-9475-4762-a83b-a409c141724f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:31.050592 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-32362bbd-9475-4762-a83b-a409c141724f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:31.051406 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-32362bbd-9475-4762-a83b-a409c141724f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:31.051883 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-32362bbd-9475-4762-a83b-a409c141724f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:31.180678 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-32362bbd-9475-4762-a83b-a409c141724f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:31.188772 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-32362bbd-9475-4762-a83b-a409c141724f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.149298 Mar 03 02:53:31.189338 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1270/2358] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:31 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:31.193815 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2d49eeb9-569f-446b-964a-bb16223e3e4b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:31.194411 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2d49eeb9-569f-446b-964a-bb16223e3e4b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:31.200092 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2d49eeb9-569f-446b-964a-bb16223e3e4b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:31.200540 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2d49eeb9-569f-446b-964a-bb16223e3e4b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:31.201313 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2d49eeb9-569f-446b-964a-bb16223e3e4b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:31.202374 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2d49eeb9-569f-446b-964a-bb16223e3e4b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:31.268099 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2d49eeb9-569f-446b-964a-bb16223e3e4b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:31.278911 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2d49eeb9-569f-446b-964a-bb16223e3e4b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.088483 Mar 03 02:53:31.279734 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1271/2359] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:31 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:31.289794 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-30dec5ed-692f-4956-828f-82ce9a024a63 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:31.290400 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-30dec5ed-692f-4956-828f-82ce9a024a63 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:31.296713 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-30dec5ed-692f-4956-828f-82ce9a024a63 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:31.297094 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-30dec5ed-692f-4956-828f-82ce9a024a63 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:31.297863 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-30dec5ed-692f-4956-828f-82ce9a024a63 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:31.298298 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-30dec5ed-692f-4956-828f-82ce9a024a63 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:31.430047 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-30dec5ed-692f-4956-828f-82ce9a024a63 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:31.438464 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-30dec5ed-692f-4956-828f-82ce9a024a63 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.152385 Mar 03 02:53:31.439036 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1272/2360] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:31 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:31.697532 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-13291101-2042-482f-b13b-68792202d1e3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:31.698208 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-13291101-2042-482f-b13b-68792202d1e3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:31.705084 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-13291101-2042-482f-b13b-68792202d1e3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:31.705537 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-13291101-2042-482f-b13b-68792202d1e3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:31.706336 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-13291101-2042-482f-b13b-68792202d1e3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:31.706769 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-13291101-2042-482f-b13b-68792202d1e3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:31.836460 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-13291101-2042-482f-b13b-68792202d1e3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:31.844714 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-13291101-2042-482f-b13b-68792202d1e3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.151123 Mar 03 02:53:31.845270 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1273/2361] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:31 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:32.207926 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ac108043-c3bf-4e6e-aefc-b06ec2343f05 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:32.208528 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ac108043-c3bf-4e6e-aefc-b06ec2343f05 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:32.214370 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ac108043-c3bf-4e6e-aefc-b06ec2343f05 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:32.214818 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ac108043-c3bf-4e6e-aefc-b06ec2343f05 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:32.215586 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ac108043-c3bf-4e6e-aefc-b06ec2343f05 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:32.216041 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ac108043-c3bf-4e6e-aefc-b06ec2343f05 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:32.347708 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ac108043-c3bf-4e6e-aefc-b06ec2343f05 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:32.355257 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ac108043-c3bf-4e6e-aefc-b06ec2343f05 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.151183 Mar 03 02:53:32.355835 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1274/2362] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:32 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:32.360669 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-711bd439-edd1-40e6-880c-727c9721df31 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:32.361259 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-711bd439-edd1-40e6-880c-727c9721df31 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:32.366542 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-711bd439-edd1-40e6-880c-727c9721df31 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:32.366985 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-711bd439-edd1-40e6-880c-727c9721df31 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:32.367784 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-711bd439-edd1-40e6-880c-727c9721df31 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:32.368219 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-711bd439-edd1-40e6-880c-727c9721df31 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:32.426172 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-711bd439-edd1-40e6-880c-727c9721df31 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:32.433799 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-711bd439-edd1-40e6-880c-727c9721df31 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.077040 Mar 03 02:53:32.434456 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1275/2363] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:32 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:32.455163 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a03df65f-5d6d-45cc-8459-1ddfaef3310f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:32.455801 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a03df65f-5d6d-45cc-8459-1ddfaef3310f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:32.461298 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a03df65f-5d6d-45cc-8459-1ddfaef3310f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:32.461756 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a03df65f-5d6d-45cc-8459-1ddfaef3310f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:32.462526 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a03df65f-5d6d-45cc-8459-1ddfaef3310f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:32.462961 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a03df65f-5d6d-45cc-8459-1ddfaef3310f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:32.589730 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a03df65f-5d6d-45cc-8459-1ddfaef3310f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:32.598165 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a03df65f-5d6d-45cc-8459-1ddfaef3310f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.146628 Mar 03 02:53:32.598669 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1276/2364] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:32 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:32.862546 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4fd73a12-4b60-4019-8b65-aaf8d9956521 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:32.863204 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4fd73a12-4b60-4019-8b65-aaf8d9956521 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:32.869237 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4fd73a12-4b60-4019-8b65-aaf8d9956521 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:32.869689 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4fd73a12-4b60-4019-8b65-aaf8d9956521 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:32.870458 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4fd73a12-4b60-4019-8b65-aaf8d9956521 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:32.870895 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4fd73a12-4b60-4019-8b65-aaf8d9956521 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:33.008041 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4fd73a12-4b60-4019-8b65-aaf8d9956521 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:33.015823 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4fd73a12-4b60-4019-8b65-aaf8d9956521 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.157922 Mar 03 02:53:33.016388 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1277/2365] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:32 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:33.372309 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d2ff0522-c1e1-4089-a971-a88941fb422d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:33.372919 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d2ff0522-c1e1-4089-a971-a88941fb422d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:33.378768 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d2ff0522-c1e1-4089-a971-a88941fb422d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:33.379221 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d2ff0522-c1e1-4089-a971-a88941fb422d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:33.380015 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d2ff0522-c1e1-4089-a971-a88941fb422d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:33.380452 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d2ff0522-c1e1-4089-a971-a88941fb422d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:33.509241 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d2ff0522-c1e1-4089-a971-a88941fb422d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:33.517072 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d2ff0522-c1e1-4089-a971-a88941fb422d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.148623 Mar 03 02:53:33.517635 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1278/2366] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:33 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:33.521991 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5b8f6317-7eb9-4f9c-936d-86e829465a68 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:33.522583 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5b8f6317-7eb9-4f9c-936d-86e829465a68 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:33.527994 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5b8f6317-7eb9-4f9c-936d-86e829465a68 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:33.528445 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5b8f6317-7eb9-4f9c-936d-86e829465a68 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:33.529215 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5b8f6317-7eb9-4f9c-936d-86e829465a68 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:33.530145 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5b8f6317-7eb9-4f9c-936d-86e829465a68 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:33.591229 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5b8f6317-7eb9-4f9c-936d-86e829465a68 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:33.599794 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5b8f6317-7eb9-4f9c-936d-86e829465a68 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.081172 Mar 03 02:53:33.600356 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1279/2367] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:33 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:33.615923 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-77e5352c-0774-4862-a1e9-1ead81c3ee99 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:33.616512 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-77e5352c-0774-4862-a1e9-1ead81c3ee99 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:33.622086 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-77e5352c-0774-4862-a1e9-1ead81c3ee99 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:33.622534 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-77e5352c-0774-4862-a1e9-1ead81c3ee99 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:33.623295 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-77e5352c-0774-4862-a1e9-1ead81c3ee99 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:33.623758 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-77e5352c-0774-4862-a1e9-1ead81c3ee99 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:33.754643 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-77e5352c-0774-4862-a1e9-1ead81c3ee99 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:33.762287 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-77e5352c-0774-4862-a1e9-1ead81c3ee99 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.149869 Mar 03 02:53:33.762773 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1280/2368] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:33 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:34.033064 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-91d6ba03-6195-4c7a-b683-fd83ad911d90 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:34.033680 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-91d6ba03-6195-4c7a-b683-fd83ad911d90 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:34.040044 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-91d6ba03-6195-4c7a-b683-fd83ad911d90 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:34.040495 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-91d6ba03-6195-4c7a-b683-fd83ad911d90 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:34.041259 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-91d6ba03-6195-4c7a-b683-fd83ad911d90 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:34.041710 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-91d6ba03-6195-4c7a-b683-fd83ad911d90 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:34.172816 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-91d6ba03-6195-4c7a-b683-fd83ad911d90 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:34.180406 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-91d6ba03-6195-4c7a-b683-fd83ad911d90 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.151336 Mar 03 02:53:34.180966 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1281/2369] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:34 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:34.534304 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c2fdde1c-7a19-4c35-8d5f-3b0b872a0af9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:34.534886 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c2fdde1c-7a19-4c35-8d5f-3b0b872a0af9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:34.540660 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c2fdde1c-7a19-4c35-8d5f-3b0b872a0af9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:34.541103 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c2fdde1c-7a19-4c35-8d5f-3b0b872a0af9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:34.541862 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c2fdde1c-7a19-4c35-8d5f-3b0b872a0af9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:34.542294 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c2fdde1c-7a19-4c35-8d5f-3b0b872a0af9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:34.673998 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c2fdde1c-7a19-4c35-8d5f-3b0b872a0af9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:34.681611 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c2fdde1c-7a19-4c35-8d5f-3b0b872a0af9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.151145 Mar 03 02:53:34.682171 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1282/2370] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:34 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:34.687801 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-dbd89a80-3156-4f72-a2ec-a628bbb243d6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:34.688405 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-dbd89a80-3156-4f72-a2ec-a628bbb243d6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:34.693687 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dbd89a80-3156-4f72-a2ec-a628bbb243d6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:34.694141 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dbd89a80-3156-4f72-a2ec-a628bbb243d6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:34.694912 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dbd89a80-3156-4f72-a2ec-a628bbb243d6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:34.695350 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dbd89a80-3156-4f72-a2ec-a628bbb243d6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:34.754742 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-dbd89a80-3156-4f72-a2ec-a628bbb243d6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:34.762396 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-dbd89a80-3156-4f72-a2ec-a628bbb243d6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079308 Mar 03 02:53:34.762961 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1283/2371] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:34 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:34.779430 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-24f6a25c-c07e-41c4-8815-0918fd8c9cc0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:34.780713 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-24f6a25c-c07e-41c4-8815-0918fd8c9cc0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:34.786552 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-24f6a25c-c07e-41c4-8815-0918fd8c9cc0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:34.786919 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-24f6a25c-c07e-41c4-8815-0918fd8c9cc0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:34.787709 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-24f6a25c-c07e-41c4-8815-0918fd8c9cc0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:34.788144 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-24f6a25c-c07e-41c4-8815-0918fd8c9cc0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:34.917843 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-24f6a25c-c07e-41c4-8815-0918fd8c9cc0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:34.926273 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-24f6a25c-c07e-41c4-8815-0918fd8c9cc0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.150436 Mar 03 02:53:34.926831 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1284/2372] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:34 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:35.198671 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-984cb0d2-29cd-4633-8cf5-e4574c433e26 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:35.199357 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-984cb0d2-29cd-4633-8cf5-e4574c433e26 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:35.205858 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-984cb0d2-29cd-4633-8cf5-e4574c433e26 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:35.206299 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-984cb0d2-29cd-4633-8cf5-e4574c433e26 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:35.207065 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-984cb0d2-29cd-4633-8cf5-e4574c433e26 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:35.207493 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-984cb0d2-29cd-4633-8cf5-e4574c433e26 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:35.338151 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-984cb0d2-29cd-4633-8cf5-e4574c433e26 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:35.346356 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-984cb0d2-29cd-4633-8cf5-e4574c433e26 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.151895 Mar 03 02:53:35.346914 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1285/2373] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:35 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:35.698398 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3945a202-0d50-479c-9795-fac68ebe6404 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:35.698902 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3945a202-0d50-479c-9795-fac68ebe6404 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:35.705723 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3945a202-0d50-479c-9795-fac68ebe6404 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:35.706168 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3945a202-0d50-479c-9795-fac68ebe6404 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:35.706933 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3945a202-0d50-479c-9795-fac68ebe6404 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:35.707363 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3945a202-0d50-479c-9795-fac68ebe6404 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:35.840764 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-3945a202-0d50-479c-9795-fac68ebe6404 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:35.848704 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3945a202-0d50-479c-9795-fac68ebe6404 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.154220 Mar 03 02:53:35.849264 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1286/2374] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:35 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:35.853662 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-55f6f523-c77b-4a03-80fe-b095ef9fae00 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:35.854251 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-55f6f523-c77b-4a03-80fe-b095ef9fae00 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:35.860279 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-55f6f523-c77b-4a03-80fe-b095ef9fae00 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:35.860727 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-55f6f523-c77b-4a03-80fe-b095ef9fae00 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:35.861490 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-55f6f523-c77b-4a03-80fe-b095ef9fae00 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:35.861920 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-55f6f523-c77b-4a03-80fe-b095ef9fae00 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:35.922992 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-55f6f523-c77b-4a03-80fe-b095ef9fae00 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:35.930605 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-55f6f523-c77b-4a03-80fe-b095ef9fae00 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080431 Mar 03 02:53:35.931164 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1287/2375] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:35 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:35.942961 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8c3bbed0-0a07-42be-a925-a8797f9fc1fe tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:35.943575 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8c3bbed0-0a07-42be-a925-a8797f9fc1fe tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:35.949262 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8c3bbed0-0a07-42be-a925-a8797f9fc1fe tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:35.949659 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8c3bbed0-0a07-42be-a925-a8797f9fc1fe tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:35.950419 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8c3bbed0-0a07-42be-a925-a8797f9fc1fe tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:35.950848 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8c3bbed0-0a07-42be-a925-a8797f9fc1fe tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:36.080039 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8c3bbed0-0a07-42be-a925-a8797f9fc1fe tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:36.087571 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8c3bbed0-0a07-42be-a925-a8797f9fc1fe tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.148193 Mar 03 02:53:36.088160 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1288/2376] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:35 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:36.363825 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a1051757-87f6-4e56-bed5-7ca4b9ca4425 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:36.364473 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a1051757-87f6-4e56-bed5-7ca4b9ca4425 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:36.370926 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a1051757-87f6-4e56-bed5-7ca4b9ca4425 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:36.371371 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a1051757-87f6-4e56-bed5-7ca4b9ca4425 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:36.372166 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a1051757-87f6-4e56-bed5-7ca4b9ca4425 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:36.372598 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a1051757-87f6-4e56-bed5-7ca4b9ca4425 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:36.502287 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a1051757-87f6-4e56-bed5-7ca4b9ca4425 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:36.510072 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a1051757-87f6-4e56-bed5-7ca4b9ca4425 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.150041 Mar 03 02:53:36.510638 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1289/2377] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:36 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:36.866084 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ba5c2c62-e26b-4ee4-9533-b25d3d83a89a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:36.866689 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ba5c2c62-e26b-4ee4-9533-b25d3d83a89a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:36.872509 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ba5c2c62-e26b-4ee4-9533-b25d3d83a89a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:36.872957 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ba5c2c62-e26b-4ee4-9533-b25d3d83a89a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:36.873851 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ba5c2c62-e26b-4ee4-9533-b25d3d83a89a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:36.874283 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ba5c2c62-e26b-4ee4-9533-b25d3d83a89a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:37.006938 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ba5c2c62-e26b-4ee4-9533-b25d3d83a89a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:37.015930 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ba5c2c62-e26b-4ee4-9533-b25d3d83a89a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.153612 Mar 03 02:53:37.016504 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1290/2378] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:36 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:37.021687 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4b234d81-1a6c-47c0-b57e-7862cc5a8de5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:37.022287 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4b234d81-1a6c-47c0-b57e-7862cc5a8de5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:37.027654 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4b234d81-1a6c-47c0-b57e-7862cc5a8de5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:37.028110 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4b234d81-1a6c-47c0-b57e-7862cc5a8de5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:37.028881 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4b234d81-1a6c-47c0-b57e-7862cc5a8de5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:37.029317 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4b234d81-1a6c-47c0-b57e-7862cc5a8de5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:37.087841 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4b234d81-1a6c-47c0-b57e-7862cc5a8de5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:37.096325 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4b234d81-1a6c-47c0-b57e-7862cc5a8de5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.078026 Mar 03 02:53:37.096885 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1291/2379] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:37 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:37.104559 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ca363be4-abbc-4422-863b-427f0819f808 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:37.105157 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ca363be4-abbc-4422-863b-427f0819f808 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:37.112393 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ca363be4-abbc-4422-863b-427f0819f808 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:37.112841 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ca363be4-abbc-4422-863b-427f0819f808 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:37.113613 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ca363be4-abbc-4422-863b-427f0819f808 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:37.114050 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ca363be4-abbc-4422-863b-427f0819f808 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:37.243865 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ca363be4-abbc-4422-863b-427f0819f808 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:37.252043 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ca363be4-abbc-4422-863b-427f0819f808 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.150989 Mar 03 02:53:37.252643 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1292/2380] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:37 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:37.527420 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-adfba505-c9d0-45f3-8201-08e8b34aee5d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:37.528080 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-adfba505-c9d0-45f3-8201-08e8b34aee5d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:37.534687 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-adfba505-c9d0-45f3-8201-08e8b34aee5d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:37.535132 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-adfba505-c9d0-45f3-8201-08e8b34aee5d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:37.535933 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-adfba505-c9d0-45f3-8201-08e8b34aee5d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:37.536369 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-adfba505-c9d0-45f3-8201-08e8b34aee5d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:37.668626 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-adfba505-c9d0-45f3-8201-08e8b34aee5d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:37.676598 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-adfba505-c9d0-45f3-8201-08e8b34aee5d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.152996 Mar 03 02:53:37.677164 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1293/2381] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:37 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:38.033510 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-531c3d20-cac8-4ff9-a6f2-cf3890ede9cc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:38.034040 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-531c3d20-cac8-4ff9-a6f2-cf3890ede9cc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:38.039879 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-531c3d20-cac8-4ff9-a6f2-cf3890ede9cc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:38.040327 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-531c3d20-cac8-4ff9-a6f2-cf3890ede9cc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:38.041089 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-531c3d20-cac8-4ff9-a6f2-cf3890ede9cc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:38.041520 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-531c3d20-cac8-4ff9-a6f2-cf3890ede9cc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:38.171871 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-531c3d20-cac8-4ff9-a6f2-cf3890ede9cc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:38.179434 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-531c3d20-cac8-4ff9-a6f2-cf3890ede9cc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.150496 Mar 03 02:53:38.180031 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1294/2382] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:38 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:38.184276 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0ed8ef08-b374-4f57-b589-f0ff03fe843d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:38.184859 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0ed8ef08-b374-4f57-b589-f0ff03fe843d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:38.190176 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0ed8ef08-b374-4f57-b589-f0ff03fe843d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:38.190618 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0ed8ef08-b374-4f57-b589-f0ff03fe843d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:38.191381 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0ed8ef08-b374-4f57-b589-f0ff03fe843d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:38.191847 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0ed8ef08-b374-4f57-b589-f0ff03fe843d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:38.253932 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0ed8ef08-b374-4f57-b589-f0ff03fe843d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:38.261474 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0ed8ef08-b374-4f57-b589-f0ff03fe843d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080534 Mar 03 02:53:38.262040 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1295/2383] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:38 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:38.269071 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-972988ed-718a-4637-acb1-e2948170a893 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:38.269679 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-972988ed-718a-4637-acb1-e2948170a893 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:38.275138 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-972988ed-718a-4637-acb1-e2948170a893 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:38.275593 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-972988ed-718a-4637-acb1-e2948170a893 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:38.276394 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-972988ed-718a-4637-acb1-e2948170a893 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:38.276836 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-972988ed-718a-4637-acb1-e2948170a893 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:38.404202 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-972988ed-718a-4637-acb1-e2948170a893 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:38.411986 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-972988ed-718a-4637-acb1-e2948170a893 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.146425 Mar 03 02:53:38.412556 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1296/2384] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:38 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:38.692966 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-31d56e76-acde-4339-90e3-71a661140a61 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:38.693604 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-31d56e76-acde-4339-90e3-71a661140a61 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:38.699671 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-31d56e76-acde-4339-90e3-71a661140a61 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:38.700118 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-31d56e76-acde-4339-90e3-71a661140a61 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:38.700880 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-31d56e76-acde-4339-90e3-71a661140a61 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:38.701310 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-31d56e76-acde-4339-90e3-71a661140a61 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:38.830702 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-31d56e76-acde-4339-90e3-71a661140a61 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:38.838202 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-31d56e76-acde-4339-90e3-71a661140a61 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.149150 Mar 03 02:53:38.838752 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1297/2385] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:38 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:39.196556 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e47398e7-7d0f-4f46-8504-c36c20feb786 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:39.197159 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e47398e7-7d0f-4f46-8504-c36c20feb786 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:39.203418 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e47398e7-7d0f-4f46-8504-c36c20feb786 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:39.203897 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e47398e7-7d0f-4f46-8504-c36c20feb786 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:39.204665 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e47398e7-7d0f-4f46-8504-c36c20feb786 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:39.205096 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e47398e7-7d0f-4f46-8504-c36c20feb786 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:39.337967 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e47398e7-7d0f-4f46-8504-c36c20feb786 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:39.346178 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e47398e7-7d0f-4f46-8504-c36c20feb786 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.153515 Mar 03 02:53:39.346748 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1298/2386] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:39 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:39.351113 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4ac7af35-0090-4939-9b0f-77e2c2e100f8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:39.351736 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4ac7af35-0090-4939-9b0f-77e2c2e100f8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:39.357300 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4ac7af35-0090-4939-9b0f-77e2c2e100f8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:39.357757 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4ac7af35-0090-4939-9b0f-77e2c2e100f8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:39.359187 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4ac7af35-0090-4939-9b0f-77e2c2e100f8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:39.359649 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4ac7af35-0090-4939-9b0f-77e2c2e100f8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:39.418398 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4ac7af35-0090-4939-9b0f-77e2c2e100f8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:39.428424 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4ac7af35-0090-4939-9b0f-77e2c2e100f8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080684 Mar 03 02:53:39.429898 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1299/2387] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:39 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:39.434654 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c7dc43de-983b-4674-b7f4-cd23e8b9cf01 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:39.435249 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c7dc43de-983b-4674-b7f4-cd23e8b9cf01 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:39.441540 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c7dc43de-983b-4674-b7f4-cd23e8b9cf01 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:39.441985 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c7dc43de-983b-4674-b7f4-cd23e8b9cf01 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:39.442748 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c7dc43de-983b-4674-b7f4-cd23e8b9cf01 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:39.443181 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c7dc43de-983b-4674-b7f4-cd23e8b9cf01 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:39.571564 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c7dc43de-983b-4674-b7f4-cd23e8b9cf01 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:39.579946 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c7dc43de-983b-4674-b7f4-cd23e8b9cf01 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.149077 Mar 03 02:53:39.580513 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1300/2388] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:39 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:39.855472 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1c246d39-5955-422a-94aa-962b5d182f6e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:39.856125 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1c246d39-5955-422a-94aa-962b5d182f6e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:39.862798 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1c246d39-5955-422a-94aa-962b5d182f6e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:39.863244 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1c246d39-5955-422a-94aa-962b5d182f6e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:39.864037 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1c246d39-5955-422a-94aa-962b5d182f6e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:39.864468 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1c246d39-5955-422a-94aa-962b5d182f6e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:39.997426 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1c246d39-5955-422a-94aa-962b5d182f6e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:40.006153 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1c246d39-5955-422a-94aa-962b5d182f6e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.154480 Mar 03 02:53:40.006722 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1301/2389] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:39 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:40.363501 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f94e10ea-476b-4e73-a448-0296ac9b286b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:40.364167 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f94e10ea-476b-4e73-a448-0296ac9b286b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:40.370019 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f94e10ea-476b-4e73-a448-0296ac9b286b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:40.370471 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f94e10ea-476b-4e73-a448-0296ac9b286b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:40.371244 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f94e10ea-476b-4e73-a448-0296ac9b286b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:40.371709 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f94e10ea-476b-4e73-a448-0296ac9b286b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:40.502756 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f94e10ea-476b-4e73-a448-0296ac9b286b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:40.510521 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f94e10ea-476b-4e73-a448-0296ac9b286b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.150847 Mar 03 02:53:40.511077 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1302/2390] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:40 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:40.515622 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c2c73feb-e749-433c-b155-a69b984f1356 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:40.516221 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c2c73feb-e749-433c-b155-a69b984f1356 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:40.521438 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c2c73feb-e749-433c-b155-a69b984f1356 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:40.521883 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c2c73feb-e749-433c-b155-a69b984f1356 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:40.522641 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c2c73feb-e749-433c-b155-a69b984f1356 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:40.523072 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c2c73feb-e749-433c-b155-a69b984f1356 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:40.584353 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c2c73feb-e749-433c-b155-a69b984f1356 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:40.591975 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c2c73feb-e749-433c-b155-a69b984f1356 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079957 Mar 03 02:53:40.592759 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1303/2391] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:40 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:40.596941 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3945c13e-4e8c-4093-815e-a7a08b4ffbd7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:40.597528 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3945c13e-4e8c-4093-815e-a7a08b4ffbd7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:40.602836 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3945c13e-4e8c-4093-815e-a7a08b4ffbd7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:40.603282 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3945c13e-4e8c-4093-815e-a7a08b4ffbd7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:40.604085 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3945c13e-4e8c-4093-815e-a7a08b4ffbd7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:40.604517 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3945c13e-4e8c-4093-815e-a7a08b4ffbd7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:40.733463 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-3945c13e-4e8c-4093-815e-a7a08b4ffbd7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:40.741060 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3945c13e-4e8c-4093-815e-a7a08b4ffbd7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.147485 Mar 03 02:53:40.741623 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1304/2392] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:40 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:41.024572 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-291d5381-affe-42d0-82ea-9a8901dcfad2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:41.025178 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-291d5381-affe-42d0-82ea-9a8901dcfad2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:41.032193 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-291d5381-affe-42d0-82ea-9a8901dcfad2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:41.032644 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-291d5381-affe-42d0-82ea-9a8901dcfad2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:41.033422 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-291d5381-affe-42d0-82ea-9a8901dcfad2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:41.033861 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-291d5381-affe-42d0-82ea-9a8901dcfad2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:41.163957 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-291d5381-affe-42d0-82ea-9a8901dcfad2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:41.171702 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-291d5381-affe-42d0-82ea-9a8901dcfad2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.151080 Mar 03 02:53:41.172262 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1305/2393] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:41 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:41.526382 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1ee5edb8-460c-4c6b-b5f7-937f1628b594 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:41.526986 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1ee5edb8-460c-4c6b-b5f7-937f1628b594 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:41.533118 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1ee5edb8-460c-4c6b-b5f7-937f1628b594 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:41.533570 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1ee5edb8-460c-4c6b-b5f7-937f1628b594 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:41.534336 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1ee5edb8-460c-4c6b-b5f7-937f1628b594 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:41.534773 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1ee5edb8-460c-4c6b-b5f7-937f1628b594 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:41.668758 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1ee5edb8-460c-4c6b-b5f7-937f1628b594 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:41.676421 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1ee5edb8-460c-4c6b-b5f7-937f1628b594 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.153841 Mar 03 02:53:41.676982 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1306/2394] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:41 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:41.681410 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2678c338-beb0-44b7-8dd3-172f4b6fe360 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:41.682005 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2678c338-beb0-44b7-8dd3-172f4b6fe360 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:41.687873 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2678c338-beb0-44b7-8dd3-172f4b6fe360 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:41.688328 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2678c338-beb0-44b7-8dd3-172f4b6fe360 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:41.689098 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2678c338-beb0-44b7-8dd3-172f4b6fe360 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:41.689531 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2678c338-beb0-44b7-8dd3-172f4b6fe360 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:41.748078 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2678c338-beb0-44b7-8dd3-172f4b6fe360 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:41.756627 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2678c338-beb0-44b7-8dd3-172f4b6fe360 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.078690 Mar 03 02:53:41.757493 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1307/2395] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:41 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:41.761661 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2ecd38b4-5169-4228-b4b0-14fca74f28e7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:41.762258 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2ecd38b4-5169-4228-b4b0-14fca74f28e7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:41.768337 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2ecd38b4-5169-4228-b4b0-14fca74f28e7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:41.768785 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2ecd38b4-5169-4228-b4b0-14fca74f28e7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:41.769553 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2ecd38b4-5169-4228-b4b0-14fca74f28e7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:41.769994 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2ecd38b4-5169-4228-b4b0-14fca74f28e7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:41.899062 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2ecd38b4-5169-4228-b4b0-14fca74f28e7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:41.906959 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2ecd38b4-5169-4228-b4b0-14fca74f28e7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.148797 Mar 03 02:53:41.907523 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1308/2396] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:41 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:42.189239 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4df6d6c6-af88-4a48-a941-b561aee544bc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:42.189870 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4df6d6c6-af88-4a48-a941-b561aee544bc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:42.195894 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4df6d6c6-af88-4a48-a941-b561aee544bc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:42.196338 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4df6d6c6-af88-4a48-a941-b561aee544bc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:42.197101 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4df6d6c6-af88-4a48-a941-b561aee544bc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:42.197533 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4df6d6c6-af88-4a48-a941-b561aee544bc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:42.328885 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4df6d6c6-af88-4a48-a941-b561aee544bc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:42.336442 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4df6d6c6-af88-4a48-a941-b561aee544bc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.151786 Mar 03 02:53:42.336998 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1309/2397] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:42 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:42.693020 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-26182c8e-53e8-47ca-b30f-ebefab8a28f9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:42.693626 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-26182c8e-53e8-47ca-b30f-ebefab8a28f9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:42.699260 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-26182c8e-53e8-47ca-b30f-ebefab8a28f9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:42.699743 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-26182c8e-53e8-47ca-b30f-ebefab8a28f9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:42.700509 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-26182c8e-53e8-47ca-b30f-ebefab8a28f9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:42.700938 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-26182c8e-53e8-47ca-b30f-ebefab8a28f9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:42.832773 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-26182c8e-53e8-47ca-b30f-ebefab8a28f9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:42.840633 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-26182c8e-53e8-47ca-b30f-ebefab8a28f9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.151384 Mar 03 02:53:42.841196 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1310/2398] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:42 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:42.846571 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-76d93284-40cb-41f8-84a2-8bd7e94e233d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:42.847165 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-76d93284-40cb-41f8-84a2-8bd7e94e233d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:42.852657 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-76d93284-40cb-41f8-84a2-8bd7e94e233d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:42.853103 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-76d93284-40cb-41f8-84a2-8bd7e94e233d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:42.853865 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-76d93284-40cb-41f8-84a2-8bd7e94e233d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:42.854297 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-76d93284-40cb-41f8-84a2-8bd7e94e233d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:42.916851 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-76d93284-40cb-41f8-84a2-8bd7e94e233d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:42.925024 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-76d93284-40cb-41f8-84a2-8bd7e94e233d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.082870 Mar 03 02:53:42.925589 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1311/2399] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:42 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:42.929973 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-94c40030-904f-4797-902c-f498ffb03a55 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:42.930562 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-94c40030-904f-4797-902c-f498ffb03a55 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:42.935919 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-94c40030-904f-4797-902c-f498ffb03a55 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:42.936387 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-94c40030-904f-4797-902c-f498ffb03a55 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:42.937127 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-94c40030-904f-4797-902c-f498ffb03a55 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:42.937551 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-94c40030-904f-4797-902c-f498ffb03a55 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:43.067504 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-94c40030-904f-4797-902c-f498ffb03a55 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:43.075245 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-94c40030-904f-4797-902c-f498ffb03a55 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.148711 Mar 03 02:53:43.075830 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1312/2400] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:42 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:43.353610 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1f91613c-5c77-487b-a974-51aa852bb5a5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:43.354232 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1f91613c-5c77-487b-a974-51aa852bb5a5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:43.361389 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1f91613c-5c77-487b-a974-51aa852bb5a5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:43.361829 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1f91613c-5c77-487b-a974-51aa852bb5a5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:43.362588 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1f91613c-5c77-487b-a974-51aa852bb5a5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:43.363017 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1f91613c-5c77-487b-a974-51aa852bb5a5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:43.489991 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1f91613c-5c77-487b-a974-51aa852bb5a5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:43.497663 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1f91613c-5c77-487b-a974-51aa852bb5a5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.147793 Mar 03 02:53:43.498235 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1313/2401] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:43 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:43.859412 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3d9c8ced-7d11-4772-af01-2d0eaff9511c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:43.860051 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3d9c8ced-7d11-4772-af01-2d0eaff9511c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:43.865891 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3d9c8ced-7d11-4772-af01-2d0eaff9511c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:43.866344 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3d9c8ced-7d11-4772-af01-2d0eaff9511c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:43.867118 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3d9c8ced-7d11-4772-af01-2d0eaff9511c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:43.867559 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3d9c8ced-7d11-4772-af01-2d0eaff9511c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:44.000658 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-3d9c8ced-7d11-4772-af01-2d0eaff9511c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:44.008358 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3d9c8ced-7d11-4772-af01-2d0eaff9511c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.153967 Mar 03 02:53:44.008918 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1314/2402] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:43 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:44.013196 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-837fd381-19f9-4105-80bd-2e9375540020 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:44.013812 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-837fd381-19f9-4105-80bd-2e9375540020 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:44.019062 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-837fd381-19f9-4105-80bd-2e9375540020 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:44.019507 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-837fd381-19f9-4105-80bd-2e9375540020 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:44.020298 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-837fd381-19f9-4105-80bd-2e9375540020 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:44.020757 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-837fd381-19f9-4105-80bd-2e9375540020 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:44.078971 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-837fd381-19f9-4105-80bd-2e9375540020 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:44.086737 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-837fd381-19f9-4105-80bd-2e9375540020 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.076889 Mar 03 02:53:44.087297 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1315/2403] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:44 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:44.093204 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-cc8e336d-e356-4bd0-81d6-80fd904398dd tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:44.093802 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-cc8e336d-e356-4bd0-81d6-80fd904398dd tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:44.099591 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cc8e336d-e356-4bd0-81d6-80fd904398dd tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:44.100079 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cc8e336d-e356-4bd0-81d6-80fd904398dd tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:44.100872 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cc8e336d-e356-4bd0-81d6-80fd904398dd tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:44.101296 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cc8e336d-e356-4bd0-81d6-80fd904398dd tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:44.229763 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-cc8e336d-e356-4bd0-81d6-80fd904398dd tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:44.237614 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-cc8e336d-e356-4bd0-81d6-80fd904398dd tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.149375 Mar 03 02:53:44.238170 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1316/2404] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:44 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:44.515345 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-594702f0-67d9-44ea-90d8-86810d43a2ec tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:44.516020 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-594702f0-67d9-44ea-90d8-86810d43a2ec tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:44.522040 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-594702f0-67d9-44ea-90d8-86810d43a2ec tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:44.522492 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-594702f0-67d9-44ea-90d8-86810d43a2ec tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:44.523268 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-594702f0-67d9-44ea-90d8-86810d43a2ec tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:44.523736 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-594702f0-67d9-44ea-90d8-86810d43a2ec tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:44.657163 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-594702f0-67d9-44ea-90d8-86810d43a2ec tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:44.664858 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-594702f0-67d9-44ea-90d8-86810d43a2ec tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.153488 Mar 03 02:53:44.665427 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1317/2405] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:44 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:45.025961 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-94b7556d-cfb2-4957-98f2-1f7f2c6b8d22 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:45.026564 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-94b7556d-cfb2-4957-98f2-1f7f2c6b8d22 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:45.032978 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-94b7556d-cfb2-4957-98f2-1f7f2c6b8d22 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:45.033423 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-94b7556d-cfb2-4957-98f2-1f7f2c6b8d22 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:45.034187 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-94b7556d-cfb2-4957-98f2-1f7f2c6b8d22 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:45.034620 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-94b7556d-cfb2-4957-98f2-1f7f2c6b8d22 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:45.163523 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-94b7556d-cfb2-4957-98f2-1f7f2c6b8d22 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:45.171377 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-94b7556d-cfb2-4957-98f2-1f7f2c6b8d22 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.149342 Mar 03 02:53:45.171998 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1318/2406] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:45 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:45.176297 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-00a8a297-9779-4bc9-ae12-4eb918c176eb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:45.176894 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-00a8a297-9779-4bc9-ae12-4eb918c176eb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:45.182242 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-00a8a297-9779-4bc9-ae12-4eb918c176eb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:45.182693 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-00a8a297-9779-4bc9-ae12-4eb918c176eb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:45.183468 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-00a8a297-9779-4bc9-ae12-4eb918c176eb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:45.183946 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-00a8a297-9779-4bc9-ae12-4eb918c176eb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:45.246916 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-00a8a297-9779-4bc9-ae12-4eb918c176eb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:45.255356 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-00a8a297-9779-4bc9-ae12-4eb918c176eb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.082415 Mar 03 02:53:45.255976 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1319/2407] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:45 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:45.260255 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8b6fb798-e2da-4851-a184-d9729470151f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:45.260855 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8b6fb798-e2da-4851-a184-d9729470151f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:45.266698 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b6fb798-e2da-4851-a184-d9729470151f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:45.267151 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b6fb798-e2da-4851-a184-d9729470151f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:45.267961 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b6fb798-e2da-4851-a184-d9729470151f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:45.268402 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b6fb798-e2da-4851-a184-d9729470151f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:45.398215 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8b6fb798-e2da-4851-a184-d9729470151f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:45.406152 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8b6fb798-e2da-4851-a184-d9729470151f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.149268 Mar 03 02:53:45.406738 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1320/2408] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:45 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:45.682932 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-30e3aa29-94bc-46ed-b3a2-546bbe158740 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:45.683553 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-30e3aa29-94bc-46ed-b3a2-546bbe158740 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:45.690833 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-30e3aa29-94bc-46ed-b3a2-546bbe158740 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:45.691285 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-30e3aa29-94bc-46ed-b3a2-546bbe158740 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:45.692083 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-30e3aa29-94bc-46ed-b3a2-546bbe158740 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:45.692520 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-30e3aa29-94bc-46ed-b3a2-546bbe158740 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:45.820430 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-30e3aa29-94bc-46ed-b3a2-546bbe158740 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:45.828623 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-30e3aa29-94bc-46ed-b3a2-546bbe158740 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.149574 Mar 03 02:53:45.829185 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1321/2409] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:45 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:46.187894 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3f104358-fb5f-4cf4-acc0-713b67d73c70 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:46.188498 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3f104358-fb5f-4cf4-acc0-713b67d73c70 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:46.194295 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3f104358-fb5f-4cf4-acc0-713b67d73c70 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:46.194742 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3f104358-fb5f-4cf4-acc0-713b67d73c70 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:46.195508 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3f104358-fb5f-4cf4-acc0-713b67d73c70 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:46.195971 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3f104358-fb5f-4cf4-acc0-713b67d73c70 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:46.328036 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-3f104358-fb5f-4cf4-acc0-713b67d73c70 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:46.335540 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3f104358-fb5f-4cf4-acc0-713b67d73c70 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.151638 Mar 03 02:53:46.336334 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1322/2410] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:46 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:46.340547 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3b2b64a0-83f7-4823-9d45-f5d5983a514c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:46.341135 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3b2b64a0-83f7-4823-9d45-f5d5983a514c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:46.346874 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3b2b64a0-83f7-4823-9d45-f5d5983a514c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:46.347318 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3b2b64a0-83f7-4823-9d45-f5d5983a514c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:46.348109 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3b2b64a0-83f7-4823-9d45-f5d5983a514c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:46.348536 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3b2b64a0-83f7-4823-9d45-f5d5983a514c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:46.406712 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-3b2b64a0-83f7-4823-9d45-f5d5983a514c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:46.414233 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3b2b64a0-83f7-4823-9d45-f5d5983a514c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.077113 Mar 03 02:53:46.414789 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1323/2411] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:46 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:46.422774 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ba037e7b-3dfb-4650-a286-83301da3f685 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:46.423367 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ba037e7b-3dfb-4650-a286-83301da3f685 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:46.428891 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ba037e7b-3dfb-4650-a286-83301da3f685 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:46.429336 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ba037e7b-3dfb-4650-a286-83301da3f685 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:46.430097 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ba037e7b-3dfb-4650-a286-83301da3f685 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:46.430526 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ba037e7b-3dfb-4650-a286-83301da3f685 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:46.560121 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ba037e7b-3dfb-4650-a286-83301da3f685 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:46.567854 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ba037e7b-3dfb-4650-a286-83301da3f685 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.148561 Mar 03 02:53:46.568423 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1324/2412] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:46 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:46.845928 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e25a1a48-d451-44f4-b9e1-dec33b97fe30 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:46.846618 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e25a1a48-d451-44f4-b9e1-dec33b97fe30 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:46.852868 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e25a1a48-d451-44f4-b9e1-dec33b97fe30 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:46.853313 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e25a1a48-d451-44f4-b9e1-dec33b97fe30 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:46.854083 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e25a1a48-d451-44f4-b9e1-dec33b97fe30 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:46.854516 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e25a1a48-d451-44f4-b9e1-dec33b97fe30 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:46.985516 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e25a1a48-d451-44f4-b9e1-dec33b97fe30 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:46.993123 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e25a1a48-d451-44f4-b9e1-dec33b97fe30 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.151245 Mar 03 02:53:46.993681 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1325/2413] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:46 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:47.352195 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-16b104f6-e36a-49fc-83e4-bff0f6e3b693 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:47.352823 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-16b104f6-e36a-49fc-83e4-bff0f6e3b693 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:47.359344 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-16b104f6-e36a-49fc-83e4-bff0f6e3b693 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:47.359816 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-16b104f6-e36a-49fc-83e4-bff0f6e3b693 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:47.360579 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-16b104f6-e36a-49fc-83e4-bff0f6e3b693 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:47.361011 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-16b104f6-e36a-49fc-83e4-bff0f6e3b693 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:47.489638 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-16b104f6-e36a-49fc-83e4-bff0f6e3b693 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:47.497228 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-16b104f6-e36a-49fc-83e4-bff0f6e3b693 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.148892 Mar 03 02:53:47.497785 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1326/2414] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:47 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:47.502214 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-182d49d0-be0b-4e70-8305-6ce4286b950d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:47.502808 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-182d49d0-be0b-4e70-8305-6ce4286b950d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:47.508050 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-182d49d0-be0b-4e70-8305-6ce4286b950d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:47.508495 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-182d49d0-be0b-4e70-8305-6ce4286b950d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:47.509247 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-182d49d0-be0b-4e70-8305-6ce4286b950d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:47.509680 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-182d49d0-be0b-4e70-8305-6ce4286b950d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:47.570431 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-182d49d0-be0b-4e70-8305-6ce4286b950d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:47.577982 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-182d49d0-be0b-4e70-8305-6ce4286b950d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079211 Mar 03 02:53:47.578534 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1327/2415] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:47 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:47.585023 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-aeb7b724-3fbe-470e-82fe-6eae37948df5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:47.585619 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-aeb7b724-3fbe-470e-82fe-6eae37948df5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:47.591148 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aeb7b724-3fbe-470e-82fe-6eae37948df5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:47.591619 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aeb7b724-3fbe-470e-82fe-6eae37948df5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:47.593141 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aeb7b724-3fbe-470e-82fe-6eae37948df5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:47.593582 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aeb7b724-3fbe-470e-82fe-6eae37948df5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:47.724396 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-aeb7b724-3fbe-470e-82fe-6eae37948df5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:47.732287 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-aeb7b724-3fbe-470e-82fe-6eae37948df5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.150508 Mar 03 02:53:47.732924 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1328/2416] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:47 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:48.009796 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-eb60aaea-3855-4564-834d-9bdc18149bc7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:48.010405 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-eb60aaea-3855-4564-834d-9bdc18149bc7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:48.016651 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-eb60aaea-3855-4564-834d-9bdc18149bc7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:48.017099 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-eb60aaea-3855-4564-834d-9bdc18149bc7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:48.017878 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-eb60aaea-3855-4564-834d-9bdc18149bc7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:48.018311 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-eb60aaea-3855-4564-834d-9bdc18149bc7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:48.146307 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-eb60aaea-3855-4564-834d-9bdc18149bc7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:48.154036 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-eb60aaea-3855-4564-834d-9bdc18149bc7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.148125 Mar 03 02:53:48.154664 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1329/2417] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:48 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:48.514739 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0e13ae33-584f-4fbd-8181-2d4058127110 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:48.515333 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0e13ae33-584f-4fbd-8181-2d4058127110 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:48.521116 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0e13ae33-584f-4fbd-8181-2d4058127110 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:48.521560 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0e13ae33-584f-4fbd-8181-2d4058127110 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:48.522327 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0e13ae33-584f-4fbd-8181-2d4058127110 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:48.522760 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0e13ae33-584f-4fbd-8181-2d4058127110 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:48.655775 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0e13ae33-584f-4fbd-8181-2d4058127110 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:48.663302 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0e13ae33-584f-4fbd-8181-2d4058127110 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.152973 Mar 03 02:53:48.663966 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1330/2418] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:48 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:48.668221 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3ccfb6af-c6ee-4c15-930c-f9aa5ff07715 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:48.668809 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3ccfb6af-c6ee-4c15-930c-f9aa5ff07715 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:48.674843 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3ccfb6af-c6ee-4c15-930c-f9aa5ff07715 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:48.675337 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3ccfb6af-c6ee-4c15-930c-f9aa5ff07715 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:48.676127 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3ccfb6af-c6ee-4c15-930c-f9aa5ff07715 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:48.676559 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3ccfb6af-c6ee-4c15-930c-f9aa5ff07715 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:48.735084 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-3ccfb6af-c6ee-4c15-930c-f9aa5ff07715 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:48.742716 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3ccfb6af-c6ee-4c15-930c-f9aa5ff07715 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.077830 Mar 03 02:53:48.743316 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1331/2419] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:48 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:48.749622 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-89289021-3292-4592-8ad7-db30fad4eb66 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:48.750212 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-89289021-3292-4592-8ad7-db30fad4eb66 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:48.755597 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-89289021-3292-4592-8ad7-db30fad4eb66 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:48.756068 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-89289021-3292-4592-8ad7-db30fad4eb66 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:48.756828 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-89289021-3292-4592-8ad7-db30fad4eb66 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:48.757259 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-89289021-3292-4592-8ad7-db30fad4eb66 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:48.885792 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-89289021-3292-4592-8ad7-db30fad4eb66 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:48.893562 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-89289021-3292-4592-8ad7-db30fad4eb66 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.148065 Mar 03 02:53:48.894128 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1332/2420] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:48 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:49.171714 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6bdd686b-2c01-4870-8917-1a8cdfcf8245 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:49.172300 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6bdd686b-2c01-4870-8917-1a8cdfcf8245 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:49.178384 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6bdd686b-2c01-4870-8917-1a8cdfcf8245 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:49.178833 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6bdd686b-2c01-4870-8917-1a8cdfcf8245 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:49.179621 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6bdd686b-2c01-4870-8917-1a8cdfcf8245 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:49.180064 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6bdd686b-2c01-4870-8917-1a8cdfcf8245 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:49.312691 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6bdd686b-2c01-4870-8917-1a8cdfcf8245 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:49.320358 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6bdd686b-2c01-4870-8917-1a8cdfcf8245 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.153144 Mar 03 02:53:49.320919 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1333/2421] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:49 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:49.680731 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c430379a-e538-48bf-9e7a-6b4641c48f0a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:49.681402 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c430379a-e538-48bf-9e7a-6b4641c48f0a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:49.687429 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c430379a-e538-48bf-9e7a-6b4641c48f0a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:49.688022 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c430379a-e538-48bf-9e7a-6b4641c48f0a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:49.688798 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c430379a-e538-48bf-9e7a-6b4641c48f0a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:49.689240 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c430379a-e538-48bf-9e7a-6b4641c48f0a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:49.821390 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c430379a-e538-48bf-9e7a-6b4641c48f0a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:49.830379 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c430379a-e538-48bf-9e7a-6b4641c48f0a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.153452 Mar 03 02:53:49.830944 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1334/2422] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:49 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:53:49.835268 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a98e1ae1-4f59-42df-9fcd-36cfd5fa5099 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:49.835893 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a98e1ae1-4f59-42df-9fcd-36cfd5fa5099 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:49.841469 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a98e1ae1-4f59-42df-9fcd-36cfd5fa5099 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:49.842549 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a98e1ae1-4f59-42df-9fcd-36cfd5fa5099 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:49.843343 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a98e1ae1-4f59-42df-9fcd-36cfd5fa5099 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:49.843811 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a98e1ae1-4f59-42df-9fcd-36cfd5fa5099 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:49.906174 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a98e1ae1-4f59-42df-9fcd-36cfd5fa5099 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:49.913872 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a98e1ae1-4f59-42df-9fcd-36cfd5fa5099 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.082002 Mar 03 02:53:49.914430 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1335/2423] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:49 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:49.918689 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-90f0729e-917b-4b2e-93c5-3a6d3ffda9db tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:49.919286 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-90f0729e-917b-4b2e-93c5-3a6d3ffda9db tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:49.925185 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-90f0729e-917b-4b2e-93c5-3a6d3ffda9db tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:49.925658 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-90f0729e-917b-4b2e-93c5-3a6d3ffda9db tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:49.926456 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-90f0729e-917b-4b2e-93c5-3a6d3ffda9db tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:49.926893 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-90f0729e-917b-4b2e-93c5-3a6d3ffda9db tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:50.056357 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-90f0729e-917b-4b2e-93c5-3a6d3ffda9db tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:53:50.064781 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-90f0729e-917b-4b2e-93c5-3a6d3ffda9db tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.149413 Mar 03 02:53:50.065371 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1336/2424] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:53:49 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:53:50.262261 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-afb6bb60-9fc4-4fdd-921e-e397cdf858c0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:53:50.262919 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-afb6bb60-9fc4-4fdd-921e-e397cdf858c0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:53:50.268837 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-afb6bb60-9fc4-4fdd-921e-e397cdf858c0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:50.269283 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-afb6bb60-9fc4-4fdd-921e-e397cdf858c0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:50.270048 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-afb6bb60-9fc4-4fdd-921e-e397cdf858c0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:50.270479 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-afb6bb60-9fc4-4fdd-921e-e397cdf858c0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:50.293450 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-afb6bb60-9fc4-4fdd-921e-e397cdf858c0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Going to try to terminate instance {{(pid=116858) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 03 02:53:50.299740 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.compute.api [None req-afb6bb60-9fc4-4fdd-921e-e397cdf858c0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Working on deleting snapshot 2f948944-33ce-4200-b673-40eb8ceb9e37 from shelved instance... Mar 03 02:53:50.360769 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: WARNING nova.compute.api [None req-afb6bb60-9fc4-4fdd-921e-e397cdf858c0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Failed to delete snapshot from shelved instance (Image 2f948944-33ce-4200-b673-40eb8ceb9e37 could not be found.).: nova.exception.ImageNotFound: Image 2f948944-33ce-4200-b673-40eb8ceb9e37 could not be found. Mar 03 02:53:50.402345 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-afb6bb60-9fc4-4fdd-921e-e397cdf858c0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Doing local delete in cell 056eea21-8cd3-453b-8bc6-a26b173c51c8(cell1) {{(pid=116858) _delete /opt/stack/nova/nova/compute/api.py:2489}} Mar 03 02:53:50.403136 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-afb6bb60-9fc4-4fdd-921e-e397cdf858c0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:53:50.403576 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-afb6bb60-9fc4-4fdd-921e-e397cdf858c0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:53:50.404019 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.compute.api [None req-afb6bb60-9fc4-4fdd-921e-e397cdf858c0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Mar 03 02:53:50.407670 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.network.neutron [None req-afb6bb60-9fc4-4fdd-921e-e397cdf858c0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] deallocate_for_instance() {{(pid=116858) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1789}} Mar 03 02:53:50.440539 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.network.neutron [None req-afb6bb60-9fc4-4fdd-921e-e397cdf858c0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Instance cache missing network info. {{(pid=116858) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3309}} Mar 03 02:53:50.448323 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.network.neutron [None req-afb6bb60-9fc4-4fdd-921e-e397cdf858c0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Updating instance_info_cache with network_info: [] {{(pid=116858) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Mar 03 02:54:35.542320 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: ERROR nova.volume.cinder [None req-afb6bb60-9fc4-4fdd-921e-e397cdf858c0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Delete attachment failed for attachment ca69d747-c300-4bb2-a7d8-e6ef55ad2d7e. Error: Volume attachment could not be found with filter: attachment_id = ca69d747-c300-4bb2-a7d8-e6ef55ad2d7e. (HTTP 404) (Request-ID: req-df8d62b6-d8c7-4674-9716-ee8d37c5008f) Code: 404: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = ca69d747-c300-4bb2-a7d8-e6ef55ad2d7e. (HTTP 404) (Request-ID: req-df8d62b6-d8c7-4674-9716-ee8d37c5008f) Mar 03 02:54:35.555928 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: WARNING nova.compute.api [None req-afb6bb60-9fc4-4fdd-921e-e397cdf858c0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Ignoring volume cleanup failure due to Volume attachment ca69d747-c300-4bb2-a7d8-e6ef55ad2d7e could not be found.: nova.exception.VolumeAttachmentNotFound: Volume attachment ca69d747-c300-4bb2-a7d8-e6ef55ad2d7e could not be found. Mar 03 02:54:35.737280 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.scheduler.client.report [None req-afb6bb60-9fc4-4fdd-921e-e397cdf858c0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Deleted allocations for instance f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 Mar 03 02:54:35.737568 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.scheduler.client.report [None req-563adb8b-9ff6-4f70-b314-d7bb9f239a34 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Deleted allocations for instance f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 Mar 03 02:54:35.863357 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-afb6bb60-9fc4-4fdd-921e-e397cdf858c0 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 204 len: 0 microversion: 2.20 time: 45.604876 Mar 03 02:54:35.864119 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1337/2425] 10.222.0.30 () {60 vars in 1279 bytes} [Thu Mar 3 02:53:50 2022] DELETE /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 0 bytes in 45606 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Mar 03 02:54:35.869075 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a8799d8f-779a-4cab-8e8c-08a9222a83f3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:35.869776 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a8799d8f-779a-4cab-8e8c-08a9222a83f3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:35.876607 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a8799d8f-779a-4cab-8e8c-08a9222a83f3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:35.877066 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a8799d8f-779a-4cab-8e8c-08a9222a83f3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:35.877844 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a8799d8f-779a-4cab-8e8c-08a9222a83f3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:35.878282 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a8799d8f-779a-4cab-8e8c-08a9222a83f3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:35.891050 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi [None req-563adb8b-9ff6-4f70-b314-d7bb9f239a34 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Unexpected exception in API method: nova.exception.ObjectActionError: Object action destroy failed because: host changed Mar 03 02:54:35.891050 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Mar 03 02:54:35.891050 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance.py", line 654, in destroy Mar 03 02:54:35.891050 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi db_inst = db.instance_destroy(self._context, self.uuid, Mar 03 02:54:35.891050 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Mar 03 02:54:35.891050 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Mar 03 02:54:35.891050 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Mar 03 02:54:35.891050 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi ectxt.value = e.inner_exc Mar 03 02:54:35.891050 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Mar 03 02:54:35.891050 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi self.force_reraise() Mar 03 02:54:35.891050 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Mar 03 02:54:35.891050 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi raise self.value Mar 03 02:54:35.891050 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Mar 03 02:54:35.891050 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Mar 03 02:54:35.891050 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 190, in wrapper Mar 03 02:54:35.891050 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Mar 03 02:54:35.891050 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 1320, in instance_destroy Mar 03 02:54:35.891050 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi raise exception.ConstraintNotMet() Mar 03 02:54:35.892551 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi nova.exception.ConstraintNotMet: Constraint not met. Mar 03 02:54:35.892551 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi Mar 03 02:54:35.892551 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Mar 03 02:54:35.892551 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi Mar 03 02:54:35.892551 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Mar 03 02:54:35.892551 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 658, in wrapped Mar 03 02:54:35.892551 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Mar 03 02:54:35.892551 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Mar 03 02:54:35.892551 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Mar 03 02:54:35.892551 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 903, in _delete Mar 03 02:54:35.892551 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi self.compute_api.delete(context, instance) Mar 03 02:54:35.892551 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Mar 03 02:54:35.892551 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Mar 03 02:54:35.892551 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Mar 03 02:54:35.892551 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Mar 03 02:54:35.892551 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2665, in delete Mar 03 02:54:35.892551 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi self._delete_instance(context, instance) Mar 03 02:54:35.892551 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2656, in _delete_instance Mar 03 02:54:35.892551 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi self._delete(context, instance, 'delete', self._do_delete, Mar 03 02:54:35.892551 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2492, in _delete Mar 03 02:54:35.893968 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi self._local_delete(cctxt, instance, bdms, delete_type, cb) Mar 03 02:54:35.893968 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2606, in _local_delete Mar 03 02:54:35.893968 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi instance.destroy() Mar 03 02:54:35.893968 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Mar 03 02:54:35.893968 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Mar 03 02:54:35.893968 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance.py", line 659, in destroy Mar 03 02:54:35.893968 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi raise exception.ObjectActionError(action='destroy', Mar 03 02:54:35.893968 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi nova.exception.ObjectActionError: Object action destroy failed because: host changed Mar 03 02:54:35.893968 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: ERROR nova.api.openstack.wsgi Mar 03 02:54:35.893968 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.wsgi [None req-563adb8b-9ff6-4f70-b314-d7bb9f239a34 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Mar 03 02:54:35.893968 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: Mar 03 02:54:35.893968 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-563adb8b-9ff6-4f70-b314-d7bb9f239a34 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Mar 03 02:54:35.893968 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: {{(pid=116859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:54:35.895068 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-563adb8b-9ff6-4f70-b314-d7bb9f239a34 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 500 len: 206 microversion: 2.20 time: 105.695551 Mar 03 02:54:35.895839 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1089/2426] 10.222.0.30 () {60 vars in 1279 bytes} [Thu Mar 3 02:52:50 2022] DELETE /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 206 bytes in 105697 msecs (HTTP/1.1 500) 9 headers in 393 bytes (1 switches on core 0) Mar 03 02:54:36.022896 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-bb9fefc9-af76-495d-beda-7bc395959b30 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:36.023591 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-bb9fefc9-af76-495d-beda-7bc395959b30 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:36.026932 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a8799d8f-779a-4cab-8e8c-08a9222a83f3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:36.029578 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bb9fefc9-af76-495d-beda-7bc395959b30 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:36.030028 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bb9fefc9-af76-495d-beda-7bc395959b30 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:36.030815 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bb9fefc9-af76-495d-beda-7bc395959b30 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:36.031254 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bb9fefc9-af76-495d-beda-7bc395959b30 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:36.035480 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a8799d8f-779a-4cab-8e8c-08a9222a83f3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.170279 Mar 03 02:54:36.036145 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1338/2427] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:35 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:36.040595 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-38abdfba-9c43-4e17-b0ed-c092a528f5bb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:36.041272 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-38abdfba-9c43-4e17-b0ed-c092a528f5bb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:36.047528 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-38abdfba-9c43-4e17-b0ed-c092a528f5bb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:36.048083 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-38abdfba-9c43-4e17-b0ed-c092a528f5bb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:36.048941 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-38abdfba-9c43-4e17-b0ed-c092a528f5bb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:36.049705 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-38abdfba-9c43-4e17-b0ed-c092a528f5bb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:36.109898 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-38abdfba-9c43-4e17-b0ed-c092a528f5bb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:36.117558 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-38abdfba-9c43-4e17-b0ed-c092a528f5bb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080409 Mar 03 02:54:36.118133 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1339/2428] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:36 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:36.122559 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2eb63c1c-abd6-43c5-af32-3e2e758a22c7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:36.123536 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2eb63c1c-abd6-43c5-af32-3e2e758a22c7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:36.128861 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2eb63c1c-abd6-43c5-af32-3e2e758a22c7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:36.129315 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2eb63c1c-abd6-43c5-af32-3e2e758a22c7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:36.130102 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2eb63c1c-abd6-43c5-af32-3e2e758a22c7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:36.130542 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2eb63c1c-abd6-43c5-af32-3e2e758a22c7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:36.174957 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-bb9fefc9-af76-495d-beda-7bc395959b30 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:36.182663 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-bb9fefc9-af76-495d-beda-7bc395959b30 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.285994 Mar 03 02:54:36.183330 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1090/2429] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:35 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:36.196362 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d3a5b8f1-d3ab-4c4f-9007-8d8459202587 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:36.196970 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d3a5b8f1-d3ab-4c4f-9007-8d8459202587 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:36.202708 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d3a5b8f1-d3ab-4c4f-9007-8d8459202587 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:36.203157 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d3a5b8f1-d3ab-4c4f-9007-8d8459202587 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:36.203966 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d3a5b8f1-d3ab-4c4f-9007-8d8459202587 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:36.204424 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d3a5b8f1-d3ab-4c4f-9007-8d8459202587 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:36.218281 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.wsgi [None req-d3a5b8f1-d3ab-4c4f-9007-8d8459202587 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] HTTP exception thrown: Instance f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 could not be found. Mar 03 02:54:36.218865 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d3a5b8f1-d3ab-4c4f-9007-8d8459202587 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Returning 404 to user: Instance f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 could not be found. {{(pid=116859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:54:36.219717 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d3a5b8f1-d3ab-4c4f-9007-8d8459202587 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 404 len: 111 microversion: 2.20 time: 0.027103 Mar 03 02:54:36.220263 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1091/2430] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:54:36 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 03 02:54:36.228596 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7c14410a-df61-44f2-b790-5bdb4ecd8eb4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '.version_select at 0x7fb3cbb9e670>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:36.246785 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7c14410a-df61-44f2-b790-5bdb4ecd8eb4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-933584465" status: 204 len: 0 microversion: 2.20 time: 0.021747 Mar 03 02:54:36.247347 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1092/2431] 10.222.0.30 () {60 vars in 1258 bytes} [Thu Mar 3 02:54:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-933584465 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Mar 03 02:54:36.266120 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2eb63c1c-abd6-43c5-af32-3e2e758a22c7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:36.274157 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2eb63c1c-abd6-43c5-af32-3e2e758a22c7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.155008 Mar 03 02:54:36.274748 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1340/2432] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:36 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:37.053098 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5c79fc9b-b4bd-4616-a6f3-4e8a6a4a0aa3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:37.053858 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5c79fc9b-b4bd-4616-a6f3-4e8a6a4a0aa3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:37.059101 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-463759a6-7c41-43cc-af6e-e33cf9f96ebc tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Action: 'create', calling method: .version_select at 0x7fb3cbc51dc0>, body: {"keypair": {"name": "tempest-keypair-1381735626"}} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:54:37.060819 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5c79fc9b-b4bd-4616-a6f3-4e8a6a4a0aa3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:37.061275 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5c79fc9b-b4bd-4616-a6f3-4e8a6a4a0aa3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:37.062054 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5c79fc9b-b4bd-4616-a6f3-4e8a6a4a0aa3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:37.062487 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5c79fc9b-b4bd-4616-a6f3-4e8a6a4a0aa3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:37.078276 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.quota [None req-463759a6-7c41-43cc-af6e-e33cf9f96ebc tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Getting quotas for project 09c4069c31144128952334c19272d2c6. Resources: {'key_pairs'} {{(pid=116858) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 03 02:54:37.085039 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.quota [None req-463759a6-7c41-43cc-af6e-e33cf9f96ebc tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Getting quotas for user f2f87d12584b4465b93c30d79d1ba832 and project 09c4069c31144128952334c19272d2c6. Resources: {'key_pairs'} {{(pid=116858) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 03 02:54:37.195995 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5c79fc9b-b4bd-4616-a6f3-4e8a6a4a0aa3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:37.204248 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5c79fc9b-b4bd-4616-a6f3-4e8a6a4a0aa3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.155194 Mar 03 02:54:37.204809 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1093/2433] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:37 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:37.209080 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-acab775f-1699-4ad9-b42d-17ca919c2a18 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:37.209673 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-acab775f-1699-4ad9-b42d-17ca919c2a18 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:37.215029 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-acab775f-1699-4ad9-b42d-17ca919c2a18 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:37.215477 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-acab775f-1699-4ad9-b42d-17ca919c2a18 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:37.216294 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-acab775f-1699-4ad9-b42d-17ca919c2a18 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:37.217177 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-acab775f-1699-4ad9-b42d-17ca919c2a18 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:37.245399 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.quota [None req-463759a6-7c41-43cc-af6e-e33cf9f96ebc tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Getting quotas for project 09c4069c31144128952334c19272d2c6. Resources: {'key_pairs'} {{(pid=116858) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 03 02:54:37.249951 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.quota [None req-463759a6-7c41-43cc-af6e-e33cf9f96ebc tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Getting quotas for user f2f87d12584b4465b93c30d79d1ba832 and project 09c4069c31144128952334c19272d2c6. Resources: {'key_pairs'} {{(pid=116858) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 03 02:54:37.262378 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-463759a6-7c41-43cc-af6e-e33cf9f96ebc tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.207304 Mar 03 02:54:37.262974 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1341/2434] 10.222.0.30 () {62 vars in 1198 bytes} [Thu Mar 3 02:54:37 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 209 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 03 02:54:37.269466 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9c5b4254-5d88-4a76-9b2c-8f80ce310289 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:37.270072 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9c5b4254-5d88-4a76-9b2c-8f80ce310289 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:37.275899 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9c5b4254-5d88-4a76-9b2c-8f80ce310289 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:37.276465 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9c5b4254-5d88-4a76-9b2c-8f80ce310289 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:37.277247 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9c5b4254-5d88-4a76-9b2c-8f80ce310289 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:37.278264 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9c5b4254-5d88-4a76-9b2c-8f80ce310289 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:37.278655 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-acab775f-1699-4ad9-b42d-17ca919c2a18 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:37.289636 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-acab775f-1699-4ad9-b42d-17ca919c2a18 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.083773 Mar 03 02:54:37.290237 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1094/2435] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:37 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:37.296898 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-070beafd-12ff-42aa-8041-a64b5c099600 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:37.297578 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-070beafd-12ff-42aa-8041-a64b5c099600 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:37.304079 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-070beafd-12ff-42aa-8041-a64b5c099600 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:37.304481 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-070beafd-12ff-42aa-8041-a64b5c099600 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:37.305288 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-070beafd-12ff-42aa-8041-a64b5c099600 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:37.305918 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-070beafd-12ff-42aa-8041-a64b5c099600 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:37.483445 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-070beafd-12ff-42aa-8041-a64b5c099600 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:37.492781 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-070beafd-12ff-42aa-8041-a64b5c099600 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.201383 Mar 03 02:54:37.493803 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1095/2436] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:37 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:37.574122 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9c5b4254-5d88-4a76-9b2c-8f80ce310289 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:37.583372 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9c5b4254-5d88-4a76-9b2c-8f80ce310289 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.318928 Mar 03 02:54:37.584659 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1342/2437] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:37 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:38.221122 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8bc3beeb-66cf-475d-af71-db24e4d2aa04 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:38.221715 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8bc3beeb-66cf-475d-af71-db24e4d2aa04 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:38.228031 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8bc3beeb-66cf-475d-af71-db24e4d2aa04 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:38.228498 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8bc3beeb-66cf-475d-af71-db24e4d2aa04 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:38.229288 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8bc3beeb-66cf-475d-af71-db24e4d2aa04 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:38.229719 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8bc3beeb-66cf-475d-af71-db24e4d2aa04 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:38.308567 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-67314f22-58fb-4339-b028-6833fc851429 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:38.311268 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-67314f22-58fb-4339-b028-6833fc851429 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:38.317734 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-67314f22-58fb-4339-b028-6833fc851429 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:38.318407 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-67314f22-58fb-4339-b028-6833fc851429 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:38.319195 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-67314f22-58fb-4339-b028-6833fc851429 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:38.319711 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-67314f22-58fb-4339-b028-6833fc851429 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:38.363705 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8bc3beeb-66cf-475d-af71-db24e4d2aa04 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:38.371653 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8bc3beeb-66cf-475d-af71-db24e4d2aa04 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.154404 Mar 03 02:54:38.372235 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1096/2438] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:38 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:38.392150 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-67314f22-58fb-4339-b028-6833fc851429 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:38.400177 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-67314f22-58fb-4339-b028-6833fc851429 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.095488 Mar 03 02:54:38.401585 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1343/2439] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:38 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:54:38.512080 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7362a150-396a-43eb-9d2a-856eebee7080 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:38.512689 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7362a150-396a-43eb-9d2a-856eebee7080 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:38.519580 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7362a150-396a-43eb-9d2a-856eebee7080 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:38.520070 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7362a150-396a-43eb-9d2a-856eebee7080 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:38.520853 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7362a150-396a-43eb-9d2a-856eebee7080 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:38.521286 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7362a150-396a-43eb-9d2a-856eebee7080 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:38.602215 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ae703c14-38c0-4ade-a619-11f731736c5c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:38.603239 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ae703c14-38c0-4ade-a619-11f731736c5c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:38.610366 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ae703c14-38c0-4ade-a619-11f731736c5c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:38.610824 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ae703c14-38c0-4ade-a619-11f731736c5c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:38.611692 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ae703c14-38c0-4ade-a619-11f731736c5c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:38.612108 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ae703c14-38c0-4ade-a619-11f731736c5c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:38.661163 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-7362a150-396a-43eb-9d2a-856eebee7080 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:38.669248 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7362a150-396a-43eb-9d2a-856eebee7080 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.160967 Mar 03 02:54:38.669989 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1097/2440] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:38 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:38.828524 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ae703c14-38c0-4ade-a619-11f731736c5c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:38.836148 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ae703c14-38c0-4ade-a619-11f731736c5c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.237945 Mar 03 02:54:38.836698 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1344/2441] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:38 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:38.891328 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b6f578ac-50de-4205-beda-a702ff26af27 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-513636183", "imageRef": "1fe11a1a-b4d0-46f5-89cd-501ceff49317", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a158f3aa-e152-4a15-91ae-f9397ac00beb"}], "security_groups": [{"name": "tempest-securitygroup--759613499"}], "key_name": "tempest-keypair-1381735626", "user_data": "}} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:54:38.993713 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.network.neutron [None req-b6f578ac-50de-4205-beda-a702ff26af27 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] validate_networks() for [('a158f3aa-e152-4a15-91ae-f9397ac00beb', None, None, None, None, None)] {{(pid=116859) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 03 02:54:39.390941 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-16864b3d-a81c-497f-926c-b706f88b30a6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:39.391552 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-16864b3d-a81c-497f-926c-b706f88b30a6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:39.397727 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-16864b3d-a81c-497f-926c-b706f88b30a6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:39.398204 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-16864b3d-a81c-497f-926c-b706f88b30a6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:39.399008 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-16864b3d-a81c-497f-926c-b706f88b30a6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:39.399437 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-16864b3d-a81c-497f-926c-b706f88b30a6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:39.454070 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-b6f578ac-50de-4205-beda-a702ff26af27 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Flavor limits 0:0:0 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 03 02:54:39.454609 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-b6f578ac-50de-4205-beda-a702ff26af27 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Image limits 0:0:0 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 03 02:54:39.454964 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-b6f578ac-50de-4205-beda-a702ff26af27 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Flavor pref 0:0:0 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 03 02:54:39.455374 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-b6f578ac-50de-4205-beda-a702ff26af27 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Image pref 0:0:0 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 03 02:54:39.456016 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-b6f578ac-50de-4205-beda-a702ff26af27 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 03 02:54:39.468358 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b6f578ac-50de-4205-beda-a702ff26af27 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:39.468813 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b6f578ac-50de-4205-beda-a702ff26af27 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:39.469632 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b6f578ac-50de-4205-beda-a702ff26af27 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:39.470075 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b6f578ac-50de-4205-beda-a702ff26af27 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:39.486717 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.quota [None req-b6f578ac-50de-4205-beda-a702ff26af27 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Getting quotas for project 09c4069c31144128952334c19272d2c6. Resources: {'instances', 'ram', 'cores'} {{(pid=116859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 03 02:54:39.490948 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.quota [None req-b6f578ac-50de-4205-beda-a702ff26af27 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Getting quotas for user f2f87d12584b4465b93c30d79d1ba832 and project 09c4069c31144128952334c19272d2c6. Resources: {'instances', 'ram', 'cores'} {{(pid=116859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 03 02:54:39.502329 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b6f578ac-50de-4205-beda-a702ff26af27 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Going to run 1 instances... {{(pid=116859) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 03 02:54:39.504702 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b6f578ac-50de-4205-beda-a702ff26af27 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: 70518a58-de77-4946-ae7f-ec562c0556ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1fe11a1a-b4d0-46f5-89cd-501ceff49317',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 03 02:54:39.533343 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-16864b3d-a81c-497f-926c-b706f88b30a6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:39.541758 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-16864b3d-a81c-497f-926c-b706f88b30a6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.155768 Mar 03 02:54:39.542558 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1345/2442] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:39 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:54:39.548088 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6ffed3c4-95cf-4380-b2ec-7b8d366b4361 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:39.548887 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6ffed3c4-95cf-4380-b2ec-7b8d366b4361 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:39.554326 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b6f578ac-50de-4205-beda-a702ff26af27 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.668223 Mar 03 02:54:39.554968 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1098/2443] 10.222.0.30 () {62 vars in 1187 bytes} [Thu Mar 3 02:54:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 03 02:54:39.555290 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6ffed3c4-95cf-4380-b2ec-7b8d366b4361 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:39.555887 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6ffed3c4-95cf-4380-b2ec-7b8d366b4361 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:39.556680 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6ffed3c4-95cf-4380-b2ec-7b8d366b4361 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:39.557119 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6ffed3c4-95cf-4380-b2ec-7b8d366b4361 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:39.565409 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2ecde42a-aa63-4107-b972-72c77545b606 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:39.566011 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2ecde42a-aa63-4107-b972-72c77545b606 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: 70518a58-de77-4946-ae7f-ec562c0556ea] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:39.630418 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2ecde42a-aa63-4107-b972-72c77545b606 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:39.634484 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6ffed3c4-95cf-4380-b2ec-7b8d366b4361 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:39.639585 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2ecde42a-aa63-4107-b972-72c77545b606 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:39.641165 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2ecde42a-aa63-4107-b972-72c77545b606 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:39.642300 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2ecde42a-aa63-4107-b972-72c77545b606 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/70518a58-de77-4946-ae7f-ec562c0556ea" status: 200 len: 1281 microversion: 2.20 time: 0.080795 Mar 03 02:54:39.642628 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6ffed3c4-95cf-4380-b2ec-7b8d366b4361 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.098572 Mar 03 02:54:39.643316 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1099/2444] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:54:39 2022] GET /compute/v2.1/servers/70518a58-de77-4946-ae7f-ec562c0556ea => generated 1281 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:54:39.643463 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1346/2445] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:39 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:39.686391 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-eeb07b14-cd75-4d69-b966-144bfb831ab5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:39.686992 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-eeb07b14-cd75-4d69-b966-144bfb831ab5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:39.692857 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eeb07b14-cd75-4d69-b966-144bfb831ab5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:39.693308 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eeb07b14-cd75-4d69-b966-144bfb831ab5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:39.694077 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eeb07b14-cd75-4d69-b966-144bfb831ab5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:39.694510 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eeb07b14-cd75-4d69-b966-144bfb831ab5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:39.838187 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-eeb07b14-cd75-4d69-b966-144bfb831ab5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:39.846138 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-eeb07b14-cd75-4d69-b966-144bfb831ab5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.163843 Mar 03 02:54:39.846795 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1100/2446] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:39 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:39.854220 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4e995289-9917-46bd-8469-3bc0f4960c11 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:39.854826 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4e995289-9917-46bd-8469-3bc0f4960c11 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:39.862090 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4e995289-9917-46bd-8469-3bc0f4960c11 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:39.862808 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4e995289-9917-46bd-8469-3bc0f4960c11 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:39.863675 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4e995289-9917-46bd-8469-3bc0f4960c11 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:39.864155 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4e995289-9917-46bd-8469-3bc0f4960c11 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:40.007758 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4e995289-9917-46bd-8469-3bc0f4960c11 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:40.016089 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4e995289-9917-46bd-8469-3bc0f4960c11 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.165846 Mar 03 02:54:40.016656 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1347/2447] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:39 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:40.559189 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5e2c2d41-f0dc-4b51-8e96-fa5fa253962d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:40.559832 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5e2c2d41-f0dc-4b51-8e96-fa5fa253962d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:40.566387 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5e2c2d41-f0dc-4b51-8e96-fa5fa253962d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:40.567090 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5e2c2d41-f0dc-4b51-8e96-fa5fa253962d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:40.568141 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5e2c2d41-f0dc-4b51-8e96-fa5fa253962d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:40.568745 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5e2c2d41-f0dc-4b51-8e96-fa5fa253962d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:40.659532 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-29cca17b-ebfb-4543-81e0-be6b0ec261ec tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:40.660381 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-29cca17b-ebfb-4543-81e0-be6b0ec261ec tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:40.666786 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-29cca17b-ebfb-4543-81e0-be6b0ec261ec tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:40.667247 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-29cca17b-ebfb-4543-81e0-be6b0ec261ec tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:40.668065 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-29cca17b-ebfb-4543-81e0-be6b0ec261ec tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:40.668509 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-29cca17b-ebfb-4543-81e0-be6b0ec261ec tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:40.710491 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5e2c2d41-f0dc-4b51-8e96-fa5fa253962d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:40.718863 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5e2c2d41-f0dc-4b51-8e96-fa5fa253962d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.163505 Mar 03 02:54:40.719650 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1101/2448] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:40 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:40.723871 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d5507648-e72c-4f79-b48a-75dbda32415a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:40.724472 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d5507648-e72c-4f79-b48a-75dbda32415a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: 70518a58-de77-4946-ae7f-ec562c0556ea] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:40.730169 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d5507648-e72c-4f79-b48a-75dbda32415a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:40.730694 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d5507648-e72c-4f79-b48a-75dbda32415a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:40.731885 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d5507648-e72c-4f79-b48a-75dbda32415a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:40.732425 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d5507648-e72c-4f79-b48a-75dbda32415a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:40.763985 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-29cca17b-ebfb-4543-81e0-be6b0ec261ec tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:40.775252 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-29cca17b-ebfb-4543-81e0-be6b0ec261ec tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.120403 Mar 03 02:54:40.776984 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1348/2449] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:40 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:54:40.797444 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d5507648-e72c-4f79-b48a-75dbda32415a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:40.805523 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d5507648-e72c-4f79-b48a-75dbda32415a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:40.807165 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d5507648-e72c-4f79-b48a-75dbda32415a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:40.808300 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d5507648-e72c-4f79-b48a-75dbda32415a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/70518a58-de77-4946-ae7f-ec562c0556ea" status: 200 len: 1339 microversion: 2.20 time: 0.087930 Mar 03 02:54:40.819302 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1102/2450] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:54:40 2022] GET /compute/v2.1/servers/70518a58-de77-4946-ae7f-ec562c0556ea => generated 1339 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:54:40.864184 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-922e3d5a-d7ba-4b29-9446-b2e72bb4d1dc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:40.864978 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-922e3d5a-d7ba-4b29-9446-b2e72bb4d1dc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:40.870851 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-922e3d5a-d7ba-4b29-9446-b2e72bb4d1dc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:40.871395 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-922e3d5a-d7ba-4b29-9446-b2e72bb4d1dc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:40.872285 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-922e3d5a-d7ba-4b29-9446-b2e72bb4d1dc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:40.873680 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-922e3d5a-d7ba-4b29-9446-b2e72bb4d1dc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:41.033191 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7820f507-4c53-46b9-b51c-9fcdd9591efa tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:41.033789 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7820f507-4c53-46b9-b51c-9fcdd9591efa tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:41.039703 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7820f507-4c53-46b9-b51c-9fcdd9591efa tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:41.040161 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7820f507-4c53-46b9-b51c-9fcdd9591efa tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:41.041511 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7820f507-4c53-46b9-b51c-9fcdd9591efa tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:41.041961 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7820f507-4c53-46b9-b51c-9fcdd9591efa tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:41.117344 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-922e3d5a-d7ba-4b29-9446-b2e72bb4d1dc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:41.126544 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-922e3d5a-d7ba-4b29-9446-b2e72bb4d1dc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.266345 Mar 03 02:54:41.127284 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1349/2451] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:40 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:41.179164 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-7820f507-4c53-46b9-b51c-9fcdd9591efa tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:41.188038 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7820f507-4c53-46b9-b51c-9fcdd9591efa tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.158741 Mar 03 02:54:41.188615 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1103/2452] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:41 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:54:41.737042 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c3658dd0-1f75-4273-adf5-023d60f351cd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:41.737651 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c3658dd0-1f75-4273-adf5-023d60f351cd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:41.744246 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c3658dd0-1f75-4273-adf5-023d60f351cd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:41.744695 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c3658dd0-1f75-4273-adf5-023d60f351cd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:41.745487 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c3658dd0-1f75-4273-adf5-023d60f351cd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:41.745920 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c3658dd0-1f75-4273-adf5-023d60f351cd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:41.793305 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-bc96d3fe-d56a-4b3d-acb4-132896370ae4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:41.797940 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-bc96d3fe-d56a-4b3d-acb4-132896370ae4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:41.804721 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bc96d3fe-d56a-4b3d-acb4-132896370ae4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:41.805442 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bc96d3fe-d56a-4b3d-acb4-132896370ae4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:41.806249 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bc96d3fe-d56a-4b3d-acb4-132896370ae4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:41.806681 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bc96d3fe-d56a-4b3d-acb4-132896370ae4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:41.876762 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-bc96d3fe-d56a-4b3d-acb4-132896370ae4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:41.884408 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-bc96d3fe-d56a-4b3d-acb4-132896370ae4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.095033 Mar 03 02:54:41.885074 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1104/2453] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:41 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:54:41.893720 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-badc3959-6532-4fe1-bc01-e2b3eb462e04 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:41.894273 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-badc3959-6532-4fe1-bc01-e2b3eb462e04 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: 70518a58-de77-4946-ae7f-ec562c0556ea] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:41.900184 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-badc3959-6532-4fe1-bc01-e2b3eb462e04 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:41.900719 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-badc3959-6532-4fe1-bc01-e2b3eb462e04 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:41.901510 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-badc3959-6532-4fe1-bc01-e2b3eb462e04 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:41.901982 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-badc3959-6532-4fe1-bc01-e2b3eb462e04 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:41.970244 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c3658dd0-1f75-4273-adf5-023d60f351cd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:41.978532 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c3658dd0-1f75-4273-adf5-023d60f351cd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.245627 Mar 03 02:54:41.987692 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1350/2454] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:41 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:42.039997 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [req-caf07221-6d01-4b88-a4b9-4e2dd2baa345 req-a3725355-2d24-4a4f-bb1c-0f28bce2580f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70518a58-de77-4946-ae7f-ec562c0556ea", "tag": "87e88395-b84f-4eff-8c83-30f91c7e179c"}]} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:54:42.069051 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-caf07221-6d01-4b88-a4b9-4e2dd2baa345 req-a3725355-2d24-4a4f-bb1c-0f28bce2580f service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:42.069601 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-caf07221-6d01-4b88-a4b9-4e2dd2baa345 req-a3725355-2d24-4a4f-bb1c-0f28bce2580f service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:42.073584 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-badc3959-6532-4fe1-bc01-e2b3eb462e04 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:42.082770 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.compute.server_external_events [req-caf07221-6d01-4b88-a4b9-4e2dd2baa345 req-a3725355-2d24-4a4f-bb1c-0f28bce2580f service nova] Creating event network-changed:87e88395-b84f-4eff-8c83-30f91c7e179c for instance 70518a58-de77-4946-ae7f-ec562c0556ea on hv-cinder-81977 Mar 03 02:54:42.083471 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-badc3959-6532-4fe1-bc01-e2b3eb462e04 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:42.085100 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-badc3959-6532-4fe1-bc01-e2b3eb462e04 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:42.087185 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-badc3959-6532-4fe1-bc01-e2b3eb462e04 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/70518a58-de77-4946-ae7f-ec562c0556ea" status: 200 len: 1406 microversion: 2.20 time: 0.201140 Mar 03 02:54:42.088370 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1105/2455] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:54:41 2022] GET /compute/v2.1/servers/70518a58-de77-4946-ae7f-ec562c0556ea => generated 1406 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:54:42.100486 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [req-caf07221-6d01-4b88-a4b9-4e2dd2baa345 req-a3725355-2d24-4a4f-bb1c-0f28bce2580f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067384 Mar 03 02:54:42.101125 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1351/2456] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:54:42.143592 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e0239c6a-0a40-481e-920a-90c453e8e9fc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:42.144626 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e0239c6a-0a40-481e-920a-90c453e8e9fc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:42.150969 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e0239c6a-0a40-481e-920a-90c453e8e9fc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:42.151668 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e0239c6a-0a40-481e-920a-90c453e8e9fc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:42.152461 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e0239c6a-0a40-481e-920a-90c453e8e9fc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:42.152900 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e0239c6a-0a40-481e-920a-90c453e8e9fc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:42.207009 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ff416d37-dbda-41c5-b1af-11e70f9c6fc1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:42.207999 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ff416d37-dbda-41c5-b1af-11e70f9c6fc1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:42.214342 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ff416d37-dbda-41c5-b1af-11e70f9c6fc1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:42.214840 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ff416d37-dbda-41c5-b1af-11e70f9c6fc1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:42.215834 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ff416d37-dbda-41c5-b1af-11e70f9c6fc1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:42.216941 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ff416d37-dbda-41c5-b1af-11e70f9c6fc1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:42.296899 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e0239c6a-0a40-481e-920a-90c453e8e9fc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:42.304599 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e0239c6a-0a40-481e-920a-90c453e8e9fc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.164866 Mar 03 02:54:42.305245 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1106/2457] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:42 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:42.430309 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ff416d37-dbda-41c5-b1af-11e70f9c6fc1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:42.438958 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ff416d37-dbda-41c5-b1af-11e70f9c6fc1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.236531 Mar 03 02:54:42.439526 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1352/2458] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:42 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:42.902377 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f36716b1-127a-4402-93c7-a309c976f2f3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:42.903115 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f36716b1-127a-4402-93c7-a309c976f2f3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:42.910137 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f36716b1-127a-4402-93c7-a309c976f2f3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:42.910592 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f36716b1-127a-4402-93c7-a309c976f2f3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:42.911388 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f36716b1-127a-4402-93c7-a309c976f2f3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:42.911863 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f36716b1-127a-4402-93c7-a309c976f2f3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:42.970798 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f36716b1-127a-4402-93c7-a309c976f2f3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:42.978402 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f36716b1-127a-4402-93c7-a309c976f2f3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080637 Mar 03 02:54:42.978994 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1107/2459] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:42 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:42.995979 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9bc459dd-99ae-46fe-8e09-eed310409afc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:42.996588 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9bc459dd-99ae-46fe-8e09-eed310409afc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:43.003347 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9bc459dd-99ae-46fe-8e09-eed310409afc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:43.003850 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9bc459dd-99ae-46fe-8e09-eed310409afc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:43.004645 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9bc459dd-99ae-46fe-8e09-eed310409afc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:43.005087 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9bc459dd-99ae-46fe-8e09-eed310409afc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:43.104455 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-64bc3390-078b-4995-9877-99fa904f7a1e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:43.105153 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-64bc3390-078b-4995-9877-99fa904f7a1e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: 70518a58-de77-4946-ae7f-ec562c0556ea] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:43.111340 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-64bc3390-078b-4995-9877-99fa904f7a1e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:43.111933 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-64bc3390-078b-4995-9877-99fa904f7a1e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:43.112787 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-64bc3390-078b-4995-9877-99fa904f7a1e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:43.113301 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-64bc3390-078b-4995-9877-99fa904f7a1e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:43.144646 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9bc459dd-99ae-46fe-8e09-eed310409afc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:43.152527 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9bc459dd-99ae-46fe-8e09-eed310409afc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.160331 Mar 03 02:54:43.153183 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1353/2460] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:42 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:43.245912 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-64bc3390-078b-4995-9877-99fa904f7a1e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:43.253598 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-64bc3390-078b-4995-9877-99fa904f7a1e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:43.255092 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-64bc3390-078b-4995-9877-99fa904f7a1e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:43.256216 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-64bc3390-078b-4995-9877-99fa904f7a1e tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/70518a58-de77-4946-ae7f-ec562c0556ea" status: 200 len: 1406 microversion: 2.20 time: 0.155665 Mar 03 02:54:43.256792 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1108/2461] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:54:43 2022] GET /compute/v2.1/servers/70518a58-de77-4946-ae7f-ec562c0556ea => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:54:43.322028 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8a26f139-65a9-4b95-a40b-4788ea91ce6c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:43.322646 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8a26f139-65a9-4b95-a40b-4788ea91ce6c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:43.328910 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8a26f139-65a9-4b95-a40b-4788ea91ce6c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:43.329357 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8a26f139-65a9-4b95-a40b-4788ea91ce6c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:43.330122 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8a26f139-65a9-4b95-a40b-4788ea91ce6c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:43.330555 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8a26f139-65a9-4b95-a40b-4788ea91ce6c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:43.456692 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-df957f10-c780-4c5b-a9a3-9c36ed218758 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:43.457303 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-df957f10-c780-4c5b-a9a3-9c36ed218758 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:43.459488 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8a26f139-65a9-4b95-a40b-4788ea91ce6c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:43.463062 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-df957f10-c780-4c5b-a9a3-9c36ed218758 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:43.463515 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-df957f10-c780-4c5b-a9a3-9c36ed218758 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:43.464327 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-df957f10-c780-4c5b-a9a3-9c36ed218758 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:43.464764 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-df957f10-c780-4c5b-a9a3-9c36ed218758 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:43.467360 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8a26f139-65a9-4b95-a40b-4788ea91ce6c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.149170 Mar 03 02:54:43.467954 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1354/2462] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:43 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:43.596294 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-df957f10-c780-4c5b-a9a3-9c36ed218758 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:43.604221 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-df957f10-c780-4c5b-a9a3-9c36ed218758 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.151241 Mar 03 02:54:43.604797 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1109/2463] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:43 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:43.995753 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e0d73091-1d14-4336-8052-a29898b3330c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:43.996388 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e0d73091-1d14-4336-8052-a29898b3330c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:44.003100 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e0d73091-1d14-4336-8052-a29898b3330c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:44.003544 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e0d73091-1d14-4336-8052-a29898b3330c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:44.004344 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e0d73091-1d14-4336-8052-a29898b3330c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:44.004778 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e0d73091-1d14-4336-8052-a29898b3330c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:44.063647 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e0d73091-1d14-4336-8052-a29898b3330c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:44.071318 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e0d73091-1d14-4336-8052-a29898b3330c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079481 Mar 03 02:54:44.071956 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1355/2464] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:43 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:44.170979 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2f523da6-c99a-4586-b5b7-d5df32183b07 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:44.171584 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2f523da6-c99a-4586-b5b7-d5df32183b07 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:44.177816 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f523da6-c99a-4586-b5b7-d5df32183b07 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:44.178203 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f523da6-c99a-4586-b5b7-d5df32183b07 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:44.178970 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f523da6-c99a-4586-b5b7-d5df32183b07 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:44.179400 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f523da6-c99a-4586-b5b7-d5df32183b07 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:44.274139 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-bc9c6439-5b6b-48af-b24e-31c9f2a491a3 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:44.274838 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-bc9c6439-5b6b-48af-b24e-31c9f2a491a3 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: 70518a58-de77-4946-ae7f-ec562c0556ea] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:44.281290 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bc9c6439-5b6b-48af-b24e-31c9f2a491a3 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:44.281842 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bc9c6439-5b6b-48af-b24e-31c9f2a491a3 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:44.282691 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bc9c6439-5b6b-48af-b24e-31c9f2a491a3 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:44.283128 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bc9c6439-5b6b-48af-b24e-31c9f2a491a3 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:44.314255 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2f523da6-c99a-4586-b5b7-d5df32183b07 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:44.322067 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2f523da6-c99a-4586-b5b7-d5df32183b07 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.155719 Mar 03 02:54:44.322667 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1110/2465] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:44 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:44.414212 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-bc9c6439-5b6b-48af-b24e-31c9f2a491a3 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:44.421834 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-bc9c6439-5b6b-48af-b24e-31c9f2a491a3 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:44.423330 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-bc9c6439-5b6b-48af-b24e-31c9f2a491a3 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:44.424427 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-bc9c6439-5b6b-48af-b24e-31c9f2a491a3 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/70518a58-de77-4946-ae7f-ec562c0556ea" status: 200 len: 1406 microversion: 2.20 time: 0.154186 Mar 03 02:54:44.424984 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1356/2466] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:54:44 2022] GET /compute/v2.1/servers/70518a58-de77-4946-ae7f-ec562c0556ea => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:54:44.485533 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4458a2e9-4d33-4b11-aaf5-356f2c0c5005 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:44.486064 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4458a2e9-4d33-4b11-aaf5-356f2c0c5005 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:44.491892 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4458a2e9-4d33-4b11-aaf5-356f2c0c5005 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:44.492339 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4458a2e9-4d33-4b11-aaf5-356f2c0c5005 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:44.493106 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4458a2e9-4d33-4b11-aaf5-356f2c0c5005 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:44.493542 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4458a2e9-4d33-4b11-aaf5-356f2c0c5005 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:44.621877 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5c5438e1-9d75-4579-ac23-2279b6ec6b94 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:44.623104 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5c5438e1-9d75-4579-ac23-2279b6ec6b94 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:44.624246 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4458a2e9-4d33-4b11-aaf5-356f2c0c5005 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:44.628934 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5c5438e1-9d75-4579-ac23-2279b6ec6b94 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:44.629383 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5c5438e1-9d75-4579-ac23-2279b6ec6b94 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:44.630215 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5c5438e1-9d75-4579-ac23-2279b6ec6b94 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:44.630653 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5c5438e1-9d75-4579-ac23-2279b6ec6b94 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:44.631857 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4458a2e9-4d33-4b11-aaf5-356f2c0c5005 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.151244 Mar 03 02:54:44.632424 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1111/2467] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:44 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:44.761550 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5c5438e1-9d75-4579-ac23-2279b6ec6b94 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:44.769312 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5c5438e1-9d75-4579-ac23-2279b6ec6b94 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.151305 Mar 03 02:54:44.769903 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1357/2468] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:44 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:54:45.088028 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-36383206-4f2a-483b-b89a-89bf07b690ec tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:45.088633 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-36383206-4f2a-483b-b89a-89bf07b690ec tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:45.095157 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-36383206-4f2a-483b-b89a-89bf07b690ec tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:45.095617 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-36383206-4f2a-483b-b89a-89bf07b690ec tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:45.096389 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-36383206-4f2a-483b-b89a-89bf07b690ec tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:45.096842 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-36383206-4f2a-483b-b89a-89bf07b690ec tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:45.155750 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-36383206-4f2a-483b-b89a-89bf07b690ec tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:45.163179 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-36383206-4f2a-483b-b89a-89bf07b690ec tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.078993 Mar 03 02:54:45.163770 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1112/2469] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:45 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:45.340237 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2ef72a8e-b8f0-4828-a5fa-6639b4f95bd9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:45.340845 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2ef72a8e-b8f0-4828-a5fa-6639b4f95bd9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:45.347920 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2ef72a8e-b8f0-4828-a5fa-6639b4f95bd9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:45.348373 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2ef72a8e-b8f0-4828-a5fa-6639b4f95bd9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:45.349157 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2ef72a8e-b8f0-4828-a5fa-6639b4f95bd9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:45.349598 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2ef72a8e-b8f0-4828-a5fa-6639b4f95bd9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:45.441057 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-962265f6-790a-4810-81b3-06e70accfef5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:45.441666 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-962265f6-790a-4810-81b3-06e70accfef5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: 70518a58-de77-4946-ae7f-ec562c0556ea] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:45.447869 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-962265f6-790a-4810-81b3-06e70accfef5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:45.448328 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-962265f6-790a-4810-81b3-06e70accfef5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:45.449112 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-962265f6-790a-4810-81b3-06e70accfef5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:45.449553 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-962265f6-790a-4810-81b3-06e70accfef5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:45.477841 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2ef72a8e-b8f0-4828-a5fa-6639b4f95bd9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:45.486058 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2ef72a8e-b8f0-4828-a5fa-6639b4f95bd9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.149616 Mar 03 02:54:45.486620 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1358/2470] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:45 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:45.581409 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-962265f6-790a-4810-81b3-06e70accfef5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:45.589204 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-962265f6-790a-4810-81b3-06e70accfef5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:45.590757 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-962265f6-790a-4810-81b3-06e70accfef5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:45.592687 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-962265f6-790a-4810-81b3-06e70accfef5 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/70518a58-de77-4946-ae7f-ec562c0556ea" status: 200 len: 1406 microversion: 2.20 time: 0.155275 Mar 03 02:54:45.593254 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1113/2471] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:54:45 2022] GET /compute/v2.1/servers/70518a58-de77-4946-ae7f-ec562c0556ea => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:54:45.649067 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b302bf13-89db-40ac-97b7-d175b2ffa5de tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:45.649673 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b302bf13-89db-40ac-97b7-d175b2ffa5de tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:45.655632 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b302bf13-89db-40ac-97b7-d175b2ffa5de tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:45.656090 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b302bf13-89db-40ac-97b7-d175b2ffa5de tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:45.656861 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b302bf13-89db-40ac-97b7-d175b2ffa5de tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:45.657294 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b302bf13-89db-40ac-97b7-d175b2ffa5de tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:45.786878 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8a218ff0-c6bb-48a8-ac8a-02cfd9963432 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:45.787680 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8a218ff0-c6bb-48a8-ac8a-02cfd9963432 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:45.792635 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b302bf13-89db-40ac-97b7-d175b2ffa5de tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:45.793523 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8a218ff0-c6bb-48a8-ac8a-02cfd9963432 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:45.793978 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8a218ff0-c6bb-48a8-ac8a-02cfd9963432 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:45.794807 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8a218ff0-c6bb-48a8-ac8a-02cfd9963432 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:45.795213 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8a218ff0-c6bb-48a8-ac8a-02cfd9963432 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:45.801366 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b302bf13-89db-40ac-97b7-d175b2ffa5de tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.156477 Mar 03 02:54:45.808216 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1359/2472] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:45 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:45.928006 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8a218ff0-c6bb-48a8-ac8a-02cfd9963432 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:45.936436 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8a218ff0-c6bb-48a8-ac8a-02cfd9963432 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.153732 Mar 03 02:54:45.937002 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1114/2473] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:45 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:46.180709 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9cd29937-a5f2-48fa-b800-83a9cae958c9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:46.181323 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9cd29937-a5f2-48fa-b800-83a9cae958c9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:46.188343 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9cd29937-a5f2-48fa-b800-83a9cae958c9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:46.188800 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9cd29937-a5f2-48fa-b800-83a9cae958c9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:46.189584 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9cd29937-a5f2-48fa-b800-83a9cae958c9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:46.190023 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9cd29937-a5f2-48fa-b800-83a9cae958c9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:46.249378 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9cd29937-a5f2-48fa-b800-83a9cae958c9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:46.257087 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9cd29937-a5f2-48fa-b800-83a9cae958c9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080220 Mar 03 02:54:46.257685 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1360/2474] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:46 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:46.502634 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ea51bfc3-3a1c-48af-8ce0-6a0a8198f599 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:46.503214 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ea51bfc3-3a1c-48af-8ce0-6a0a8198f599 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:46.509520 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ea51bfc3-3a1c-48af-8ce0-6a0a8198f599 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:46.509965 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ea51bfc3-3a1c-48af-8ce0-6a0a8198f599 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:46.510728 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ea51bfc3-3a1c-48af-8ce0-6a0a8198f599 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:46.511161 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ea51bfc3-3a1c-48af-8ce0-6a0a8198f599 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:46.611216 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0b14f878-068e-48a5-89c2-e3bb023f39e6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:46.611845 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0b14f878-068e-48a5-89c2-e3bb023f39e6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: 70518a58-de77-4946-ae7f-ec562c0556ea] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:46.617970 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0b14f878-068e-48a5-89c2-e3bb023f39e6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:46.618419 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0b14f878-068e-48a5-89c2-e3bb023f39e6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:46.619187 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0b14f878-068e-48a5-89c2-e3bb023f39e6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:46.619638 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0b14f878-068e-48a5-89c2-e3bb023f39e6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:46.645337 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ea51bfc3-3a1c-48af-8ce0-6a0a8198f599 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:46.653020 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ea51bfc3-3a1c-48af-8ce0-6a0a8198f599 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.154456 Mar 03 02:54:46.654139 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1115/2475] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:46 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:46.752370 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0b14f878-068e-48a5-89c2-e3bb023f39e6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:46.759902 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0b14f878-068e-48a5-89c2-e3bb023f39e6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:46.761319 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0b14f878-068e-48a5-89c2-e3bb023f39e6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:46.762407 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0b14f878-068e-48a5-89c2-e3bb023f39e6 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/70518a58-de77-4946-ae7f-ec562c0556ea" status: 200 len: 1406 microversion: 2.20 time: 0.156085 Mar 03 02:54:46.763465 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1361/2476] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:54:46 2022] GET /compute/v2.1/servers/70518a58-de77-4946-ae7f-ec562c0556ea => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:54:46.818890 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5952831e-501d-47e1-9033-37006f70dc04 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:46.819495 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5952831e-501d-47e1-9033-37006f70dc04 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:46.825375 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5952831e-501d-47e1-9033-37006f70dc04 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:46.826348 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5952831e-501d-47e1-9033-37006f70dc04 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:46.827104 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5952831e-501d-47e1-9033-37006f70dc04 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:46.827533 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5952831e-501d-47e1-9033-37006f70dc04 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:46.953962 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c1de8eb5-9f97-429a-a37b-475bca5ea01c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:46.954313 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c1de8eb5-9f97-429a-a37b-475bca5ea01c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:46.956215 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5952831e-501d-47e1-9033-37006f70dc04 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:46.959998 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c1de8eb5-9f97-429a-a37b-475bca5ea01c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:46.960446 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c1de8eb5-9f97-429a-a37b-475bca5ea01c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:46.961220 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c1de8eb5-9f97-429a-a37b-475bca5ea01c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:46.961654 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c1de8eb5-9f97-429a-a37b-475bca5ea01c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:46.963992 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5952831e-501d-47e1-9033-37006f70dc04 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.149014 Mar 03 02:54:46.964561 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1116/2477] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:46 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:47.089901 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c1de8eb5-9f97-429a-a37b-475bca5ea01c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:47.098180 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c1de8eb5-9f97-429a-a37b-475bca5ea01c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.148762 Mar 03 02:54:47.098734 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1362/2478] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:46 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:54:47.275068 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-34415a85-5cea-4396-9704-8f47d1e7bb32 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:47.275698 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-34415a85-5cea-4396-9704-8f47d1e7bb32 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:47.281483 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-34415a85-5cea-4396-9704-8f47d1e7bb32 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:47.281937 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-34415a85-5cea-4396-9704-8f47d1e7bb32 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:47.282719 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-34415a85-5cea-4396-9704-8f47d1e7bb32 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:47.283161 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-34415a85-5cea-4396-9704-8f47d1e7bb32 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:47.341680 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-34415a85-5cea-4396-9704-8f47d1e7bb32 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:47.349310 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-34415a85-5cea-4396-9704-8f47d1e7bb32 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.078170 Mar 03 02:54:47.349875 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1117/2479] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:47 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:47.671151 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2dce347e-eaf1-4f6c-8c45-67d4c3531cfe tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:47.671791 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2dce347e-eaf1-4f6c-8c45-67d4c3531cfe tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:47.678018 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2dce347e-eaf1-4f6c-8c45-67d4c3531cfe tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:47.678468 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2dce347e-eaf1-4f6c-8c45-67d4c3531cfe tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:47.679249 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2dce347e-eaf1-4f6c-8c45-67d4c3531cfe tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:47.679718 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2dce347e-eaf1-4f6c-8c45-67d4c3531cfe tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:47.780572 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-17bbee38-d84b-4ad3-834c-191eafc77063 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:47.781322 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-17bbee38-d84b-4ad3-834c-191eafc77063 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: 70518a58-de77-4946-ae7f-ec562c0556ea] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:47.788353 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-17bbee38-d84b-4ad3-834c-191eafc77063 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:47.788922 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-17bbee38-d84b-4ad3-834c-191eafc77063 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:47.790269 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-17bbee38-d84b-4ad3-834c-191eafc77063 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:47.790417 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-17bbee38-d84b-4ad3-834c-191eafc77063 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:47.812393 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2dce347e-eaf1-4f6c-8c45-67d4c3531cfe tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:47.821051 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2dce347e-eaf1-4f6c-8c45-67d4c3531cfe tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.154589 Mar 03 02:54:47.831741 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1363/2480] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:47 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:47.902260 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [req-13abe939-b8be-4d27-8f8e-60a9c18ca66a req-f8aba511-bbb0-4a57-819c-3241a78f00cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70518a58-de77-4946-ae7f-ec562c0556ea", "name": "network-vif-plugged", "status": "completed", "tag": "87e88395-b84f-4eff-8c83-30f91c7e179c"}]} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:54:47.910951 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-13abe939-b8be-4d27-8f8e-60a9c18ca66a req-f8aba511-bbb0-4a57-819c-3241a78f00cf service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:47.911404 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-13abe939-b8be-4d27-8f8e-60a9c18ca66a req-f8aba511-bbb0-4a57-819c-3241a78f00cf service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:47.922881 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.compute.server_external_events [req-13abe939-b8be-4d27-8f8e-60a9c18ca66a req-f8aba511-bbb0-4a57-819c-3241a78f00cf service nova] Creating event network-vif-plugged:87e88395-b84f-4eff-8c83-30f91c7e179c for instance 70518a58-de77-4946-ae7f-ec562c0556ea on hv-cinder-81977 Mar 03 02:54:47.927873 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [req-13abe939-b8be-4d27-8f8e-60a9c18ca66a req-f8aba511-bbb0-4a57-819c-3241a78f00cf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090526 Mar 03 02:54:47.928739 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1364/2481] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:54:47.941825 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-17bbee38-d84b-4ad3-834c-191eafc77063 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:47.949631 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-17bbee38-d84b-4ad3-834c-191eafc77063 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:47.952838 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-17bbee38-d84b-4ad3-834c-191eafc77063 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:47.953997 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-17bbee38-d84b-4ad3-834c-191eafc77063 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/70518a58-de77-4946-ae7f-ec562c0556ea" status: 200 len: 1406 microversion: 2.20 time: 0.177640 Mar 03 02:54:47.954696 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1118/2482] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:54:47 2022] GET /compute/v2.1/servers/70518a58-de77-4946-ae7f-ec562c0556ea => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:54:47.982934 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-fbb90e99-9ca5-4233-9550-af2620f6915e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:47.983737 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-fbb90e99-9ca5-4233-9550-af2620f6915e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:47.990134 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fbb90e99-9ca5-4233-9550-af2620f6915e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:47.990583 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fbb90e99-9ca5-4233-9550-af2620f6915e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:47.991482 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fbb90e99-9ca5-4233-9550-af2620f6915e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:47.992500 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fbb90e99-9ca5-4233-9550-af2620f6915e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:48.115388 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-607701e4-f67b-4e3c-80df-e757cd2055fa tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:48.116037 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-607701e4-f67b-4e3c-80df-e757cd2055fa tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:48.122611 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-607701e4-f67b-4e3c-80df-e757cd2055fa tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:48.123095 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-607701e4-f67b-4e3c-80df-e757cd2055fa tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:48.123923 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-607701e4-f67b-4e3c-80df-e757cd2055fa tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:48.124362 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-607701e4-f67b-4e3c-80df-e757cd2055fa tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:48.188779 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-fbb90e99-9ca5-4233-9550-af2620f6915e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:48.196778 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-fbb90e99-9ca5-4233-9550-af2620f6915e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.218281 Mar 03 02:54:48.197449 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1365/2483] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:47 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:48.258711 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-607701e4-f67b-4e3c-80df-e757cd2055fa tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:48.266784 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-607701e4-f67b-4e3c-80df-e757cd2055fa tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.155463 Mar 03 02:54:48.267347 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1119/2484] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:48 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:54:48.365931 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4b97bd39-da91-40bf-87fd-069f7175cdd4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:48.366541 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4b97bd39-da91-40bf-87fd-069f7175cdd4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:48.373223 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4b97bd39-da91-40bf-87fd-069f7175cdd4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:48.373678 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4b97bd39-da91-40bf-87fd-069f7175cdd4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:48.374464 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4b97bd39-da91-40bf-87fd-069f7175cdd4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:48.374908 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4b97bd39-da91-40bf-87fd-069f7175cdd4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:48.432875 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4b97bd39-da91-40bf-87fd-069f7175cdd4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:48.440643 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4b97bd39-da91-40bf-87fd-069f7175cdd4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.078484 Mar 03 02:54:48.441153 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1366/2485] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:48 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:48.838247 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8fa3e1c3-76ba-4e63-80de-77c791fb5c6b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:48.838860 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8fa3e1c3-76ba-4e63-80de-77c791fb5c6b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:48.845193 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8fa3e1c3-76ba-4e63-80de-77c791fb5c6b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:48.845648 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8fa3e1c3-76ba-4e63-80de-77c791fb5c6b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:48.846420 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8fa3e1c3-76ba-4e63-80de-77c791fb5c6b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:48.846858 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8fa3e1c3-76ba-4e63-80de-77c791fb5c6b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:48.970778 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5a443088-4da2-4e69-8337-86cfbb4edb73 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:48.971505 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5a443088-4da2-4e69-8337-86cfbb4edb73 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: 70518a58-de77-4946-ae7f-ec562c0556ea] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:48.976833 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8fa3e1c3-76ba-4e63-80de-77c791fb5c6b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:48.977767 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5a443088-4da2-4e69-8337-86cfbb4edb73 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:48.978219 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5a443088-4da2-4e69-8337-86cfbb4edb73 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:48.979001 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5a443088-4da2-4e69-8337-86cfbb4edb73 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:48.979442 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5a443088-4da2-4e69-8337-86cfbb4edb73 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:48.985335 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8fa3e1c3-76ba-4e63-80de-77c791fb5c6b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.150951 Mar 03 02:54:48.985916 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1120/2486] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:48 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:49.114057 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5a443088-4da2-4e69-8337-86cfbb4edb73 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:49.121660 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5a443088-4da2-4e69-8337-86cfbb4edb73 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:49.123949 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5a443088-4da2-4e69-8337-86cfbb4edb73 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:49.125043 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5a443088-4da2-4e69-8337-86cfbb4edb73 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/70518a58-de77-4946-ae7f-ec562c0556ea" status: 200 len: 1406 microversion: 2.20 time: 0.158168 Mar 03 02:54:49.125605 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1367/2487] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:54:48 2022] GET /compute/v2.1/servers/70518a58-de77-4946-ae7f-ec562c0556ea => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:54:49.213940 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6a4904d3-d508-4b80-99f1-e8d63d6c1823 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:49.214545 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6a4904d3-d508-4b80-99f1-e8d63d6c1823 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:49.220864 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6a4904d3-d508-4b80-99f1-e8d63d6c1823 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:49.221315 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6a4904d3-d508-4b80-99f1-e8d63d6c1823 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:49.222083 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6a4904d3-d508-4b80-99f1-e8d63d6c1823 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:49.222517 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6a4904d3-d508-4b80-99f1-e8d63d6c1823 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:49.285447 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6d89525c-7aaa-4905-98f5-7d0c3fc2c2b3 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:49.286049 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6d89525c-7aaa-4905-98f5-7d0c3fc2c2b3 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:49.295449 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6d89525c-7aaa-4905-98f5-7d0c3fc2c2b3 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:49.295887 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6d89525c-7aaa-4905-98f5-7d0c3fc2c2b3 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:49.296674 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6d89525c-7aaa-4905-98f5-7d0c3fc2c2b3 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:49.297106 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6d89525c-7aaa-4905-98f5-7d0c3fc2c2b3 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:49.364470 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-6a4904d3-d508-4b80-99f1-e8d63d6c1823 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:49.372100 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6a4904d3-d508-4b80-99f1-e8d63d6c1823 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.162012 Mar 03 02:54:49.373572 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1121/2488] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:49 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:49.429755 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6d89525c-7aaa-4905-98f5-7d0c3fc2c2b3 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:49.437579 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6d89525c-7aaa-4905-98f5-7d0c3fc2c2b3 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.155997 Mar 03 02:54:49.438329 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1368/2489] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:49 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:49.456909 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5ae330d7-7146-4d59-8394-e5124ea9998c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:49.457518 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5ae330d7-7146-4d59-8394-e5124ea9998c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:49.463931 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5ae330d7-7146-4d59-8394-e5124ea9998c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:49.464563 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5ae330d7-7146-4d59-8394-e5124ea9998c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:49.465415 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5ae330d7-7146-4d59-8394-e5124ea9998c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:49.465849 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5ae330d7-7146-4d59-8394-e5124ea9998c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:49.531740 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5ae330d7-7146-4d59-8394-e5124ea9998c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:49.539361 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5ae330d7-7146-4d59-8394-e5124ea9998c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.086377 Mar 03 02:54:49.539958 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1122/2490] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:49 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:50.002864 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-35dd006f-cb33-4801-9152-b8d8f10d9e95 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:50.003478 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-35dd006f-cb33-4801-9152-b8d8f10d9e95 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:50.009899 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-35dd006f-cb33-4801-9152-b8d8f10d9e95 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:50.010357 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-35dd006f-cb33-4801-9152-b8d8f10d9e95 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:50.011138 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-35dd006f-cb33-4801-9152-b8d8f10d9e95 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:50.011577 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-35dd006f-cb33-4801-9152-b8d8f10d9e95 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:50.142789 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-35dd006f-cb33-4801-9152-b8d8f10d9e95 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:50.142947 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ffe09296-22be-496d-b082-862a5dffe731 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:50.143486 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ffe09296-22be-496d-b082-862a5dffe731 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: 70518a58-de77-4946-ae7f-ec562c0556ea] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:50.149783 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ffe09296-22be-496d-b082-862a5dffe731 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:50.150237 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ffe09296-22be-496d-b082-862a5dffe731 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:50.150545 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-35dd006f-cb33-4801-9152-b8d8f10d9e95 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.151602 Mar 03 02:54:50.151025 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ffe09296-22be-496d-b082-862a5dffe731 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:50.151126 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1369/2491] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:49 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:50.151574 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ffe09296-22be-496d-b082-862a5dffe731 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:50.289706 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ffe09296-22be-496d-b082-862a5dffe731 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:50.298297 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ffe09296-22be-496d-b082-862a5dffe731 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:50.299821 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ffe09296-22be-496d-b082-862a5dffe731 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:50.300950 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ffe09296-22be-496d-b082-862a5dffe731 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/70518a58-de77-4946-ae7f-ec562c0556ea" status: 200 len: 1599 microversion: 2.20 time: 0.162427 Mar 03 02:54:50.301512 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1123/2492] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:54:50 2022] GET /compute/v2.1/servers/70518a58-de77-4946-ae7f-ec562c0556ea => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:54:50.318494 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-330966bf-1bbe-42cb-8d59-fb78c891c80f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:50.318986 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-330966bf-1bbe-42cb-8d59-fb78c891c80f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: 70518a58-de77-4946-ae7f-ec562c0556ea] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:50.324667 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-330966bf-1bbe-42cb-8d59-fb78c891c80f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:50.325113 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-330966bf-1bbe-42cb-8d59-fb78c891c80f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:50.326669 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-330966bf-1bbe-42cb-8d59-fb78c891c80f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:50.327096 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-330966bf-1bbe-42cb-8d59-fb78c891c80f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:50.390649 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8158e25d-e533-4c31-bee3-e357798ac512 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:50.391257 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8158e25d-e533-4c31-bee3-e357798ac512 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:50.397067 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8158e25d-e533-4c31-bee3-e357798ac512 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:50.397519 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8158e25d-e533-4c31-bee3-e357798ac512 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:50.398311 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8158e25d-e533-4c31-bee3-e357798ac512 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:50.398747 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8158e25d-e533-4c31-bee3-e357798ac512 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:50.407353 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-330966bf-1bbe-42cb-8d59-fb78c891c80f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/70518a58-de77-4946-ae7f-ec562c0556ea/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.092710 Mar 03 02:54:50.407980 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1370/2493] 10.222.0.30 () {60 vars in 1315 bytes} [Thu Mar 3 02:54:50 2022] GET /compute/v2.1/servers/70518a58-de77-4946-ae7f-ec562c0556ea/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:54:50.454786 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-974c4ec5-de0b-4e2b-b701-ee0460436248 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:50.455428 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-974c4ec5-de0b-4e2b-b701-ee0460436248 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:50.461374 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-974c4ec5-de0b-4e2b-b701-ee0460436248 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:50.461827 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-974c4ec5-de0b-4e2b-b701-ee0460436248 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:50.462615 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-974c4ec5-de0b-4e2b-b701-ee0460436248 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:50.463112 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-974c4ec5-de0b-4e2b-b701-ee0460436248 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:50.532801 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8158e25d-e533-4c31-bee3-e357798ac512 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:50.540701 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8158e25d-e533-4c31-bee3-e357798ac512 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.154721 Mar 03 02:54:50.541276 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1124/2494] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:50 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:54:50.555946 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-673e3235-0751-4ccd-b93b-0b96a8f4a5af tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:50.556643 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-673e3235-0751-4ccd-b93b-0b96a8f4a5af tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:50.563275 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-673e3235-0751-4ccd-b93b-0b96a8f4a5af tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:50.563866 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-673e3235-0751-4ccd-b93b-0b96a8f4a5af tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:50.564724 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-673e3235-0751-4ccd-b93b-0b96a8f4a5af tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:50.565232 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-673e3235-0751-4ccd-b93b-0b96a8f4a5af tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:50.625522 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-673e3235-0751-4ccd-b93b-0b96a8f4a5af tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:50.633454 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-673e3235-0751-4ccd-b93b-0b96a8f4a5af tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.081193 Mar 03 02:54:50.634015 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1125/2495] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:50 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:54:50.721144 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-974c4ec5-de0b-4e2b-b701-ee0460436248 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:50.729118 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-974c4ec5-de0b-4e2b-b701-ee0460436248 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.278738 Mar 03 02:54:50.729724 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1371/2496] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:50 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:54:51.169008 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1fd37f23-b87d-4b53-a0c3-059fb870ead7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:51.170309 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1fd37f23-b87d-4b53-a0c3-059fb870ead7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:51.177067 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1fd37f23-b87d-4b53-a0c3-059fb870ead7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:51.177510 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1fd37f23-b87d-4b53-a0c3-059fb870ead7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:51.178295 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1fd37f23-b87d-4b53-a0c3-059fb870ead7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:51.178725 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1fd37f23-b87d-4b53-a0c3-059fb870ead7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:51.320238 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1fd37f23-b87d-4b53-a0c3-059fb870ead7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:51.328131 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1fd37f23-b87d-4b53-a0c3-059fb870ead7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.163522 Mar 03 02:54:51.328700 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1126/2497] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:51 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:51.557568 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-10b9410c-40e4-4ede-904e-23c670cda4e1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:51.558178 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-10b9410c-40e4-4ede-904e-23c670cda4e1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:51.565526 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-10b9410c-40e4-4ede-904e-23c670cda4e1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:51.565976 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-10b9410c-40e4-4ede-904e-23c670cda4e1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:51.566757 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-10b9410c-40e4-4ede-904e-23c670cda4e1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:51.567194 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-10b9410c-40e4-4ede-904e-23c670cda4e1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:51.650139 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5c1db1c7-9730-45ca-8a4f-cdb7807d8665 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:51.650864 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5c1db1c7-9730-45ca-8a4f-cdb7807d8665 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:51.657881 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5c1db1c7-9730-45ca-8a4f-cdb7807d8665 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:51.658329 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5c1db1c7-9730-45ca-8a4f-cdb7807d8665 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:51.659510 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5c1db1c7-9730-45ca-8a4f-cdb7807d8665 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:51.660005 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5c1db1c7-9730-45ca-8a4f-cdb7807d8665 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:51.725597 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5c1db1c7-9730-45ca-8a4f-cdb7807d8665 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:51.734376 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5c1db1c7-9730-45ca-8a4f-cdb7807d8665 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.088116 Mar 03 02:54:51.735137 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1127/2498] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:51 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:54:51.749341 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ab65ae00-3d3a-4e4e-9e77-11b150baea2b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:51.749341 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ab65ae00-3d3a-4e4e-9e77-11b150baea2b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:51.755208 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ab65ae00-3d3a-4e4e-9e77-11b150baea2b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:51.755758 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ab65ae00-3d3a-4e4e-9e77-11b150baea2b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:51.756464 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ab65ae00-3d3a-4e4e-9e77-11b150baea2b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:51.756897 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ab65ae00-3d3a-4e4e-9e77-11b150baea2b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:51.782134 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-10b9410c-40e4-4ede-904e-23c670cda4e1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:51.790149 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-10b9410c-40e4-4ede-904e-23c670cda4e1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.236472 Mar 03 02:54:51.791142 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1372/2499] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:51 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:51.796638 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-741390ad-4afa-41d5-959b-876dd11ecdc4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:51.797138 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-741390ad-4afa-41d5-959b-876dd11ecdc4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: 70518a58-de77-4946-ae7f-ec562c0556ea] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:51.803147 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-741390ad-4afa-41d5-959b-876dd11ecdc4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:51.803622 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-741390ad-4afa-41d5-959b-876dd11ecdc4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:51.804451 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-741390ad-4afa-41d5-959b-876dd11ecdc4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:51.804885 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-741390ad-4afa-41d5-959b-876dd11ecdc4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:51.829543 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-741390ad-4afa-41d5-959b-876dd11ecdc4 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/70518a58-de77-4946-ae7f-ec562c0556ea/ips" status: 200 len: 113 microversion: 2.20 time: 0.037475 Mar 03 02:54:51.835251 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1373/2500] 10.222.0.30 () {60 vars in 1288 bytes} [Thu Mar 3 02:54:51 2022] GET /compute/v2.1/servers/70518a58-de77-4946-ae7f-ec562c0556ea/ips => generated 113 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 03 02:54:51.835251 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [req-78a05b81-29c0-4ee8-8430-301cd31ee66a req-4fb4133e-d88d-4382-853d-15da442dbb3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70518a58-de77-4946-ae7f-ec562c0556ea", "tag": "87e88395-b84f-4eff-8c83-30f91c7e179c"}]} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:54:51.844952 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-78a05b81-29c0-4ee8-8430-301cd31ee66a req-4fb4133e-d88d-4382-853d-15da442dbb3d service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:51.845162 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-78a05b81-29c0-4ee8-8430-301cd31ee66a req-4fb4133e-d88d-4382-853d-15da442dbb3d service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:51.860898 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.compute.server_external_events [req-78a05b81-29c0-4ee8-8430-301cd31ee66a req-4fb4133e-d88d-4382-853d-15da442dbb3d service nova] Creating event network-changed:87e88395-b84f-4eff-8c83-30f91c7e179c for instance 70518a58-de77-4946-ae7f-ec562c0556ea on hv-cinder-81977 Mar 03 02:54:51.866734 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [req-78a05b81-29c0-4ee8-8430-301cd31ee66a req-4fb4133e-d88d-4382-853d-15da442dbb3d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035177 Mar 03 02:54:51.867477 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1374/2501] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:54:51.906135 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ab65ae00-3d3a-4e4e-9e77-11b150baea2b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:51.916511 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ab65ae00-3d3a-4e4e-9e77-11b150baea2b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.172087 Mar 03 02:54:51.917482 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1128/2502] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:51 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:52.346471 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e91b38d2-cf96-4486-be3a-61c7bb40c9ea tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:52.347383 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e91b38d2-cf96-4486-be3a-61c7bb40c9ea tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:52.353353 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e91b38d2-cf96-4486-be3a-61c7bb40c9ea tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:52.353802 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e91b38d2-cf96-4486-be3a-61c7bb40c9ea tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:52.354588 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e91b38d2-cf96-4486-be3a-61c7bb40c9ea tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:52.355017 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e91b38d2-cf96-4486-be3a-61c7bb40c9ea tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:52.495824 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e91b38d2-cf96-4486-be3a-61c7bb40c9ea tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:52.504018 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e91b38d2-cf96-4486-be3a-61c7bb40c9ea tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.161717 Mar 03 02:54:52.504600 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1375/2503] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:52 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:52.750527 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9a465acf-75d7-4963-a07d-190db603030a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:52.751133 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9a465acf-75d7-4963-a07d-190db603030a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:52.757544 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9a465acf-75d7-4963-a07d-190db603030a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:52.757998 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9a465acf-75d7-4963-a07d-190db603030a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:52.758775 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9a465acf-75d7-4963-a07d-190db603030a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:52.759216 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9a465acf-75d7-4963-a07d-190db603030a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:52.815264 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-84074842-a596-4830-877c-5198279bd845 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:52.815965 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-84074842-a596-4830-877c-5198279bd845 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:52.821921 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9a465acf-75d7-4963-a07d-190db603030a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:52.822852 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-84074842-a596-4830-877c-5198279bd845 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:52.822852 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-84074842-a596-4830-877c-5198279bd845 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:52.823783 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-84074842-a596-4830-877c-5198279bd845 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:52.824057 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-84074842-a596-4830-877c-5198279bd845 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:52.833189 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9a465acf-75d7-4963-a07d-190db603030a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.086516 Mar 03 02:54:52.834005 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1129/2504] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:52 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:52.933134 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c3fe64e6-b5e1-4572-8f8c-9237be19c9b2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:52.933742 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c3fe64e6-b5e1-4572-8f8c-9237be19c9b2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:52.941196 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c3fe64e6-b5e1-4572-8f8c-9237be19c9b2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:52.941645 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c3fe64e6-b5e1-4572-8f8c-9237be19c9b2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:52.942443 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c3fe64e6-b5e1-4572-8f8c-9237be19c9b2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:52.942878 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c3fe64e6-b5e1-4572-8f8c-9237be19c9b2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:52.959344 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-84074842-a596-4830-877c-5198279bd845 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:52.968020 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-84074842-a596-4830-877c-5198279bd845 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.156850 Mar 03 02:54:52.968598 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1376/2505] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:52 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:53.078025 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c3fe64e6-b5e1-4572-8f8c-9237be19c9b2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:53.085883 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c3fe64e6-b5e1-4572-8f8c-9237be19c9b2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.156668 Mar 03 02:54:53.086453 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1130/2506] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:52 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:54:53.522187 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-99cde7b3-6325-4312-8858-685d5bebc7a1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:53.522840 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-99cde7b3-6325-4312-8858-685d5bebc7a1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:53.530034 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-99cde7b3-6325-4312-8858-685d5bebc7a1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:53.530491 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-99cde7b3-6325-4312-8858-685d5bebc7a1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:53.531299 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-99cde7b3-6325-4312-8858-685d5bebc7a1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:53.531768 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-99cde7b3-6325-4312-8858-685d5bebc7a1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:53.671554 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-99cde7b3-6325-4312-8858-685d5bebc7a1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:53.679224 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-99cde7b3-6325-4312-8858-685d5bebc7a1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.161067 Mar 03 02:54:53.679821 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1377/2507] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:53 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:53.850219 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-fa0ebb81-d11e-49da-b468-de4599a3e776 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:53.850828 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-fa0ebb81-d11e-49da-b468-de4599a3e776 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:53.857325 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fa0ebb81-d11e-49da-b468-de4599a3e776 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:53.857772 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fa0ebb81-d11e-49da-b468-de4599a3e776 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:53.858543 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fa0ebb81-d11e-49da-b468-de4599a3e776 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:53.858981 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fa0ebb81-d11e-49da-b468-de4599a3e776 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:53.918182 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-fa0ebb81-d11e-49da-b468-de4599a3e776 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:53.926617 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-fa0ebb81-d11e-49da-b468-de4599a3e776 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080298 Mar 03 02:54:53.927194 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1131/2508] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:53 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:53.985389 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-14d48278-e4bc-4883-93ce-8569e90e6e65 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:53.986003 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-14d48278-e4bc-4883-93ce-8569e90e6e65 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:53.992168 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-14d48278-e4bc-4883-93ce-8569e90e6e65 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:53.992619 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-14d48278-e4bc-4883-93ce-8569e90e6e65 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:53.993395 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-14d48278-e4bc-4883-93ce-8569e90e6e65 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:53.993833 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-14d48278-e4bc-4883-93ce-8569e90e6e65 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:54.103492 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-45769401-365f-4efd-85d0-91f338e88a84 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:54.104071 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-45769401-365f-4efd-85d0-91f338e88a84 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:54.110068 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-45769401-365f-4efd-85d0-91f338e88a84 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:54.110522 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-45769401-365f-4efd-85d0-91f338e88a84 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:54.111308 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-45769401-365f-4efd-85d0-91f338e88a84 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:54.111795 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-45769401-365f-4efd-85d0-91f338e88a84 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:54.131803 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-14d48278-e4bc-4883-93ce-8569e90e6e65 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:54.140196 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-14d48278-e4bc-4883-93ce-8569e90e6e65 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.158885 Mar 03 02:54:54.140773 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1378/2509] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:53 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:54.245854 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-45769401-365f-4efd-85d0-91f338e88a84 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:54.254686 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-45769401-365f-4efd-85d0-91f338e88a84 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.155106 Mar 03 02:54:54.255255 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1132/2510] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:54 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:54:54.696185 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-763f5c9a-f75b-4f80-809c-d28effbe73da tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:54.696708 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-763f5c9a-f75b-4f80-809c-d28effbe73da tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:54.703001 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-763f5c9a-f75b-4f80-809c-d28effbe73da tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:54.703450 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-763f5c9a-f75b-4f80-809c-d28effbe73da tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:54.704247 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-763f5c9a-f75b-4f80-809c-d28effbe73da tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:54.704675 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-763f5c9a-f75b-4f80-809c-d28effbe73da tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:54.897533 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-763f5c9a-f75b-4f80-809c-d28effbe73da tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:54.906047 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-763f5c9a-f75b-4f80-809c-d28effbe73da tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.213803 Mar 03 02:54:54.906613 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1379/2511] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:54 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:54:54.943419 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ff7b7545-f908-46ba-bb4f-035f1c46f1cb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:54.944069 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ff7b7545-f908-46ba-bb4f-035f1c46f1cb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:54.950989 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ff7b7545-f908-46ba-bb4f-035f1c46f1cb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:54.951559 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ff7b7545-f908-46ba-bb4f-035f1c46f1cb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:54.952183 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ff7b7545-f908-46ba-bb4f-035f1c46f1cb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:54.952628 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ff7b7545-f908-46ba-bb4f-035f1c46f1cb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:55.011072 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ff7b7545-f908-46ba-bb4f-035f1c46f1cb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:55.019174 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ff7b7545-f908-46ba-bb4f-035f1c46f1cb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079539 Mar 03 02:54:55.019762 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1133/2512] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:54 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:55.157875 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-930440ea-8a51-4bbb-a6e5-38ef96464982 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:55.158486 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-930440ea-8a51-4bbb-a6e5-38ef96464982 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:55.164722 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-930440ea-8a51-4bbb-a6e5-38ef96464982 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:55.165177 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-930440ea-8a51-4bbb-a6e5-38ef96464982 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:55.165960 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-930440ea-8a51-4bbb-a6e5-38ef96464982 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:55.166404 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-930440ea-8a51-4bbb-a6e5-38ef96464982 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:55.272138 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2b0965c4-3bf3-4af4-aba7-548f0c7d7c43 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:55.272744 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2b0965c4-3bf3-4af4-aba7-548f0c7d7c43 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:55.278878 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2b0965c4-3bf3-4af4-aba7-548f0c7d7c43 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:55.279779 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2b0965c4-3bf3-4af4-aba7-548f0c7d7c43 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:55.280567 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2b0965c4-3bf3-4af4-aba7-548f0c7d7c43 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:55.281008 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2b0965c4-3bf3-4af4-aba7-548f0c7d7c43 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:55.304394 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-930440ea-8a51-4bbb-a6e5-38ef96464982 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:55.312916 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-930440ea-8a51-4bbb-a6e5-38ef96464982 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.159359 Mar 03 02:54:55.313487 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1380/2513] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:55 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:55.411088 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2b0965c4-3bf3-4af4-aba7-548f0c7d7c43 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:55.418717 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2b0965c4-3bf3-4af4-aba7-548f0c7d7c43 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.150406 Mar 03 02:54:55.420439 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1134/2514] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:55 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:54:55.922178 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-948c5745-0757-4876-a1ab-c5183c43b2ab tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:55.922782 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-948c5745-0757-4876-a1ab-c5183c43b2ab tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:55.929027 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-948c5745-0757-4876-a1ab-c5183c43b2ab tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:55.929474 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-948c5745-0757-4876-a1ab-c5183c43b2ab tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:55.930266 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-948c5745-0757-4876-a1ab-c5183c43b2ab tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:55.931032 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-948c5745-0757-4876-a1ab-c5183c43b2ab tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:56.035705 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3bbf315a-6871-495a-bf69-2baccc3ed6ed tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:56.036326 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3bbf315a-6871-495a-bf69-2baccc3ed6ed tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:56.042461 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3bbf315a-6871-495a-bf69-2baccc3ed6ed tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:56.042923 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3bbf315a-6871-495a-bf69-2baccc3ed6ed tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:56.043735 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3bbf315a-6871-495a-bf69-2baccc3ed6ed tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:56.044266 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3bbf315a-6871-495a-bf69-2baccc3ed6ed tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:56.061111 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-948c5745-0757-4876-a1ab-c5183c43b2ab tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:56.068892 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-948c5745-0757-4876-a1ab-c5183c43b2ab tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.150543 Mar 03 02:54:56.069456 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1381/2515] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:55 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:56.103451 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3bbf315a-6871-495a-bf69-2baccc3ed6ed tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:56.111423 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3bbf315a-6871-495a-bf69-2baccc3ed6ed tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079583 Mar 03 02:54:56.112025 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1135/2516] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:56 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:54:56.330685 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9fc4757c-c243-4d08-b6d9-47723d9c3236 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:56.331286 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9fc4757c-c243-4d08-b6d9-47723d9c3236 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:56.337475 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9fc4757c-c243-4d08-b6d9-47723d9c3236 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:56.337923 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9fc4757c-c243-4d08-b6d9-47723d9c3236 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:56.338686 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9fc4757c-c243-4d08-b6d9-47723d9c3236 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:56.339123 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9fc4757c-c243-4d08-b6d9-47723d9c3236 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:56.437037 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-71192152-b2eb-4511-b086-51efc1a3751a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:56.437737 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-71192152-b2eb-4511-b086-51efc1a3751a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:56.443474 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-71192152-b2eb-4511-b086-51efc1a3751a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:56.443970 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-71192152-b2eb-4511-b086-51efc1a3751a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:56.444758 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-71192152-b2eb-4511-b086-51efc1a3751a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:56.445196 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-71192152-b2eb-4511-b086-51efc1a3751a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:56.473002 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9fc4757c-c243-4d08-b6d9-47723d9c3236 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:56.480984 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9fc4757c-c243-4d08-b6d9-47723d9c3236 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.154078 Mar 03 02:54:56.482453 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1382/2517] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:56 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:56.579158 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-71192152-b2eb-4511-b086-51efc1a3751a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:56.587081 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-71192152-b2eb-4511-b086-51efc1a3751a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.154340 Mar 03 02:54:56.587597 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1136/2518] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:56 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:54:57.086533 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2753af50-6f0b-4781-8a22-34a3046811d6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:57.087139 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2753af50-6f0b-4781-8a22-34a3046811d6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:57.093575 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2753af50-6f0b-4781-8a22-34a3046811d6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:57.094028 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2753af50-6f0b-4781-8a22-34a3046811d6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:57.094802 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2753af50-6f0b-4781-8a22-34a3046811d6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:57.095231 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2753af50-6f0b-4781-8a22-34a3046811d6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:57.127965 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-afa89483-8aea-4c6b-bf8b-ef21cd7846b5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:57.128553 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-afa89483-8aea-4c6b-bf8b-ef21cd7846b5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:57.134886 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-afa89483-8aea-4c6b-bf8b-ef21cd7846b5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:57.135329 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-afa89483-8aea-4c6b-bf8b-ef21cd7846b5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:57.136130 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-afa89483-8aea-4c6b-bf8b-ef21cd7846b5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:57.136561 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-afa89483-8aea-4c6b-bf8b-ef21cd7846b5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:57.197085 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-afa89483-8aea-4c6b-bf8b-ef21cd7846b5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:57.204835 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-afa89483-8aea-4c6b-bf8b-ef21cd7846b5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080650 Mar 03 02:54:57.205409 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1137/2519] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:57 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:54:57.226937 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2753af50-6f0b-4781-8a22-34a3046811d6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:57.235429 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2753af50-6f0b-4781-8a22-34a3046811d6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.152823 Mar 03 02:54:57.236013 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1383/2520] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:57 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:57.499900 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e9e21c6a-9968-48d0-b678-ed9e872fb4c5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:57.500528 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e9e21c6a-9968-48d0-b678-ed9e872fb4c5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:57.506262 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e9e21c6a-9968-48d0-b678-ed9e872fb4c5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:57.506711 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e9e21c6a-9968-48d0-b678-ed9e872fb4c5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:57.507476 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e9e21c6a-9968-48d0-b678-ed9e872fb4c5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:57.507930 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e9e21c6a-9968-48d0-b678-ed9e872fb4c5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:57.604839 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-aeb7f3d3-cab3-4d10-8208-20bc2e919220 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:57.605448 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-aeb7f3d3-cab3-4d10-8208-20bc2e919220 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:57.612749 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aeb7f3d3-cab3-4d10-8208-20bc2e919220 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:57.613198 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aeb7f3d3-cab3-4d10-8208-20bc2e919220 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:57.613974 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aeb7f3d3-cab3-4d10-8208-20bc2e919220 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:57.614406 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aeb7f3d3-cab3-4d10-8208-20bc2e919220 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:57.643012 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e9e21c6a-9968-48d0-b678-ed9e872fb4c5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:57.650753 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e9e21c6a-9968-48d0-b678-ed9e872fb4c5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.154725 Mar 03 02:54:57.651310 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1138/2521] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:57 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:57.745249 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-aeb7f3d3-cab3-4d10-8208-20bc2e919220 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:57.753007 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-aeb7f3d3-cab3-4d10-8208-20bc2e919220 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.151906 Mar 03 02:54:57.753516 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1384/2522] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:57 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:54:58.221857 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2f0e2ba2-b404-4277-9e83-6e8b4fe43133 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:58.222459 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2f0e2ba2-b404-4277-9e83-6e8b4fe43133 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:58.228676 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f0e2ba2-b404-4277-9e83-6e8b4fe43133 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:58.229119 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f0e2ba2-b404-4277-9e83-6e8b4fe43133 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:58.229915 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f0e2ba2-b404-4277-9e83-6e8b4fe43133 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:58.230345 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f0e2ba2-b404-4277-9e83-6e8b4fe43133 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:58.252213 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ffcaa963-e7e9-4c5c-920b-bd5eb0e3df63 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:58.252823 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ffcaa963-e7e9-4c5c-920b-bd5eb0e3df63 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:58.258513 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ffcaa963-e7e9-4c5c-920b-bd5eb0e3df63 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:58.258969 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ffcaa963-e7e9-4c5c-920b-bd5eb0e3df63 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:58.259773 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ffcaa963-e7e9-4c5c-920b-bd5eb0e3df63 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:58.260218 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ffcaa963-e7e9-4c5c-920b-bd5eb0e3df63 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:58.299959 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2f0e2ba2-b404-4277-9e83-6e8b4fe43133 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:58.307872 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2f0e2ba2-b404-4277-9e83-6e8b4fe43133 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.089735 Mar 03 02:54:58.308390 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1139/2523] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:58 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:54:58.396280 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ffcaa963-e7e9-4c5c-920b-bd5eb0e3df63 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:58.404154 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ffcaa963-e7e9-4c5c-920b-bd5eb0e3df63 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.155782 Mar 03 02:54:58.404716 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1385/2524] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:58 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:58.668848 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-866d0814-f203-43e8-8d15-cbacfebc1b62 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:58.669452 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-866d0814-f203-43e8-8d15-cbacfebc1b62 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:58.675247 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-866d0814-f203-43e8-8d15-cbacfebc1b62 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:58.675738 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-866d0814-f203-43e8-8d15-cbacfebc1b62 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:58.676510 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-866d0814-f203-43e8-8d15-cbacfebc1b62 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:58.676946 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-866d0814-f203-43e8-8d15-cbacfebc1b62 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:58.769874 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ddc52ea5-eb9d-4f8e-8cc3-deda465333f5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:58.770489 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ddc52ea5-eb9d-4f8e-8cc3-deda465333f5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:58.776706 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ddc52ea5-eb9d-4f8e-8cc3-deda465333f5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:58.777161 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ddc52ea5-eb9d-4f8e-8cc3-deda465333f5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:58.777991 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ddc52ea5-eb9d-4f8e-8cc3-deda465333f5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:58.778504 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ddc52ea5-eb9d-4f8e-8cc3-deda465333f5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:58.811036 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-866d0814-f203-43e8-8d15-cbacfebc1b62 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:58.818983 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-866d0814-f203-43e8-8d15-cbacfebc1b62 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.154142 Mar 03 02:54:58.819551 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1140/2525] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:58 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:58.910083 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ddc52ea5-eb9d-4f8e-8cc3-deda465333f5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:58.917761 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ddc52ea5-eb9d-4f8e-8cc3-deda465333f5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.151857 Mar 03 02:54:58.918331 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1386/2526] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:58 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:54:59.324721 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-cabb0bf5-7157-4205-8fac-7322c7d97216 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:59.325549 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-cabb0bf5-7157-4205-8fac-7322c7d97216 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:59.331910 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cabb0bf5-7157-4205-8fac-7322c7d97216 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:59.332358 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cabb0bf5-7157-4205-8fac-7322c7d97216 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:59.333125 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cabb0bf5-7157-4205-8fac-7322c7d97216 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:59.333558 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cabb0bf5-7157-4205-8fac-7322c7d97216 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:59.391984 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-cabb0bf5-7157-4205-8fac-7322c7d97216 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:59.399460 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-cabb0bf5-7157-4205-8fac-7322c7d97216 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.078628 Mar 03 02:54:59.400082 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1141/2527] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:59 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:59.421679 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e0735b7c-1d70-45ca-b6c8-753feb370fe1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:59.422329 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e0735b7c-1d70-45ca-b6c8-753feb370fe1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:59.428129 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e0735b7c-1d70-45ca-b6c8-753feb370fe1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:59.428577 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e0735b7c-1d70-45ca-b6c8-753feb370fe1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:59.429352 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e0735b7c-1d70-45ca-b6c8-753feb370fe1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:59.429790 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e0735b7c-1d70-45ca-b6c8-753feb370fe1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:59.563392 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e0735b7c-1d70-45ca-b6c8-753feb370fe1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:59.571170 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e0735b7c-1d70-45ca-b6c8-753feb370fe1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.154034 Mar 03 02:54:59.571763 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1387/2528] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:59 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:54:59.835261 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0b7d88be-1843-4781-ad4f-786abeae48c4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:59.835905 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0b7d88be-1843-4781-ad4f-786abeae48c4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:59.842841 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0b7d88be-1843-4781-ad4f-786abeae48c4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:59.843298 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0b7d88be-1843-4781-ad4f-786abeae48c4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:59.844108 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0b7d88be-1843-4781-ad4f-786abeae48c4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:59.844549 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0b7d88be-1843-4781-ad4f-786abeae48c4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:59.935135 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c3d486c4-d689-48cf-abe9-bb6fbdc1a7a4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:54:59.936319 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c3d486c4-d689-48cf-abe9-bb6fbdc1a7a4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:54:59.942202 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c3d486c4-d689-48cf-abe9-bb6fbdc1a7a4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:59.942651 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c3d486c4-d689-48cf-abe9-bb6fbdc1a7a4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:59.943430 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c3d486c4-d689-48cf-abe9-bb6fbdc1a7a4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:54:59.943890 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c3d486c4-d689-48cf-abe9-bb6fbdc1a7a4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:54:59.978092 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0b7d88be-1843-4781-ad4f-786abeae48c4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:54:59.986712 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0b7d88be-1843-4781-ad4f-786abeae48c4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.155250 Mar 03 02:54:59.987294 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1142/2529] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:59 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:00.074098 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c3d486c4-d689-48cf-abe9-bb6fbdc1a7a4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:00.082077 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c3d486c4-d689-48cf-abe9-bb6fbdc1a7a4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.151307 Mar 03 02:55:00.082642 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1388/2530] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:54:59 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:00.416463 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3462e0bd-b4af-4047-af24-a0cbc2583417 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:00.417075 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3462e0bd-b4af-4047-af24-a0cbc2583417 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:00.423311 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3462e0bd-b4af-4047-af24-a0cbc2583417 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:00.423801 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3462e0bd-b4af-4047-af24-a0cbc2583417 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:00.424576 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3462e0bd-b4af-4047-af24-a0cbc2583417 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:00.425016 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3462e0bd-b4af-4047-af24-a0cbc2583417 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:00.482863 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3462e0bd-b4af-4047-af24-a0cbc2583417 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:00.490429 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3462e0bd-b4af-4047-af24-a0cbc2583417 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.077810 Mar 03 02:55:00.490990 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1143/2531] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:00 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:00.588713 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c4c66cd7-f2b7-41dc-a98d-087546e43edb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:00.589318 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c4c66cd7-f2b7-41dc-a98d-087546e43edb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:00.596233 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c4c66cd7-f2b7-41dc-a98d-087546e43edb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:00.596690 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c4c66cd7-f2b7-41dc-a98d-087546e43edb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:00.597457 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c4c66cd7-f2b7-41dc-a98d-087546e43edb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:00.597895 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c4c66cd7-f2b7-41dc-a98d-087546e43edb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:00.735429 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c4c66cd7-f2b7-41dc-a98d-087546e43edb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:00.743121 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c4c66cd7-f2b7-41dc-a98d-087546e43edb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.158251 Mar 03 02:55:00.743702 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1389/2532] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:00 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:01.004268 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-15010019-1f17-41ed-abcc-e48e0716e1eb tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:01.004778 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-15010019-1f17-41ed-abcc-e48e0716e1eb tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:01.010582 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-15010019-1f17-41ed-abcc-e48e0716e1eb tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:01.011032 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-15010019-1f17-41ed-abcc-e48e0716e1eb tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:01.011836 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-15010019-1f17-41ed-abcc-e48e0716e1eb tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:01.012271 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-15010019-1f17-41ed-abcc-e48e0716e1eb tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:01.099731 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-25c3a59a-bdf8-4d2e-b796-28144f54a260 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:01.100344 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-25c3a59a-bdf8-4d2e-b796-28144f54a260 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:01.106861 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-25c3a59a-bdf8-4d2e-b796-28144f54a260 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:01.107312 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-25c3a59a-bdf8-4d2e-b796-28144f54a260 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:01.108127 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-25c3a59a-bdf8-4d2e-b796-28144f54a260 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:01.109679 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-25c3a59a-bdf8-4d2e-b796-28144f54a260 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:01.147191 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-15010019-1f17-41ed-abcc-e48e0716e1eb tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:01.155966 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-15010019-1f17-41ed-abcc-e48e0716e1eb tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.154978 Mar 03 02:55:01.156539 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1144/2533] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:00 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:01.240235 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-25c3a59a-bdf8-4d2e-b796-28144f54a260 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:01.248022 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-25c3a59a-bdf8-4d2e-b796-28144f54a260 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.152164 Mar 03 02:55:01.248582 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1390/2534] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:01 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:01.507414 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4ca17642-dee3-42b0-8b03-5c8097b6a34d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:01.508044 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4ca17642-dee3-42b0-8b03-5c8097b6a34d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:01.514234 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4ca17642-dee3-42b0-8b03-5c8097b6a34d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:01.515260 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4ca17642-dee3-42b0-8b03-5c8097b6a34d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:01.516085 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4ca17642-dee3-42b0-8b03-5c8097b6a34d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:01.516518 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4ca17642-dee3-42b0-8b03-5c8097b6a34d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:01.579929 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4ca17642-dee3-42b0-8b03-5c8097b6a34d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:01.587583 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4ca17642-dee3-42b0-8b03-5c8097b6a34d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.083954 Mar 03 02:55:01.588171 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1145/2535] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:01 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:01.760734 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-333af693-4e71-4d33-9fd0-60cdc1c748f8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:01.761265 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-333af693-4e71-4d33-9fd0-60cdc1c748f8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:01.768279 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-333af693-4e71-4d33-9fd0-60cdc1c748f8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:01.768731 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-333af693-4e71-4d33-9fd0-60cdc1c748f8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:01.769505 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-333af693-4e71-4d33-9fd0-60cdc1c748f8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:01.769943 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-333af693-4e71-4d33-9fd0-60cdc1c748f8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:01.899377 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-333af693-4e71-4d33-9fd0-60cdc1c748f8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:01.907384 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-333af693-4e71-4d33-9fd0-60cdc1c748f8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.150612 Mar 03 02:55:01.907982 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1391/2536] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:01 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:02.173795 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-734d2483-0e43-49c0-86b3-b883735314d0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:02.174400 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-734d2483-0e43-49c0-86b3-b883735314d0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:02.180185 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-734d2483-0e43-49c0-86b3-b883735314d0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:02.180635 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-734d2483-0e43-49c0-86b3-b883735314d0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:02.181400 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-734d2483-0e43-49c0-86b3-b883735314d0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:02.181836 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-734d2483-0e43-49c0-86b3-b883735314d0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:02.265225 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7656f415-2389-4b7e-ae50-f27fdfdada91 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:02.265832 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7656f415-2389-4b7e-ae50-f27fdfdada91 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:02.272091 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7656f415-2389-4b7e-ae50-f27fdfdada91 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:02.272542 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7656f415-2389-4b7e-ae50-f27fdfdada91 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:02.273314 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7656f415-2389-4b7e-ae50-f27fdfdada91 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:02.273746 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7656f415-2389-4b7e-ae50-f27fdfdada91 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:02.313369 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-734d2483-0e43-49c0-86b3-b883735314d0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:02.321280 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-734d2483-0e43-49c0-86b3-b883735314d0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.151684 Mar 03 02:55:02.321859 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1146/2537] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:02 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:02.408092 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-7656f415-2389-4b7e-ae50-f27fdfdada91 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:02.415808 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7656f415-2389-4b7e-ae50-f27fdfdada91 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.154583 Mar 03 02:55:02.416377 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1392/2538] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:02 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:02.604986 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-913a62ad-e456-41e4-a4c8-50977d4d8eec tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:02.605590 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-913a62ad-e456-41e4-a4c8-50977d4d8eec tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:02.612875 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-913a62ad-e456-41e4-a4c8-50977d4d8eec tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:02.613328 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-913a62ad-e456-41e4-a4c8-50977d4d8eec tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:02.614095 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-913a62ad-e456-41e4-a4c8-50977d4d8eec tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:02.614527 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-913a62ad-e456-41e4-a4c8-50977d4d8eec tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:02.673284 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-913a62ad-e456-41e4-a4c8-50977d4d8eec tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:02.680905 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-913a62ad-e456-41e4-a4c8-50977d4d8eec tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079778 Mar 03 02:55:02.681462 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1147/2539] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:02 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:02.924510 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-73289e2a-b866-4a7d-9ceb-99504f504ef3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:02.925150 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-73289e2a-b866-4a7d-9ceb-99504f504ef3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:02.931037 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-73289e2a-b866-4a7d-9ceb-99504f504ef3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:02.931488 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-73289e2a-b866-4a7d-9ceb-99504f504ef3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:02.932290 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-73289e2a-b866-4a7d-9ceb-99504f504ef3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:02.932726 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-73289e2a-b866-4a7d-9ceb-99504f504ef3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:03.074377 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-73289e2a-b866-4a7d-9ceb-99504f504ef3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:03.084060 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-73289e2a-b866-4a7d-9ceb-99504f504ef3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.163475 Mar 03 02:55:03.085490 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1393/2540] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:02 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:03.338291 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2b9329d5-06d7-43c0-a93e-542465b5b71b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:03.338893 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2b9329d5-06d7-43c0-a93e-542465b5b71b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:03.345301 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2b9329d5-06d7-43c0-a93e-542465b5b71b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:03.345761 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2b9329d5-06d7-43c0-a93e-542465b5b71b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:03.346550 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2b9329d5-06d7-43c0-a93e-542465b5b71b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:03.346992 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2b9329d5-06d7-43c0-a93e-542465b5b71b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:03.433706 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a3c9bdaf-2580-4d5c-a63b-0cd4cf92962f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:03.438057 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a3c9bdaf-2580-4d5c-a63b-0cd4cf92962f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:03.447021 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a3c9bdaf-2580-4d5c-a63b-0cd4cf92962f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:03.447501 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a3c9bdaf-2580-4d5c-a63b-0cd4cf92962f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:03.448353 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a3c9bdaf-2580-4d5c-a63b-0cd4cf92962f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:03.448803 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a3c9bdaf-2580-4d5c-a63b-0cd4cf92962f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:03.484928 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2b9329d5-06d7-43c0-a93e-542465b5b71b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:03.494305 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2b9329d5-06d7-43c0-a93e-542465b5b71b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.159830 Mar 03 02:55:03.494875 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1148/2541] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:03 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:03.600661 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a3c9bdaf-2580-4d5c-a63b-0cd4cf92962f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:03.612224 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a3c9bdaf-2580-4d5c-a63b-0cd4cf92962f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.182291 Mar 03 02:55:03.613134 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1394/2542] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:03 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:03.696867 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-238ad9d6-8198-473c-b899-590593ac290a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:03.697493 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-238ad9d6-8198-473c-b899-590593ac290a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:03.704412 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-238ad9d6-8198-473c-b899-590593ac290a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:03.705306 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-238ad9d6-8198-473c-b899-590593ac290a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:03.706135 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-238ad9d6-8198-473c-b899-590593ac290a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:03.706652 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-238ad9d6-8198-473c-b899-590593ac290a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:03.768568 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-238ad9d6-8198-473c-b899-590593ac290a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:03.776216 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-238ad9d6-8198-473c-b899-590593ac290a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.083287 Mar 03 02:55:03.776775 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1149/2543] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:03 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:04.103112 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0c8c38f1-f77f-47eb-ab18-7ddee0b33f88 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:04.103750 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0c8c38f1-f77f-47eb-ab18-7ddee0b33f88 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:04.111098 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0c8c38f1-f77f-47eb-ab18-7ddee0b33f88 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:04.111551 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0c8c38f1-f77f-47eb-ab18-7ddee0b33f88 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:04.112355 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0c8c38f1-f77f-47eb-ab18-7ddee0b33f88 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:04.112793 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0c8c38f1-f77f-47eb-ab18-7ddee0b33f88 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:04.240071 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0c8c38f1-f77f-47eb-ab18-7ddee0b33f88 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:04.247797 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0c8c38f1-f77f-47eb-ab18-7ddee0b33f88 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.148562 Mar 03 02:55:04.248369 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1395/2544] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:04 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:04.512187 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c05f6893-6f37-4a04-918d-f5596d58cd50 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:04.512711 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c05f6893-6f37-4a04-918d-f5596d58cd50 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:04.519066 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c05f6893-6f37-4a04-918d-f5596d58cd50 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:04.519515 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c05f6893-6f37-4a04-918d-f5596d58cd50 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:04.520313 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c05f6893-6f37-4a04-918d-f5596d58cd50 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:04.520745 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c05f6893-6f37-4a04-918d-f5596d58cd50 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:04.628262 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-11f87a16-9b59-40be-9477-b948b0c73b63 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:04.628868 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-11f87a16-9b59-40be-9477-b948b0c73b63 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:04.634898 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-11f87a16-9b59-40be-9477-b948b0c73b63 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:04.635342 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-11f87a16-9b59-40be-9477-b948b0c73b63 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:04.636148 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-11f87a16-9b59-40be-9477-b948b0c73b63 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:04.636579 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-11f87a16-9b59-40be-9477-b948b0c73b63 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:04.650301 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c05f6893-6f37-4a04-918d-f5596d58cd50 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:04.658593 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c05f6893-6f37-4a04-918d-f5596d58cd50 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.150297 Mar 03 02:55:04.659154 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1150/2545] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:04 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:04.766895 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-11f87a16-9b59-40be-9477-b948b0c73b63 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:04.774514 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-11f87a16-9b59-40be-9477-b948b0c73b63 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.150172 Mar 03 02:55:04.775073 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1396/2546] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:04 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:04.792964 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-64d0aea2-0a0f-4570-aa09-3d36b0fddb39 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:04.793564 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-64d0aea2-0a0f-4570-aa09-3d36b0fddb39 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:04.800018 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-64d0aea2-0a0f-4570-aa09-3d36b0fddb39 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:04.800470 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-64d0aea2-0a0f-4570-aa09-3d36b0fddb39 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:04.801242 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-64d0aea2-0a0f-4570-aa09-3d36b0fddb39 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:04.801676 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-64d0aea2-0a0f-4570-aa09-3d36b0fddb39 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:04.861881 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-64d0aea2-0a0f-4570-aa09-3d36b0fddb39 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:04.869447 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-64d0aea2-0a0f-4570-aa09-3d36b0fddb39 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080223 Mar 03 02:55:04.870009 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1151/2547] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:04 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:05.266230 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9a8188b7-1998-4335-b745-488eee2893b7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:05.266853 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9a8188b7-1998-4335-b745-488eee2893b7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:05.272685 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9a8188b7-1998-4335-b745-488eee2893b7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:05.273144 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9a8188b7-1998-4335-b745-488eee2893b7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:05.273920 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9a8188b7-1998-4335-b745-488eee2893b7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:05.274362 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9a8188b7-1998-4335-b745-488eee2893b7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:05.406407 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9a8188b7-1998-4335-b745-488eee2893b7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:05.414206 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9a8188b7-1998-4335-b745-488eee2893b7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.152242 Mar 03 02:55:05.414778 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1397/2548] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:05 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:05.676135 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3cfd1b81-be7b-4626-9579-af3726d6c8f4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:05.676712 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3cfd1b81-be7b-4626-9579-af3726d6c8f4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:05.682550 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3cfd1b81-be7b-4626-9579-af3726d6c8f4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:05.682997 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3cfd1b81-be7b-4626-9579-af3726d6c8f4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:05.683791 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3cfd1b81-be7b-4626-9579-af3726d6c8f4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:05.684227 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3cfd1b81-be7b-4626-9579-af3726d6c8f4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:05.791128 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-fd7d9751-3273-4525-b262-2bb2aeb35fd1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:05.791825 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-fd7d9751-3273-4525-b262-2bb2aeb35fd1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:05.798610 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fd7d9751-3273-4525-b262-2bb2aeb35fd1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:05.799107 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fd7d9751-3273-4525-b262-2bb2aeb35fd1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:05.799957 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fd7d9751-3273-4525-b262-2bb2aeb35fd1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:05.800390 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fd7d9751-3273-4525-b262-2bb2aeb35fd1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:05.817205 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3cfd1b81-be7b-4626-9579-af3726d6c8f4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:05.824973 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3cfd1b81-be7b-4626-9579-af3726d6c8f4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.152679 Mar 03 02:55:05.825542 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1152/2549] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:05 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:05.886219 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a09c9da2-27f7-48b1-9c4f-ea1aca0639c7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:05.886783 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a09c9da2-27f7-48b1-9c4f-ea1aca0639c7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:05.893672 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a09c9da2-27f7-48b1-9c4f-ea1aca0639c7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:05.894125 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a09c9da2-27f7-48b1-9c4f-ea1aca0639c7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:05.894915 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a09c9da2-27f7-48b1-9c4f-ea1aca0639c7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:05.895351 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a09c9da2-27f7-48b1-9c4f-ea1aca0639c7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:05.937328 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-fd7d9751-3273-4525-b262-2bb2aeb35fd1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:05.945502 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-fd7d9751-3273-4525-b262-2bb2aeb35fd1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.158194 Mar 03 02:55:05.946147 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1398/2550] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:05 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:05.957566 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a09c9da2-27f7-48b1-9c4f-ea1aca0639c7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:05.965497 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a09c9da2-27f7-48b1-9c4f-ea1aca0639c7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.083164 Mar 03 02:55:05.966060 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1153/2551] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:05 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:06.431496 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9cdbfc10-a36a-416c-8981-d0dd93f98229 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:06.432144 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9cdbfc10-a36a-416c-8981-d0dd93f98229 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:06.440066 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9cdbfc10-a36a-416c-8981-d0dd93f98229 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:06.440196 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9cdbfc10-a36a-416c-8981-d0dd93f98229 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:06.440973 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9cdbfc10-a36a-416c-8981-d0dd93f98229 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:06.441403 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9cdbfc10-a36a-416c-8981-d0dd93f98229 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:06.575325 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9cdbfc10-a36a-416c-8981-d0dd93f98229 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:06.583596 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9cdbfc10-a36a-416c-8981-d0dd93f98229 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.155960 Mar 03 02:55:06.584181 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1399/2552] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:06 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:06.842647 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-426c49d6-5cbe-42fa-aa1c-bf1c00536e47 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:06.843918 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-426c49d6-5cbe-42fa-aa1c-bf1c00536e47 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:06.850096 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-426c49d6-5cbe-42fa-aa1c-bf1c00536e47 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:06.850541 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-426c49d6-5cbe-42fa-aa1c-bf1c00536e47 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:06.851306 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-426c49d6-5cbe-42fa-aa1c-bf1c00536e47 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:06.851761 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-426c49d6-5cbe-42fa-aa1c-bf1c00536e47 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:06.963429 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a345c523-f6f8-451b-b1ea-e2e8d7402bdc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:06.964126 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a345c523-f6f8-451b-b1ea-e2e8d7402bdc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:06.969909 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a345c523-f6f8-451b-b1ea-e2e8d7402bdc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:06.970360 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a345c523-f6f8-451b-b1ea-e2e8d7402bdc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:06.971136 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a345c523-f6f8-451b-b1ea-e2e8d7402bdc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:06.971569 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a345c523-f6f8-451b-b1ea-e2e8d7402bdc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:06.988043 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-426c49d6-5cbe-42fa-aa1c-bf1c00536e47 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:06.995712 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-426c49d6-5cbe-42fa-aa1c-bf1c00536e47 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.156944 Mar 03 02:55:07.000412 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1154/2553] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:06 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:07.001637 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d271b27e-d802-4693-89f6-6e2252e4a8d2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:07.002239 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d271b27e-d802-4693-89f6-6e2252e4a8d2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:07.008262 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d271b27e-d802-4693-89f6-6e2252e4a8d2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:07.008709 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d271b27e-d802-4693-89f6-6e2252e4a8d2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:07.009480 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d271b27e-d802-4693-89f6-6e2252e4a8d2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:07.009913 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d271b27e-d802-4693-89f6-6e2252e4a8d2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:07.069088 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d271b27e-d802-4693-89f6-6e2252e4a8d2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:07.077705 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d271b27e-d802-4693-89f6-6e2252e4a8d2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079362 Mar 03 02:55:07.078589 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1155/2554] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:06 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:07.103397 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a345c523-f6f8-451b-b1ea-e2e8d7402bdc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:07.112245 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a345c523-f6f8-451b-b1ea-e2e8d7402bdc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.152668 Mar 03 02:55:07.112811 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1400/2555] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:06 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:07.601408 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-aca51682-a856-4d6b-8c3c-d2ba1cce37c6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:07.602035 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-aca51682-a856-4d6b-8c3c-d2ba1cce37c6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:07.608069 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aca51682-a856-4d6b-8c3c-d2ba1cce37c6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:07.608780 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aca51682-a856-4d6b-8c3c-d2ba1cce37c6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:07.609578 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aca51682-a856-4d6b-8c3c-d2ba1cce37c6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:07.610007 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aca51682-a856-4d6b-8c3c-d2ba1cce37c6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:07.738022 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-aca51682-a856-4d6b-8c3c-d2ba1cce37c6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:07.745923 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-aca51682-a856-4d6b-8c3c-d2ba1cce37c6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.148399 Mar 03 02:55:07.746494 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1156/2556] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:07 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:08.013637 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-25bd0ea0-e15f-4e1c-903e-25f8983f40e8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:08.014366 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-25bd0ea0-e15f-4e1c-903e-25f8983f40e8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:08.021756 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-25bd0ea0-e15f-4e1c-903e-25f8983f40e8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:08.022205 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-25bd0ea0-e15f-4e1c-903e-25f8983f40e8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:08.022979 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-25bd0ea0-e15f-4e1c-903e-25f8983f40e8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:08.023417 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-25bd0ea0-e15f-4e1c-903e-25f8983f40e8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:08.094793 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1753d057-f9e0-42bf-994f-54a4b89269fd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:08.095400 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1753d057-f9e0-42bf-994f-54a4b89269fd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:08.101601 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1753d057-f9e0-42bf-994f-54a4b89269fd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:08.102058 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1753d057-f9e0-42bf-994f-54a4b89269fd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:08.102846 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1753d057-f9e0-42bf-994f-54a4b89269fd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:08.103322 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1753d057-f9e0-42bf-994f-54a4b89269fd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:08.159163 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-25bd0ea0-e15f-4e1c-903e-25f8983f40e8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:08.162844 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1753d057-f9e0-42bf-994f-54a4b89269fd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:08.167279 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-25bd0ea0-e15f-4e1c-903e-25f8983f40e8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.157523 Mar 03 02:55:08.167877 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1401/2557] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:08 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:08.170722 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1753d057-f9e0-42bf-994f-54a4b89269fd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079991 Mar 03 02:55:08.172026 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1157/2558] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:08 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:08.172891 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a75679a9-2bf4-4376-adb2-851d9687ff46 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:08.173524 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a75679a9-2bf4-4376-adb2-851d9687ff46 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:08.179086 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a75679a9-2bf4-4376-adb2-851d9687ff46 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:08.179546 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a75679a9-2bf4-4376-adb2-851d9687ff46 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:08.180363 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a75679a9-2bf4-4376-adb2-851d9687ff46 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:08.180805 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a75679a9-2bf4-4376-adb2-851d9687ff46 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:08.309624 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a75679a9-2bf4-4376-adb2-851d9687ff46 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:08.317940 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a75679a9-2bf4-4376-adb2-851d9687ff46 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.149126 Mar 03 02:55:08.318504 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1402/2559] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:08 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:08.763300 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-04db215a-caba-49f1-9d3b-093e416a6cca tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:08.764057 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-04db215a-caba-49f1-9d3b-093e416a6cca tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:08.770169 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-04db215a-caba-49f1-9d3b-093e416a6cca tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:08.770620 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-04db215a-caba-49f1-9d3b-093e416a6cca tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:08.771394 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-04db215a-caba-49f1-9d3b-093e416a6cca tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:08.771869 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-04db215a-caba-49f1-9d3b-093e416a6cca tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:08.906123 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-04db215a-caba-49f1-9d3b-093e416a6cca tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:08.913829 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-04db215a-caba-49f1-9d3b-093e416a6cca tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.154377 Mar 03 02:55:08.914396 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1158/2560] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:08 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:09.185096 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-78f9354b-2b3b-4d76-9224-352ca272db66 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:09.185710 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-78f9354b-2b3b-4d76-9224-352ca272db66 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:09.187302 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ba1f1233-0d09-4041-ad50-9ea8f103ae1e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:09.187924 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ba1f1233-0d09-4041-ad50-9ea8f103ae1e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:09.192272 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-78f9354b-2b3b-4d76-9224-352ca272db66 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:09.192729 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-78f9354b-2b3b-4d76-9224-352ca272db66 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:09.193520 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-78f9354b-2b3b-4d76-9224-352ca272db66 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:09.193961 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-78f9354b-2b3b-4d76-9224-352ca272db66 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:09.194110 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ba1f1233-0d09-4041-ad50-9ea8f103ae1e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:09.194567 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ba1f1233-0d09-4041-ad50-9ea8f103ae1e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:09.195379 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ba1f1233-0d09-4041-ad50-9ea8f103ae1e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:09.195843 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ba1f1233-0d09-4041-ad50-9ea8f103ae1e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:09.256657 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ba1f1233-0d09-4041-ad50-9ea8f103ae1e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:09.264325 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ba1f1233-0d09-4041-ad50-9ea8f103ae1e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.081306 Mar 03 02:55:09.266166 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1159/2561] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:09 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:09.330019 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-78f9354b-2b3b-4d76-9224-352ca272db66 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:09.334436 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-94ef1953-cc9b-4fb3-a6e1-c13c0f59962a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:09.335046 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-94ef1953-cc9b-4fb3-a6e1-c13c0f59962a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:09.337844 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-78f9354b-2b3b-4d76-9224-352ca272db66 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.156584 Mar 03 02:55:09.338409 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1403/2562] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:09 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:09.340945 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-94ef1953-cc9b-4fb3-a6e1-c13c0f59962a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:09.341398 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-94ef1953-cc9b-4fb3-a6e1-c13c0f59962a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:09.342175 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-94ef1953-cc9b-4fb3-a6e1-c13c0f59962a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:09.342637 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-94ef1953-cc9b-4fb3-a6e1-c13c0f59962a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:09.474150 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-94ef1953-cc9b-4fb3-a6e1-c13c0f59962a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:09.482097 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-94ef1953-cc9b-4fb3-a6e1-c13c0f59962a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.151393 Mar 03 02:55:09.482758 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1160/2563] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:09 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:09.930763 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-099351df-72b8-4e27-8529-253cba9f0799 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:09.931365 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-099351df-72b8-4e27-8529-253cba9f0799 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:09.938395 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-099351df-72b8-4e27-8529-253cba9f0799 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:09.939407 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-099351df-72b8-4e27-8529-253cba9f0799 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:09.939691 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-099351df-72b8-4e27-8529-253cba9f0799 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:09.940146 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-099351df-72b8-4e27-8529-253cba9f0799 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:10.076509 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-099351df-72b8-4e27-8529-253cba9f0799 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:10.084315 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-099351df-72b8-4e27-8529-253cba9f0799 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.157379 Mar 03 02:55:10.084871 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1404/2564] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:09 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:10.282727 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-fce3a933-2a2a-4672-ba61-90865aefec5c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:10.283298 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-fce3a933-2a2a-4672-ba61-90865aefec5c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:10.289365 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fce3a933-2a2a-4672-ba61-90865aefec5c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:10.289809 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fce3a933-2a2a-4672-ba61-90865aefec5c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:10.290573 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fce3a933-2a2a-4672-ba61-90865aefec5c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:10.291004 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fce3a933-2a2a-4672-ba61-90865aefec5c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:10.353803 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-fce3a933-2a2a-4672-ba61-90865aefec5c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:10.355513 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6ab34e5c-2ebe-4307-ac5c-11dccba20e48 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:10.356411 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6ab34e5c-2ebe-4307-ac5c-11dccba20e48 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:10.361832 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-fce3a933-2a2a-4672-ba61-90865aefec5c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.083734 Mar 03 02:55:10.362401 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1161/2565] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:10 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:10.362565 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6ab34e5c-2ebe-4307-ac5c-11dccba20e48 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:10.363012 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6ab34e5c-2ebe-4307-ac5c-11dccba20e48 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:10.363908 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6ab34e5c-2ebe-4307-ac5c-11dccba20e48 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:10.364350 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6ab34e5c-2ebe-4307-ac5c-11dccba20e48 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:10.492606 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6ab34e5c-2ebe-4307-ac5c-11dccba20e48 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:10.500318 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7a0cc685-5b3d-4b22-873d-e2e90886e5db tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:10.500511 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6ab34e5c-2ebe-4307-ac5c-11dccba20e48 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.149119 Mar 03 02:55:10.501149 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7a0cc685-5b3d-4b22-873d-e2e90886e5db tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:10.501296 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1405/2566] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:10 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:10.506622 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7a0cc685-5b3d-4b22-873d-e2e90886e5db tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:10.507066 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7a0cc685-5b3d-4b22-873d-e2e90886e5db tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:10.507859 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7a0cc685-5b3d-4b22-873d-e2e90886e5db tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:10.508293 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7a0cc685-5b3d-4b22-873d-e2e90886e5db tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:10.637023 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-7a0cc685-5b3d-4b22-873d-e2e90886e5db tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:10.645759 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7a0cc685-5b3d-4b22-873d-e2e90886e5db tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.149352 Mar 03 02:55:10.646326 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1162/2567] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:10 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:11.102144 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d2ce5fae-e594-4b5f-bd26-2d949bc756fa tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:11.102816 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d2ce5fae-e594-4b5f-bd26-2d949bc756fa tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:11.109390 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d2ce5fae-e594-4b5f-bd26-2d949bc756fa tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:11.109844 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d2ce5fae-e594-4b5f-bd26-2d949bc756fa tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:11.110621 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d2ce5fae-e594-4b5f-bd26-2d949bc756fa tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:11.111061 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d2ce5fae-e594-4b5f-bd26-2d949bc756fa tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:11.241617 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d2ce5fae-e594-4b5f-bd26-2d949bc756fa tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:11.250028 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d2ce5fae-e594-4b5f-bd26-2d949bc756fa tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.151764 Mar 03 02:55:11.250605 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1406/2568] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:11 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:11.378783 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2f330190-6db9-4e99-89fa-d18f5a0e27f2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:11.379387 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2f330190-6db9-4e99-89fa-d18f5a0e27f2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:11.385531 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f330190-6db9-4e99-89fa-d18f5a0e27f2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:11.385985 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f330190-6db9-4e99-89fa-d18f5a0e27f2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:11.386750 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f330190-6db9-4e99-89fa-d18f5a0e27f2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:11.387206 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f330190-6db9-4e99-89fa-d18f5a0e27f2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:11.445929 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2f330190-6db9-4e99-89fa-d18f5a0e27f2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:11.453511 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2f330190-6db9-4e99-89fa-d18f5a0e27f2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.078655 Mar 03 02:55:11.454066 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1163/2569] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:11 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:11.517648 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b904b9ca-bcdd-421d-9337-f3b4c60d5537 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:11.518298 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b904b9ca-bcdd-421d-9337-f3b4c60d5537 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:11.524482 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b904b9ca-bcdd-421d-9337-f3b4c60d5537 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:11.524964 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b904b9ca-bcdd-421d-9337-f3b4c60d5537 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:11.525746 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b904b9ca-bcdd-421d-9337-f3b4c60d5537 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:11.526187 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b904b9ca-bcdd-421d-9337-f3b4c60d5537 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:11.659278 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b904b9ca-bcdd-421d-9337-f3b4c60d5537 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:11.662258 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c556c2ca-4b5d-4988-b9a6-7c5d9ed6ca86 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:11.662948 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c556c2ca-4b5d-4988-b9a6-7c5d9ed6ca86 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:11.667088 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b904b9ca-bcdd-421d-9337-f3b4c60d5537 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.153472 Mar 03 02:55:11.667740 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1407/2570] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:11 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:11.668779 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c556c2ca-4b5d-4988-b9a6-7c5d9ed6ca86 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:11.669240 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c556c2ca-4b5d-4988-b9a6-7c5d9ed6ca86 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:11.670020 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c556c2ca-4b5d-4988-b9a6-7c5d9ed6ca86 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:11.670460 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c556c2ca-4b5d-4988-b9a6-7c5d9ed6ca86 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:11.806808 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c556c2ca-4b5d-4988-b9a6-7c5d9ed6ca86 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:11.815146 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c556c2ca-4b5d-4988-b9a6-7c5d9ed6ca86 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.156763 Mar 03 02:55:11.815735 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1164/2571] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:11 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:12.267158 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f8687117-8d9e-4442-80a3-7a63d7391ff2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:12.267723 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f8687117-8d9e-4442-80a3-7a63d7391ff2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:12.273557 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f8687117-8d9e-4442-80a3-7a63d7391ff2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:12.274009 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f8687117-8d9e-4442-80a3-7a63d7391ff2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:12.274788 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f8687117-8d9e-4442-80a3-7a63d7391ff2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:12.275229 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f8687117-8d9e-4442-80a3-7a63d7391ff2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:12.402370 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f8687117-8d9e-4442-80a3-7a63d7391ff2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:12.410617 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f8687117-8d9e-4442-80a3-7a63d7391ff2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.147528 Mar 03 02:55:12.411174 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1408/2572] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:12 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:12.470092 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-50046e02-079e-410a-9f68-a5f2e228419b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:12.470698 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-50046e02-079e-410a-9f68-a5f2e228419b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:12.476933 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-50046e02-079e-410a-9f68-a5f2e228419b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:12.477385 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-50046e02-079e-410a-9f68-a5f2e228419b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:12.478158 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-50046e02-079e-410a-9f68-a5f2e228419b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:12.478596 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-50046e02-079e-410a-9f68-a5f2e228419b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:12.538207 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-50046e02-079e-410a-9f68-a5f2e228419b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:12.546427 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-50046e02-079e-410a-9f68-a5f2e228419b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079918 Mar 03 02:55:12.546998 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1165/2573] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:12 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:12.684442 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3280ce64-32c1-4dd9-9043-b845cbf25ca8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:12.685048 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3280ce64-32c1-4dd9-9043-b845cbf25ca8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:12.691660 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3280ce64-32c1-4dd9-9043-b845cbf25ca8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:12.692110 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3280ce64-32c1-4dd9-9043-b845cbf25ca8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:12.692882 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3280ce64-32c1-4dd9-9043-b845cbf25ca8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:12.693342 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3280ce64-32c1-4dd9-9043-b845cbf25ca8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:12.826538 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-3280ce64-32c1-4dd9-9043-b845cbf25ca8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:12.832786 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0a7d27e2-03cd-4e7c-a3f9-8dfa87a3e11e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:12.833387 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0a7d27e2-03cd-4e7c-a3f9-8dfa87a3e11e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:12.835034 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3280ce64-32c1-4dd9-9043-b845cbf25ca8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.154421 Mar 03 02:55:12.835626 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1409/2574] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:12 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:12.839039 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0a7d27e2-03cd-4e7c-a3f9-8dfa87a3e11e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:12.839488 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0a7d27e2-03cd-4e7c-a3f9-8dfa87a3e11e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:12.840282 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0a7d27e2-03cd-4e7c-a3f9-8dfa87a3e11e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:12.841339 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0a7d27e2-03cd-4e7c-a3f9-8dfa87a3e11e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:12.971726 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0a7d27e2-03cd-4e7c-a3f9-8dfa87a3e11e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:12.979497 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0a7d27e2-03cd-4e7c-a3f9-8dfa87a3e11e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.150698 Mar 03 02:55:12.980038 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1166/2575] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:12 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:13.427795 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c1b6ecc0-51ea-4ba4-83f0-790d5cb2a04e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:13.428404 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c1b6ecc0-51ea-4ba4-83f0-790d5cb2a04e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:13.434250 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c1b6ecc0-51ea-4ba4-83f0-790d5cb2a04e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:13.434698 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c1b6ecc0-51ea-4ba4-83f0-790d5cb2a04e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:13.435466 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c1b6ecc0-51ea-4ba4-83f0-790d5cb2a04e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:13.435930 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c1b6ecc0-51ea-4ba4-83f0-790d5cb2a04e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:13.562931 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-aab2698f-0317-431b-8fde-48f029efb408 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:13.563423 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-aab2698f-0317-431b-8fde-48f029efb408 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:13.564565 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c1b6ecc0-51ea-4ba4-83f0-790d5cb2a04e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:13.569641 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aab2698f-0317-431b-8fde-48f029efb408 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:13.570109 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aab2698f-0317-431b-8fde-48f029efb408 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:13.570895 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aab2698f-0317-431b-8fde-48f029efb408 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:13.571336 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aab2698f-0317-431b-8fde-48f029efb408 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:13.572353 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c1b6ecc0-51ea-4ba4-83f0-790d5cb2a04e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.148432 Mar 03 02:55:13.572937 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1410/2576] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:13 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:13.634308 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-aab2698f-0317-431b-8fde-48f029efb408 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:13.642003 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-aab2698f-0317-431b-8fde-48f029efb408 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.083719 Mar 03 02:55:13.642565 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1167/2577] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:13 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:13.853368 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1c8cf323-063b-40fe-910f-ba8c4add3a8f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:13.853964 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1c8cf323-063b-40fe-910f-ba8c4add3a8f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:13.860608 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1c8cf323-063b-40fe-910f-ba8c4add3a8f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:13.861060 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1c8cf323-063b-40fe-910f-ba8c4add3a8f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:13.861836 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1c8cf323-063b-40fe-910f-ba8c4add3a8f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:13.862276 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1c8cf323-063b-40fe-910f-ba8c4add3a8f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:13.995816 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-53d118b9-1eb7-4f14-aead-c26ecea298d2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:13.996394 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-53d118b9-1eb7-4f14-aead-c26ecea298d2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:13.998584 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1c8cf323-063b-40fe-910f-ba8c4add3a8f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:14.002802 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-53d118b9-1eb7-4f14-aead-c26ecea298d2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:14.003253 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-53d118b9-1eb7-4f14-aead-c26ecea298d2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:14.004089 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-53d118b9-1eb7-4f14-aead-c26ecea298d2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:14.004533 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-53d118b9-1eb7-4f14-aead-c26ecea298d2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:14.007337 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1c8cf323-063b-40fe-910f-ba8c4add3a8f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.158312 Mar 03 02:55:14.007941 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1411/2578] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:13 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:14.133168 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-53d118b9-1eb7-4f14-aead-c26ecea298d2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:14.141508 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-53d118b9-1eb7-4f14-aead-c26ecea298d2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.149668 Mar 03 02:55:14.142117 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1168/2579] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:13 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:14.590982 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e2010df3-ce2b-4bd2-8a16-ab7c1e68d37d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:14.591701 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e2010df3-ce2b-4bd2-8a16-ab7c1e68d37d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:14.598496 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e2010df3-ce2b-4bd2-8a16-ab7c1e68d37d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:14.598943 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e2010df3-ce2b-4bd2-8a16-ab7c1e68d37d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:14.599751 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e2010df3-ce2b-4bd2-8a16-ab7c1e68d37d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:14.600187 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e2010df3-ce2b-4bd2-8a16-ab7c1e68d37d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:14.658734 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-02d6d368-082a-41f7-a2dc-0301aa82bc3a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:14.659381 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-02d6d368-082a-41f7-a2dc-0301aa82bc3a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:14.665725 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-02d6d368-082a-41f7-a2dc-0301aa82bc3a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:14.666182 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-02d6d368-082a-41f7-a2dc-0301aa82bc3a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:14.666975 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-02d6d368-082a-41f7-a2dc-0301aa82bc3a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:14.667411 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-02d6d368-082a-41f7-a2dc-0301aa82bc3a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:14.728072 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-02d6d368-082a-41f7-a2dc-0301aa82bc3a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:14.734780 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e2010df3-ce2b-4bd2-8a16-ab7c1e68d37d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:14.736906 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-02d6d368-082a-41f7-a2dc-0301aa82bc3a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.082537 Mar 03 02:55:14.737480 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1169/2580] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:14 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:14.742544 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e2010df3-ce2b-4bd2-8a16-ab7c1e68d37d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.156302 Mar 03 02:55:14.743104 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1412/2581] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:14 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:15.026080 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-eee2ece9-63d9-44c6-99dc-db7b9c084227 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:15.026603 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-eee2ece9-63d9-44c6-99dc-db7b9c084227 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:15.033645 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eee2ece9-63d9-44c6-99dc-db7b9c084227 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:15.034098 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eee2ece9-63d9-44c6-99dc-db7b9c084227 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:15.034876 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eee2ece9-63d9-44c6-99dc-db7b9c084227 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:15.035316 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eee2ece9-63d9-44c6-99dc-db7b9c084227 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:15.159542 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e14fdb01-2a74-4256-88f9-5cbab42edc6d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:15.160256 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e14fdb01-2a74-4256-88f9-5cbab42edc6d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:15.166801 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e14fdb01-2a74-4256-88f9-5cbab42edc6d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:15.167248 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e14fdb01-2a74-4256-88f9-5cbab42edc6d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:15.168094 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e14fdb01-2a74-4256-88f9-5cbab42edc6d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:15.168498 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e14fdb01-2a74-4256-88f9-5cbab42edc6d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:15.310640 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e14fdb01-2a74-4256-88f9-5cbab42edc6d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:15.319206 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e14fdb01-2a74-4256-88f9-5cbab42edc6d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.164557 Mar 03 02:55:15.319801 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1413/2582] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:15 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:15.337829 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-eee2ece9-63d9-44c6-99dc-db7b9c084227 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:15.345831 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-eee2ece9-63d9-44c6-99dc-db7b9c084227 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.323663 Mar 03 02:55:15.346391 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1170/2583] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:15 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:15.754192 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f0cb04bd-aa77-4952-8418-945ef8e10773 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:15.754822 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f0cb04bd-aa77-4952-8418-945ef8e10773 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:15.760180 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3079ebc5-52ec-4821-85d3-1b53ce82f7df tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:15.760746 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f0cb04bd-aa77-4952-8418-945ef8e10773 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:15.760919 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3079ebc5-52ec-4821-85d3-1b53ce82f7df tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:15.761189 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f0cb04bd-aa77-4952-8418-945ef8e10773 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:15.761992 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f0cb04bd-aa77-4952-8418-945ef8e10773 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:15.762425 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f0cb04bd-aa77-4952-8418-945ef8e10773 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:15.766979 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3079ebc5-52ec-4821-85d3-1b53ce82f7df tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:15.767439 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3079ebc5-52ec-4821-85d3-1b53ce82f7df tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:15.768254 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3079ebc5-52ec-4821-85d3-1b53ce82f7df tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:15.769268 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3079ebc5-52ec-4821-85d3-1b53ce82f7df tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:15.822609 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f0cb04bd-aa77-4952-8418-945ef8e10773 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:15.830394 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f0cb04bd-aa77-4952-8418-945ef8e10773 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080101 Mar 03 02:55:15.830975 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1414/2584] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:15 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:15.902153 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3079ebc5-52ec-4821-85d3-1b53ce82f7df tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:15.909853 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3079ebc5-52ec-4821-85d3-1b53ce82f7df tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.153472 Mar 03 02:55:15.910400 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1171/2585] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:15 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:16.336351 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-54c8308d-3835-41d6-9701-e6dc56624a68 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:16.336962 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-54c8308d-3835-41d6-9701-e6dc56624a68 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:16.344006 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-54c8308d-3835-41d6-9701-e6dc56624a68 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:16.344460 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-54c8308d-3835-41d6-9701-e6dc56624a68 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:16.345300 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-54c8308d-3835-41d6-9701-e6dc56624a68 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:16.345743 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-54c8308d-3835-41d6-9701-e6dc56624a68 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:16.362595 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8664389f-818b-42cf-b954-d3b236b4cb4c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:16.363214 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8664389f-818b-42cf-b954-d3b236b4cb4c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:16.369218 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8664389f-818b-42cf-b954-d3b236b4cb4c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:16.369681 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8664389f-818b-42cf-b954-d3b236b4cb4c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:16.370476 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8664389f-818b-42cf-b954-d3b236b4cb4c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:16.370926 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8664389f-818b-42cf-b954-d3b236b4cb4c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:16.484205 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-54c8308d-3835-41d6-9701-e6dc56624a68 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:16.492227 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-54c8308d-3835-41d6-9701-e6dc56624a68 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.159696 Mar 03 02:55:16.492917 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1415/2586] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:16 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:16.510547 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8664389f-818b-42cf-b954-d3b236b4cb4c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:16.519069 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8664389f-818b-42cf-b954-d3b236b4cb4c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.160361 Mar 03 02:55:16.519646 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1172/2587] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:16 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:16.847100 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f5f1eb52-1e49-46bb-880f-92af6211a13a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:16.847747 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f5f1eb52-1e49-46bb-880f-92af6211a13a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:16.853614 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f5f1eb52-1e49-46bb-880f-92af6211a13a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:16.854063 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f5f1eb52-1e49-46bb-880f-92af6211a13a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:16.854825 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f5f1eb52-1e49-46bb-880f-92af6211a13a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:16.855259 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f5f1eb52-1e49-46bb-880f-92af6211a13a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:16.913285 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f5f1eb52-1e49-46bb-880f-92af6211a13a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:16.920846 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f5f1eb52-1e49-46bb-880f-92af6211a13a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.077672 Mar 03 02:55:16.921400 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1416/2588] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:16 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:16.926393 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0b5a0b31-9bd4-4ec9-a352-5be9bd7ccd00 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:16.927001 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0b5a0b31-9bd4-4ec9-a352-5be9bd7ccd00 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:16.933078 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0b5a0b31-9bd4-4ec9-a352-5be9bd7ccd00 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:16.933521 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0b5a0b31-9bd4-4ec9-a352-5be9bd7ccd00 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:16.934291 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0b5a0b31-9bd4-4ec9-a352-5be9bd7ccd00 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:16.934724 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0b5a0b31-9bd4-4ec9-a352-5be9bd7ccd00 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:17.067816 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0b5a0b31-9bd4-4ec9-a352-5be9bd7ccd00 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:17.075482 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0b5a0b31-9bd4-4ec9-a352-5be9bd7ccd00 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.152908 Mar 03 02:55:17.076052 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1173/2589] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:16 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:17.509496 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d4ed2a2a-0cf1-4847-bea4-345c8d1e52a6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:17.510104 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d4ed2a2a-0cf1-4847-bea4-345c8d1e52a6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:17.516520 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d4ed2a2a-0cf1-4847-bea4-345c8d1e52a6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:17.516960 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d4ed2a2a-0cf1-4847-bea4-345c8d1e52a6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:17.517722 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d4ed2a2a-0cf1-4847-bea4-345c8d1e52a6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:17.518152 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d4ed2a2a-0cf1-4847-bea4-345c8d1e52a6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:17.536585 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2f93466c-9a2f-44eb-8709-9804888e0ddc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:17.537231 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2f93466c-9a2f-44eb-8709-9804888e0ddc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:17.542931 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f93466c-9a2f-44eb-8709-9804888e0ddc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:17.543394 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f93466c-9a2f-44eb-8709-9804888e0ddc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:17.544211 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f93466c-9a2f-44eb-8709-9804888e0ddc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:17.544661 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f93466c-9a2f-44eb-8709-9804888e0ddc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:17.653276 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d4ed2a2a-0cf1-4847-bea4-345c8d1e52a6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:17.661617 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d4ed2a2a-0cf1-4847-bea4-345c8d1e52a6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.155908 Mar 03 02:55:17.662281 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1417/2590] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:17 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:17.680127 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2f93466c-9a2f-44eb-8709-9804888e0ddc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:17.687893 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2f93466c-9a2f-44eb-8709-9804888e0ddc tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.155045 Mar 03 02:55:17.688457 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1174/2591] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:17 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:17.937385 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1729293f-6f91-44a7-8f83-daa6a61eef8c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:17.937992 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1729293f-6f91-44a7-8f83-daa6a61eef8c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:17.943888 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1729293f-6f91-44a7-8f83-daa6a61eef8c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:17.944395 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1729293f-6f91-44a7-8f83-daa6a61eef8c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:17.945247 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1729293f-6f91-44a7-8f83-daa6a61eef8c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:17.945685 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1729293f-6f91-44a7-8f83-daa6a61eef8c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:18.005089 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1729293f-6f91-44a7-8f83-daa6a61eef8c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:18.012834 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1729293f-6f91-44a7-8f83-daa6a61eef8c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079526 Mar 03 02:55:18.013395 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1418/2592] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:17 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:18.093854 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e0370571-55e1-4b50-b63c-de0435519774 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:18.094460 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e0370571-55e1-4b50-b63c-de0435519774 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:18.100647 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e0370571-55e1-4b50-b63c-de0435519774 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:18.101096 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e0370571-55e1-4b50-b63c-de0435519774 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:18.101864 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e0370571-55e1-4b50-b63c-de0435519774 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:18.102299 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e0370571-55e1-4b50-b63c-de0435519774 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:18.236487 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e0370571-55e1-4b50-b63c-de0435519774 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:18.244231 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e0370571-55e1-4b50-b63c-de0435519774 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.154901 Mar 03 02:55:18.244794 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1175/2593] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:18 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:18.679254 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ee2f52e9-1bb8-4d63-9490-5c3f2dbfac3d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:18.679916 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ee2f52e9-1bb8-4d63-9490-5c3f2dbfac3d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:18.686060 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ee2f52e9-1bb8-4d63-9490-5c3f2dbfac3d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:18.687368 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ee2f52e9-1bb8-4d63-9490-5c3f2dbfac3d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:18.688183 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ee2f52e9-1bb8-4d63-9490-5c3f2dbfac3d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:18.688618 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ee2f52e9-1bb8-4d63-9490-5c3f2dbfac3d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:18.705489 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-93773957-a553-4915-9b6e-78e37a654baa tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:18.706144 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-93773957-a553-4915-9b6e-78e37a654baa tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:18.711908 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-93773957-a553-4915-9b6e-78e37a654baa tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:18.712372 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-93773957-a553-4915-9b6e-78e37a654baa tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:18.713149 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-93773957-a553-4915-9b6e-78e37a654baa tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:18.713587 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-93773957-a553-4915-9b6e-78e37a654baa tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:18.832312 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ee2f52e9-1bb8-4d63-9490-5c3f2dbfac3d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:18.840111 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ee2f52e9-1bb8-4d63-9490-5c3f2dbfac3d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.164683 Mar 03 02:55:18.840688 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1419/2594] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:18 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:18.861082 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-93773957-a553-4915-9b6e-78e37a654baa tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:18.869153 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-93773957-a553-4915-9b6e-78e37a654baa tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.167929 Mar 03 02:55:18.869715 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1176/2595] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:18 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:19.030353 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1f0a7b48-6c98-4870-908d-5e0018013741 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:19.030971 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1f0a7b48-6c98-4870-908d-5e0018013741 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:19.036854 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1f0a7b48-6c98-4870-908d-5e0018013741 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:19.037302 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1f0a7b48-6c98-4870-908d-5e0018013741 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:19.038066 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1f0a7b48-6c98-4870-908d-5e0018013741 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:19.038498 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1f0a7b48-6c98-4870-908d-5e0018013741 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:19.100583 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1f0a7b48-6c98-4870-908d-5e0018013741 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:19.109141 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1f0a7b48-6c98-4870-908d-5e0018013741 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.083148 Mar 03 02:55:19.109715 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1420/2596] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:19 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:19.261611 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8c3babc2-af05-4515-92fe-105a589fb880 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:19.262221 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8c3babc2-af05-4515-92fe-105a589fb880 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:19.268436 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8c3babc2-af05-4515-92fe-105a589fb880 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:19.268881 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8c3babc2-af05-4515-92fe-105a589fb880 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:19.269646 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8c3babc2-af05-4515-92fe-105a589fb880 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:19.270079 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8c3babc2-af05-4515-92fe-105a589fb880 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:19.402774 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8c3babc2-af05-4515-92fe-105a589fb880 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:19.411437 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8c3babc2-af05-4515-92fe-105a589fb880 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.153676 Mar 03 02:55:19.412037 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1177/2597] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:19 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:19.857578 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-745c26b4-4e42-4fbf-be60-40b1ee011fa4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:19.858549 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-745c26b4-4e42-4fbf-be60-40b1ee011fa4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:19.864558 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-745c26b4-4e42-4fbf-be60-40b1ee011fa4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:19.865010 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-745c26b4-4e42-4fbf-be60-40b1ee011fa4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:19.865787 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-745c26b4-4e42-4fbf-be60-40b1ee011fa4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:19.866227 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-745c26b4-4e42-4fbf-be60-40b1ee011fa4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:19.886217 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3af9ae73-7a80-41fb-aa1f-9f052954ccae tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:19.886825 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3af9ae73-7a80-41fb-aa1f-9f052954ccae tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:19.893167 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3af9ae73-7a80-41fb-aa1f-9f052954ccae tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:19.893617 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3af9ae73-7a80-41fb-aa1f-9f052954ccae tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:19.894385 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3af9ae73-7a80-41fb-aa1f-9f052954ccae tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:19.894818 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3af9ae73-7a80-41fb-aa1f-9f052954ccae tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:20.000812 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-745c26b4-4e42-4fbf-be60-40b1ee011fa4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:20.008671 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-745c26b4-4e42-4fbf-be60-40b1ee011fa4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.155256 Mar 03 02:55:20.009243 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1421/2598] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:19 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:20.029178 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3af9ae73-7a80-41fb-aa1f-9f052954ccae tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:20.036898 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3af9ae73-7a80-41fb-aa1f-9f052954ccae tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.154513 Mar 03 02:55:20.037460 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1178/2599] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:19 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:20.125977 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-895416e6-fda4-422d-94fc-8b6455c47f04 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:20.126523 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-895416e6-fda4-422d-94fc-8b6455c47f04 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:20.132412 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-895416e6-fda4-422d-94fc-8b6455c47f04 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:20.132867 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-895416e6-fda4-422d-94fc-8b6455c47f04 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:20.133642 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-895416e6-fda4-422d-94fc-8b6455c47f04 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:20.134078 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-895416e6-fda4-422d-94fc-8b6455c47f04 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:20.191951 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-895416e6-fda4-422d-94fc-8b6455c47f04 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:20.199526 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-895416e6-fda4-422d-94fc-8b6455c47f04 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.077993 Mar 03 02:55:20.200132 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1422/2600] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:20 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:20.428543 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-849f3d07-93fa-4619-8e16-572efcedc848 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:20.429067 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-849f3d07-93fa-4619-8e16-572efcedc848 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:20.435416 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-849f3d07-93fa-4619-8e16-572efcedc848 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:20.435904 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-849f3d07-93fa-4619-8e16-572efcedc848 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:20.437592 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-849f3d07-93fa-4619-8e16-572efcedc848 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:20.438029 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-849f3d07-93fa-4619-8e16-572efcedc848 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:20.567807 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-849f3d07-93fa-4619-8e16-572efcedc848 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:20.575414 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-849f3d07-93fa-4619-8e16-572efcedc848 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.150895 Mar 03 02:55:20.575995 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1179/2601] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:20 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:21.026186 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8c00eca3-c958-40e8-b84e-f2bc36bfd69e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:21.026799 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8c00eca3-c958-40e8-b84e-f2bc36bfd69e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:21.033709 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8c00eca3-c958-40e8-b84e-f2bc36bfd69e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:21.034224 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8c00eca3-c958-40e8-b84e-f2bc36bfd69e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:21.035015 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8c00eca3-c958-40e8-b84e-f2bc36bfd69e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:21.035457 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8c00eca3-c958-40e8-b84e-f2bc36bfd69e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:21.054249 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2f53163e-9e9d-40e6-9a16-03a337148e8b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:21.054863 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2f53163e-9e9d-40e6-9a16-03a337148e8b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:21.060537 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f53163e-9e9d-40e6-9a16-03a337148e8b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:21.060995 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f53163e-9e9d-40e6-9a16-03a337148e8b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:21.061777 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f53163e-9e9d-40e6-9a16-03a337148e8b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:21.062217 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f53163e-9e9d-40e6-9a16-03a337148e8b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:21.172345 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8c00eca3-c958-40e8-b84e-f2bc36bfd69e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:21.180448 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8c00eca3-c958-40e8-b84e-f2bc36bfd69e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.158037 Mar 03 02:55:21.181043 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1423/2602] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:21 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:21.216258 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-552755cf-1fa4-40d7-a174-27c8db65f762 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:21.216865 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-552755cf-1fa4-40d7-a174-27c8db65f762 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:21.223185 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-552755cf-1fa4-40d7-a174-27c8db65f762 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:21.223780 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-552755cf-1fa4-40d7-a174-27c8db65f762 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:21.224583 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-552755cf-1fa4-40d7-a174-27c8db65f762 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:21.225025 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-552755cf-1fa4-40d7-a174-27c8db65f762 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:21.289236 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-552755cf-1fa4-40d7-a174-27c8db65f762 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:21.298212 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-552755cf-1fa4-40d7-a174-27c8db65f762 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.085746 Mar 03 02:55:21.298792 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1424/2603] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:21 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:21.416547 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2f53163e-9e9d-40e6-9a16-03a337148e8b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:21.424208 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2f53163e-9e9d-40e6-9a16-03a337148e8b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.373772 Mar 03 02:55:21.424771 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1180/2604] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:21 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:21.592283 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d049948c-03c3-40fa-803a-a3f276726f48 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:21.593707 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d049948c-03c3-40fa-803a-a3f276726f48 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:21.599492 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d049948c-03c3-40fa-803a-a3f276726f48 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:21.599973 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d049948c-03c3-40fa-803a-a3f276726f48 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:21.600738 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d049948c-03c3-40fa-803a-a3f276726f48 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:21.601170 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d049948c-03c3-40fa-803a-a3f276726f48 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:21.730001 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d049948c-03c3-40fa-803a-a3f276726f48 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:21.738031 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d049948c-03c3-40fa-803a-a3f276726f48 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.149639 Mar 03 02:55:21.738591 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1425/2605] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:21 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:22.198854 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0ac0e781-13d7-4915-9d17-b455418bedca tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:22.199403 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0ac0e781-13d7-4915-9d17-b455418bedca tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:22.206404 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0ac0e781-13d7-4915-9d17-b455418bedca tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:22.206854 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0ac0e781-13d7-4915-9d17-b455418bedca tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:22.207643 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0ac0e781-13d7-4915-9d17-b455418bedca tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:22.208081 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0ac0e781-13d7-4915-9d17-b455418bedca tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:22.314850 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0b457404-6a7d-4a12-9fda-0fead57f6c3c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:22.315466 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0b457404-6a7d-4a12-9fda-0fead57f6c3c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:22.321582 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0b457404-6a7d-4a12-9fda-0fead57f6c3c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:22.322033 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0b457404-6a7d-4a12-9fda-0fead57f6c3c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:22.322846 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0b457404-6a7d-4a12-9fda-0fead57f6c3c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:22.323283 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0b457404-6a7d-4a12-9fda-0fead57f6c3c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:22.337231 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0ac0e781-13d7-4915-9d17-b455418bedca tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:22.345143 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0ac0e781-13d7-4915-9d17-b455418bedca tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.150140 Mar 03 02:55:22.345702 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1181/2606] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:22 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:22.386256 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0b457404-6a7d-4a12-9fda-0fead57f6c3c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:22.394162 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0b457404-6a7d-4a12-9fda-0fead57f6c3c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.083804 Mar 03 02:55:22.394718 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1426/2607] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:22 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:22.442054 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2a61a126-9fa8-4c6c-a50a-5613e81aa02e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:22.442714 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2a61a126-9fa8-4c6c-a50a-5613e81aa02e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:22.448589 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2a61a126-9fa8-4c6c-a50a-5613e81aa02e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:22.449087 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2a61a126-9fa8-4c6c-a50a-5613e81aa02e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:22.449803 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2a61a126-9fa8-4c6c-a50a-5613e81aa02e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:22.450252 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2a61a126-9fa8-4c6c-a50a-5613e81aa02e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:22.584954 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2a61a126-9fa8-4c6c-a50a-5613e81aa02e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:22.593235 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2a61a126-9fa8-4c6c-a50a-5613e81aa02e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.154782 Mar 03 02:55:22.593799 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1182/2608] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:22 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:22.756039 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-20f12a25-7657-4bbb-a668-8c615faca628 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:22.756609 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-20f12a25-7657-4bbb-a668-8c615faca628 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:22.762566 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-20f12a25-7657-4bbb-a668-8c615faca628 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:22.763019 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-20f12a25-7657-4bbb-a668-8c615faca628 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:22.763843 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-20f12a25-7657-4bbb-a668-8c615faca628 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:22.765037 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-20f12a25-7657-4bbb-a668-8c615faca628 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:22.893448 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-20f12a25-7657-4bbb-a668-8c615faca628 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:22.901562 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-20f12a25-7657-4bbb-a668-8c615faca628 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.149508 Mar 03 02:55:22.902168 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1427/2609] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:22 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:23.362958 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-de62b604-2e33-49cc-ad0f-f3cd33395fbb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:23.363579 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-de62b604-2e33-49cc-ad0f-f3cd33395fbb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:23.369740 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-de62b604-2e33-49cc-ad0f-f3cd33395fbb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:23.370182 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-de62b604-2e33-49cc-ad0f-f3cd33395fbb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:23.370950 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-de62b604-2e33-49cc-ad0f-f3cd33395fbb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:23.371385 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-de62b604-2e33-49cc-ad0f-f3cd33395fbb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:23.410311 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f396949f-b788-4003-ac52-30bf0b332f6a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:23.410896 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f396949f-b788-4003-ac52-30bf0b332f6a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:23.416815 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f396949f-b788-4003-ac52-30bf0b332f6a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:23.417261 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f396949f-b788-4003-ac52-30bf0b332f6a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:23.418036 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f396949f-b788-4003-ac52-30bf0b332f6a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:23.418465 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f396949f-b788-4003-ac52-30bf0b332f6a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:23.479168 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f396949f-b788-4003-ac52-30bf0b332f6a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:23.488409 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f396949f-b788-4003-ac52-30bf0b332f6a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.081780 Mar 03 02:55:23.488981 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1428/2610] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:23 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:23.505616 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-de62b604-2e33-49cc-ad0f-f3cd33395fbb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:23.513248 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-de62b604-2e33-49cc-ad0f-f3cd33395fbb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.154143 Mar 03 02:55:23.513798 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1183/2611] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:23 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:23.611346 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7ad92476-399c-40d7-8f17-ba2df6477a02 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:23.612082 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7ad92476-399c-40d7-8f17-ba2df6477a02 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:23.618002 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7ad92476-399c-40d7-8f17-ba2df6477a02 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:23.618391 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7ad92476-399c-40d7-8f17-ba2df6477a02 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:23.619158 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7ad92476-399c-40d7-8f17-ba2df6477a02 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:23.619589 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7ad92476-399c-40d7-8f17-ba2df6477a02 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:23.759187 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-7ad92476-399c-40d7-8f17-ba2df6477a02 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:23.767095 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7ad92476-399c-40d7-8f17-ba2df6477a02 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.160892 Mar 03 02:55:23.767683 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1429/2612] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:23 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:23.919166 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ac563814-0362-4c8b-bbbe-937b220458bb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:23.919726 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ac563814-0362-4c8b-bbbe-937b220458bb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:23.925597 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ac563814-0362-4c8b-bbbe-937b220458bb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:23.926042 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ac563814-0362-4c8b-bbbe-937b220458bb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:23.926832 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ac563814-0362-4c8b-bbbe-937b220458bb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:23.927264 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ac563814-0362-4c8b-bbbe-937b220458bb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:24.059050 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ac563814-0362-4c8b-bbbe-937b220458bb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:24.067986 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ac563814-0362-4c8b-bbbe-937b220458bb tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.152699 Mar 03 02:55:24.068555 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1184/2613] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:23 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:24.504840 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0bd82158-c9b9-41c5-9843-cd88d9469f9b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:24.505470 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0bd82158-c9b9-41c5-9843-cd88d9469f9b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:24.511772 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0bd82158-c9b9-41c5-9843-cd88d9469f9b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:24.512228 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0bd82158-c9b9-41c5-9843-cd88d9469f9b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:24.513002 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0bd82158-c9b9-41c5-9843-cd88d9469f9b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:24.513442 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0bd82158-c9b9-41c5-9843-cd88d9469f9b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:24.530625 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-09940188-d887-4990-92a6-0019e817ed3a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:24.531333 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-09940188-d887-4990-92a6-0019e817ed3a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:24.537487 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-09940188-d887-4990-92a6-0019e817ed3a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:24.537959 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-09940188-d887-4990-92a6-0019e817ed3a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:24.538733 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-09940188-d887-4990-92a6-0019e817ed3a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:24.539165 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-09940188-d887-4990-92a6-0019e817ed3a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:24.572902 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0bd82158-c9b9-41c5-9843-cd88d9469f9b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:24.583235 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0bd82158-c9b9-41c5-9843-cd88d9469f9b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.082168 Mar 03 02:55:24.583867 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1430/2614] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:24 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:24.673390 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-09940188-d887-4990-92a6-0019e817ed3a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:24.681054 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-09940188-d887-4990-92a6-0019e817ed3a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.154825 Mar 03 02:55:24.681615 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1185/2615] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:24 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:24.784837 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-49f0a1db-fa85-4253-830e-50eb104fbeea tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:24.785367 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-49f0a1db-fa85-4253-830e-50eb104fbeea tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:24.791155 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-49f0a1db-fa85-4253-830e-50eb104fbeea tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:24.791627 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-49f0a1db-fa85-4253-830e-50eb104fbeea tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:24.792412 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-49f0a1db-fa85-4253-830e-50eb104fbeea tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:24.792848 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-49f0a1db-fa85-4253-830e-50eb104fbeea tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:24.920019 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-49f0a1db-fa85-4253-830e-50eb104fbeea tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:24.927714 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-49f0a1db-fa85-4253-830e-50eb104fbeea tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.146775 Mar 03 02:55:24.928279 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1431/2616] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:24 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:25.085067 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d0be270a-2efe-4c80-b621-78bf8b145b97 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:25.085683 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d0be270a-2efe-4c80-b621-78bf8b145b97 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:25.091566 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d0be270a-2efe-4c80-b621-78bf8b145b97 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:25.092065 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d0be270a-2efe-4c80-b621-78bf8b145b97 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:25.092851 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d0be270a-2efe-4c80-b621-78bf8b145b97 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:25.093295 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d0be270a-2efe-4c80-b621-78bf8b145b97 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:25.221970 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d0be270a-2efe-4c80-b621-78bf8b145b97 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:25.229666 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d0be270a-2efe-4c80-b621-78bf8b145b97 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.148492 Mar 03 02:55:25.230235 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1186/2617] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:25 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:25.599693 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ba9ff2b6-52b2-475a-b865-7da9826d8209 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:25.600337 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ba9ff2b6-52b2-475a-b865-7da9826d8209 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:25.606783 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ba9ff2b6-52b2-475a-b865-7da9826d8209 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:25.607230 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ba9ff2b6-52b2-475a-b865-7da9826d8209 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:25.608696 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ba9ff2b6-52b2-475a-b865-7da9826d8209 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:25.609140 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ba9ff2b6-52b2-475a-b865-7da9826d8209 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:25.667935 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ba9ff2b6-52b2-475a-b865-7da9826d8209 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:25.675623 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ba9ff2b6-52b2-475a-b865-7da9826d8209 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079779 Mar 03 02:55:25.676183 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1432/2618] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:25 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:25.698105 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8510fcf5-8974-467c-8c2f-72b876b46e40 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:25.698721 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8510fcf5-8974-467c-8c2f-72b876b46e40 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:25.705724 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8510fcf5-8974-467c-8c2f-72b876b46e40 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:25.706175 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8510fcf5-8974-467c-8c2f-72b876b46e40 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:25.706954 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8510fcf5-8974-467c-8c2f-72b876b46e40 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:25.707393 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8510fcf5-8974-467c-8c2f-72b876b46e40 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:25.839962 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8510fcf5-8974-467c-8c2f-72b876b46e40 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:25.849169 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8510fcf5-8974-467c-8c2f-72b876b46e40 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.154732 Mar 03 02:55:25.850042 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1187/2619] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:25 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:25.944490 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-fbbd635a-69ca-4a5d-bf29-0f672be27e79 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:25.945093 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-fbbd635a-69ca-4a5d-bf29-0f672be27e79 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:25.950841 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fbbd635a-69ca-4a5d-bf29-0f672be27e79 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:25.951286 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fbbd635a-69ca-4a5d-bf29-0f672be27e79 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:25.953045 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fbbd635a-69ca-4a5d-bf29-0f672be27e79 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:25.953484 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fbbd635a-69ca-4a5d-bf29-0f672be27e79 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:26.086216 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-fbbd635a-69ca-4a5d-bf29-0f672be27e79 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:26.093956 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-fbbd635a-69ca-4a5d-bf29-0f672be27e79 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.153320 Mar 03 02:55:26.094506 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1433/2620] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:25 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:26.246904 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0468548d-77ae-4952-af4d-7897e73b59c4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:26.247450 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0468548d-77ae-4952-af4d-7897e73b59c4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:26.254263 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0468548d-77ae-4952-af4d-7897e73b59c4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:26.254715 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0468548d-77ae-4952-af4d-7897e73b59c4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:26.255494 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0468548d-77ae-4952-af4d-7897e73b59c4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:26.255961 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0468548d-77ae-4952-af4d-7897e73b59c4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:26.385216 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0468548d-77ae-4952-af4d-7897e73b59c4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:26.393414 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0468548d-77ae-4952-af4d-7897e73b59c4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.150434 Mar 03 02:55:26.393975 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1188/2621] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:26 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:26.693167 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d83af547-7cdb-46c3-83a1-d5b9fb948bc4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:26.694300 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d83af547-7cdb-46c3-83a1-d5b9fb948bc4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:26.702195 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d83af547-7cdb-46c3-83a1-d5b9fb948bc4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:26.702659 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d83af547-7cdb-46c3-83a1-d5b9fb948bc4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:26.703436 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d83af547-7cdb-46c3-83a1-d5b9fb948bc4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:26.703892 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d83af547-7cdb-46c3-83a1-d5b9fb948bc4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:26.762529 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d83af547-7cdb-46c3-83a1-d5b9fb948bc4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:26.770525 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d83af547-7cdb-46c3-83a1-d5b9fb948bc4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.081897 Mar 03 02:55:26.771088 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1434/2622] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:26 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:26.869379 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-534e6a4c-1588-4b2a-be08-542336f52c5e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:26.869985 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-534e6a4c-1588-4b2a-be08-542336f52c5e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:26.876327 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-534e6a4c-1588-4b2a-be08-542336f52c5e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:26.876774 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-534e6a4c-1588-4b2a-be08-542336f52c5e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:26.877549 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-534e6a4c-1588-4b2a-be08-542336f52c5e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:26.877982 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-534e6a4c-1588-4b2a-be08-542336f52c5e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:27.022244 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-534e6a4c-1588-4b2a-be08-542336f52c5e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:27.030913 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-534e6a4c-1588-4b2a-be08-542336f52c5e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.164640 Mar 03 02:55:27.031480 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1189/2623] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:26 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:27.111060 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-58277b68-8bca-4a80-9fb9-5454e1371cfb tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:27.111691 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-58277b68-8bca-4a80-9fb9-5454e1371cfb tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:27.117784 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-58277b68-8bca-4a80-9fb9-5454e1371cfb tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:27.118232 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-58277b68-8bca-4a80-9fb9-5454e1371cfb tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:27.119261 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-58277b68-8bca-4a80-9fb9-5454e1371cfb tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:27.119725 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-58277b68-8bca-4a80-9fb9-5454e1371cfb tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:27.258097 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-58277b68-8bca-4a80-9fb9-5454e1371cfb tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:27.266535 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-58277b68-8bca-4a80-9fb9-5454e1371cfb tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.159743 Mar 03 02:55:27.267113 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1435/2624] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:27 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:27.410367 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1788baa7-01f1-46b6-bb64-69c5ea1006d5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:27.410965 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1788baa7-01f1-46b6-bb64-69c5ea1006d5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:27.417510 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1788baa7-01f1-46b6-bb64-69c5ea1006d5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:27.417924 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1788baa7-01f1-46b6-bb64-69c5ea1006d5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:27.418705 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1788baa7-01f1-46b6-bb64-69c5ea1006d5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:27.419142 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1788baa7-01f1-46b6-bb64-69c5ea1006d5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:27.552715 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1788baa7-01f1-46b6-bb64-69c5ea1006d5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:27.560799 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1788baa7-01f1-46b6-bb64-69c5ea1006d5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.154428 Mar 03 02:55:27.562023 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1190/2625] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:27 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:27.786429 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-522f0bfa-56df-41e3-940d-87d4648127c9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:27.787032 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-522f0bfa-56df-41e3-940d-87d4648127c9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:27.793303 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-522f0bfa-56df-41e3-940d-87d4648127c9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:27.793750 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-522f0bfa-56df-41e3-940d-87d4648127c9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:27.794524 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-522f0bfa-56df-41e3-940d-87d4648127c9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:27.794954 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-522f0bfa-56df-41e3-940d-87d4648127c9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:27.855158 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-522f0bfa-56df-41e3-940d-87d4648127c9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:27.863741 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-522f0bfa-56df-41e3-940d-87d4648127c9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.081178 Mar 03 02:55:27.864300 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1436/2626] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:27 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:28.048589 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-37aff613-7cf2-4d00-a60f-b7b8868b87c5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:28.049194 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-37aff613-7cf2-4d00-a60f-b7b8868b87c5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:28.055475 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-37aff613-7cf2-4d00-a60f-b7b8868b87c5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:28.055960 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-37aff613-7cf2-4d00-a60f-b7b8868b87c5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:28.056756 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-37aff613-7cf2-4d00-a60f-b7b8868b87c5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:28.057176 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-37aff613-7cf2-4d00-a60f-b7b8868b87c5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:28.187434 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-37aff613-7cf2-4d00-a60f-b7b8868b87c5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:28.195009 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-37aff613-7cf2-4d00-a60f-b7b8868b87c5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.151141 Mar 03 02:55:28.195567 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1191/2627] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:28 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:28.283871 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0ef3f0db-5713-420d-a608-bedcd0da5561 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:28.284477 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0ef3f0db-5713-420d-a608-bedcd0da5561 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:28.290156 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0ef3f0db-5713-420d-a608-bedcd0da5561 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:28.290588 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0ef3f0db-5713-420d-a608-bedcd0da5561 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:28.291348 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0ef3f0db-5713-420d-a608-bedcd0da5561 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:28.291811 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0ef3f0db-5713-420d-a608-bedcd0da5561 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:28.419001 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0ef3f0db-5713-420d-a608-bedcd0da5561 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:28.427069 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0ef3f0db-5713-420d-a608-bedcd0da5561 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.147491 Mar 03 02:55:28.427650 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1437/2628] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:28 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:28.578401 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d7be18cd-e884-4eb1-806a-b8c5907e1117 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:28.579009 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d7be18cd-e884-4eb1-806a-b8c5907e1117 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:28.584868 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d7be18cd-e884-4eb1-806a-b8c5907e1117 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:28.585321 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d7be18cd-e884-4eb1-806a-b8c5907e1117 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:28.586098 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d7be18cd-e884-4eb1-806a-b8c5907e1117 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:28.586536 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d7be18cd-e884-4eb1-806a-b8c5907e1117 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:28.724840 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d7be18cd-e884-4eb1-806a-b8c5907e1117 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:28.732722 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d7be18cd-e884-4eb1-806a-b8c5907e1117 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.158409 Mar 03 02:55:28.734154 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1192/2629] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:28 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:28.880128 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1b5fffbd-c029-4134-bf90-b693c36792a8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:28.880739 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1b5fffbd-c029-4134-bf90-b693c36792a8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:28.886908 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1b5fffbd-c029-4134-bf90-b693c36792a8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:28.887363 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1b5fffbd-c029-4134-bf90-b693c36792a8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:28.888168 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1b5fffbd-c029-4134-bf90-b693c36792a8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:28.888604 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1b5fffbd-c029-4134-bf90-b693c36792a8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:28.947798 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1b5fffbd-c029-4134-bf90-b693c36792a8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:28.958825 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1b5fffbd-c029-4134-bf90-b693c36792a8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.082173 Mar 03 02:55:28.959678 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1438/2630] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:28 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:29.212782 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1d857288-f6fa-467e-9668-0e6ed4391532 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:29.213327 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1d857288-f6fa-467e-9668-0e6ed4391532 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:29.220379 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1d857288-f6fa-467e-9668-0e6ed4391532 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:29.220830 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1d857288-f6fa-467e-9668-0e6ed4391532 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:29.221613 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1d857288-f6fa-467e-9668-0e6ed4391532 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:29.222049 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1d857288-f6fa-467e-9668-0e6ed4391532 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:29.354348 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1d857288-f6fa-467e-9668-0e6ed4391532 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:29.362226 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1d857288-f6fa-467e-9668-0e6ed4391532 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.153389 Mar 03 02:55:29.362782 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1193/2631] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:29 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:29.444573 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-763718a7-1686-4bb6-9141-5121a835de4e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:29.445184 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-763718a7-1686-4bb6-9141-5121a835de4e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:29.450947 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-763718a7-1686-4bb6-9141-5121a835de4e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:29.451399 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-763718a7-1686-4bb6-9141-5121a835de4e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:29.452754 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-763718a7-1686-4bb6-9141-5121a835de4e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:29.453191 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-763718a7-1686-4bb6-9141-5121a835de4e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:29.587188 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-763718a7-1686-4bb6-9141-5121a835de4e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:29.595157 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-763718a7-1686-4bb6-9141-5121a835de4e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.154510 Mar 03 02:55:29.595746 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1439/2632] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:29 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:29.751316 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2428ace5-5e1b-447c-b2bf-02b7661446ac tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:29.751946 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2428ace5-5e1b-447c-b2bf-02b7661446ac tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:29.757752 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2428ace5-5e1b-447c-b2bf-02b7661446ac tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:29.758196 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2428ace5-5e1b-447c-b2bf-02b7661446ac tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:29.758966 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2428ace5-5e1b-447c-b2bf-02b7661446ac tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:29.759398 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2428ace5-5e1b-447c-b2bf-02b7661446ac tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:29.895036 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2428ace5-5e1b-447c-b2bf-02b7661446ac tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:29.903160 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2428ace5-5e1b-447c-b2bf-02b7661446ac tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.156433 Mar 03 02:55:29.903741 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1194/2633] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:29 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:29.976167 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d3439167-0fe4-49fb-971e-b8f2d59ebc57 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:29.976776 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d3439167-0fe4-49fb-971e-b8f2d59ebc57 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:29.984289 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d3439167-0fe4-49fb-971e-b8f2d59ebc57 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:29.984744 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d3439167-0fe4-49fb-971e-b8f2d59ebc57 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:29.985521 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d3439167-0fe4-49fb-971e-b8f2d59ebc57 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:29.985961 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d3439167-0fe4-49fb-971e-b8f2d59ebc57 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:30.044937 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d3439167-0fe4-49fb-971e-b8f2d59ebc57 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:30.053188 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d3439167-0fe4-49fb-971e-b8f2d59ebc57 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080800 Mar 03 02:55:30.053736 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1440/2634] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:29 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:30.378805 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-866b2037-b1c7-46b3-8fde-92a962b78ad2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:30.379439 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-866b2037-b1c7-46b3-8fde-92a962b78ad2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:30.385609 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-866b2037-b1c7-46b3-8fde-92a962b78ad2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:30.386056 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-866b2037-b1c7-46b3-8fde-92a962b78ad2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:30.386832 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-866b2037-b1c7-46b3-8fde-92a962b78ad2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:30.387268 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-866b2037-b1c7-46b3-8fde-92a962b78ad2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:30.518925 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-866b2037-b1c7-46b3-8fde-92a962b78ad2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:30.526584 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-866b2037-b1c7-46b3-8fde-92a962b78ad2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.151615 Mar 03 02:55:30.527148 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1195/2635] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:30 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:30.611457 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9439af3e-2e8d-491f-8984-41cb6ab21a99 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:30.612088 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9439af3e-2e8d-491f-8984-41cb6ab21a99 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:30.617775 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9439af3e-2e8d-491f-8984-41cb6ab21a99 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:30.618226 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9439af3e-2e8d-491f-8984-41cb6ab21a99 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:30.618991 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9439af3e-2e8d-491f-8984-41cb6ab21a99 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:30.619419 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9439af3e-2e8d-491f-8984-41cb6ab21a99 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:30.750175 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9439af3e-2e8d-491f-8984-41cb6ab21a99 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:30.757890 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9439af3e-2e8d-491f-8984-41cb6ab21a99 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.150286 Mar 03 02:55:30.758458 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1441/2636] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:30 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:30.920241 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2aa39f05-e9d5-473b-b605-1f8de2c41686 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:30.921078 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2aa39f05-e9d5-473b-b605-1f8de2c41686 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:30.926943 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2aa39f05-e9d5-473b-b605-1f8de2c41686 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:30.927391 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2aa39f05-e9d5-473b-b605-1f8de2c41686 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:30.928194 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2aa39f05-e9d5-473b-b605-1f8de2c41686 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:30.928633 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2aa39f05-e9d5-473b-b605-1f8de2c41686 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:31.062983 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2aa39f05-e9d5-473b-b605-1f8de2c41686 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:31.070298 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6107289a-ac05-4ed1-a4c8-1f87a639d82d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:31.070901 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2aa39f05-e9d5-473b-b605-1f8de2c41686 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.154562 Mar 03 02:55:31.071025 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6107289a-ac05-4ed1-a4c8-1f87a639d82d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:31.071648 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1196/2637] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:30 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:31.079504 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6107289a-ac05-4ed1-a4c8-1f87a639d82d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:31.080188 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6107289a-ac05-4ed1-a4c8-1f87a639d82d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:31.081078 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6107289a-ac05-4ed1-a4c8-1f87a639d82d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:31.081609 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6107289a-ac05-4ed1-a4c8-1f87a639d82d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:31.144048 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6107289a-ac05-4ed1-a4c8-1f87a639d82d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:31.151718 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6107289a-ac05-4ed1-a4c8-1f87a639d82d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.085359 Mar 03 02:55:31.152289 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1442/2638] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:31 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:31.544115 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-931f8ea0-4a46-47d6-8b4c-1ac304dfda82 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:31.544721 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-931f8ea0-4a46-47d6-8b4c-1ac304dfda82 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:31.551567 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-931f8ea0-4a46-47d6-8b4c-1ac304dfda82 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:31.551999 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-931f8ea0-4a46-47d6-8b4c-1ac304dfda82 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:31.552775 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-931f8ea0-4a46-47d6-8b4c-1ac304dfda82 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:31.553214 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-931f8ea0-4a46-47d6-8b4c-1ac304dfda82 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:31.681442 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-931f8ea0-4a46-47d6-8b4c-1ac304dfda82 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:31.689474 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-931f8ea0-4a46-47d6-8b4c-1ac304dfda82 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.149280 Mar 03 02:55:31.690040 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1197/2639] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:31 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:31.775409 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-36b0275d-8f6d-4512-94b5-d4ef1f8f2963 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:31.776035 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-36b0275d-8f6d-4512-94b5-d4ef1f8f2963 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:31.782711 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-36b0275d-8f6d-4512-94b5-d4ef1f8f2963 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:31.783161 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-36b0275d-8f6d-4512-94b5-d4ef1f8f2963 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:31.783959 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-36b0275d-8f6d-4512-94b5-d4ef1f8f2963 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:31.784397 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-36b0275d-8f6d-4512-94b5-d4ef1f8f2963 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:31.919944 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-36b0275d-8f6d-4512-94b5-d4ef1f8f2963 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:31.928293 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-36b0275d-8f6d-4512-94b5-d4ef1f8f2963 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.156527 Mar 03 02:55:31.929574 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1443/2640] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:31 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:32.089093 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c92304a5-0302-45f6-9225-c5194b1767af tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:32.089700 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c92304a5-0302-45f6-9225-c5194b1767af tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:32.096203 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c92304a5-0302-45f6-9225-c5194b1767af tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:32.096651 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c92304a5-0302-45f6-9225-c5194b1767af tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:32.097419 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c92304a5-0302-45f6-9225-c5194b1767af tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:32.097853 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c92304a5-0302-45f6-9225-c5194b1767af tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:32.168771 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7049a862-46c3-4d0b-b16b-420788f00c10 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:32.169338 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7049a862-46c3-4d0b-b16b-420788f00c10 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:32.175821 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7049a862-46c3-4d0b-b16b-420788f00c10 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:32.176274 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7049a862-46c3-4d0b-b16b-420788f00c10 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:32.177060 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7049a862-46c3-4d0b-b16b-420788f00c10 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:32.177646 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7049a862-46c3-4d0b-b16b-420788f00c10 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:32.227628 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c92304a5-0302-45f6-9225-c5194b1767af tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:32.235913 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c92304a5-0302-45f6-9225-c5194b1767af tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.150626 Mar 03 02:55:32.236882 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1198/2641] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:32 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:32.238988 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-7049a862-46c3-4d0b-b16b-420788f00c10 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:32.246765 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7049a862-46c3-4d0b-b16b-420788f00c10 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.081935 Mar 03 02:55:32.247313 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1444/2642] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:32 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:32.706727 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-05788817-4502-4433-9e1d-15acc891c4c7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:32.707318 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-05788817-4502-4433-9e1d-15acc891c4c7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:32.713940 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-05788817-4502-4433-9e1d-15acc891c4c7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:32.714396 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-05788817-4502-4433-9e1d-15acc891c4c7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:32.715176 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-05788817-4502-4433-9e1d-15acc891c4c7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:32.715636 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-05788817-4502-4433-9e1d-15acc891c4c7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:32.851761 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-05788817-4502-4433-9e1d-15acc891c4c7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:32.860381 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-05788817-4502-4433-9e1d-15acc891c4c7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.157540 Mar 03 02:55:32.860965 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1199/2643] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:32 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:32.945579 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b0b318e0-17ef-4e88-acdf-8c25c496e00e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:32.946187 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b0b318e0-17ef-4e88-acdf-8c25c496e00e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:32.952695 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b0b318e0-17ef-4e88-acdf-8c25c496e00e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:32.953142 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b0b318e0-17ef-4e88-acdf-8c25c496e00e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:32.953924 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b0b318e0-17ef-4e88-acdf-8c25c496e00e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:32.954363 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b0b318e0-17ef-4e88-acdf-8c25c496e00e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:33.254101 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3c621740-e3bc-4fa7-8fd8-b4c43d960bb5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:33.254712 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3c621740-e3bc-4fa7-8fd8-b4c43d960bb5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:33.260692 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3c621740-e3bc-4fa7-8fd8-b4c43d960bb5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:33.261150 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3c621740-e3bc-4fa7-8fd8-b4c43d960bb5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:33.261939 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3c621740-e3bc-4fa7-8fd8-b4c43d960bb5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:33.262383 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3c621740-e3bc-4fa7-8fd8-b4c43d960bb5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:33.329834 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b0b318e0-17ef-4e88-acdf-8c25c496e00e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:33.337471 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b0b318e0-17ef-4e88-acdf-8c25c496e00e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.395682 Mar 03 02:55:33.338041 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1445/2644] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:32 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:33.343059 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-75e3363f-aee4-4eeb-8179-adbac5e15b75 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:33.343422 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-75e3363f-aee4-4eeb-8179-adbac5e15b75 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:33.349395 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-75e3363f-aee4-4eeb-8179-adbac5e15b75 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:33.349855 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-75e3363f-aee4-4eeb-8179-adbac5e15b75 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:33.350667 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-75e3363f-aee4-4eeb-8179-adbac5e15b75 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:33.351103 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-75e3363f-aee4-4eeb-8179-adbac5e15b75 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:33.397751 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3c621740-e3bc-4fa7-8fd8-b4c43d960bb5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:33.405817 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3c621740-e3bc-4fa7-8fd8-b4c43d960bb5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.155659 Mar 03 02:55:33.406470 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1200/2645] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:33 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:33.409917 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-75e3363f-aee4-4eeb-8179-adbac5e15b75 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:33.417471 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-75e3363f-aee4-4eeb-8179-adbac5e15b75 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.078511 Mar 03 02:55:33.418020 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1446/2646] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:33 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:33.878105 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-bace5050-28b0-4cbd-be99-d28f75c3f64c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:33.878667 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-bace5050-28b0-4cbd-be99-d28f75c3f64c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:33.884840 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bace5050-28b0-4cbd-be99-d28f75c3f64c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:33.885294 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bace5050-28b0-4cbd-be99-d28f75c3f64c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:33.886070 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bace5050-28b0-4cbd-be99-d28f75c3f64c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:33.886509 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bace5050-28b0-4cbd-be99-d28f75c3f64c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:34.024511 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-bace5050-28b0-4cbd-be99-d28f75c3f64c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:34.032654 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-bace5050-28b0-4cbd-be99-d28f75c3f64c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.159244 Mar 03 02:55:34.033211 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1201/2647] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:33 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:34.354791 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b1f66f5d-847a-4751-ba99-85aa4f45f75a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:34.355413 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b1f66f5d-847a-4751-ba99-85aa4f45f75a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:34.362770 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b1f66f5d-847a-4751-ba99-85aa4f45f75a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:34.363224 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b1f66f5d-847a-4751-ba99-85aa4f45f75a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:34.364034 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b1f66f5d-847a-4751-ba99-85aa4f45f75a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:34.364504 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b1f66f5d-847a-4751-ba99-85aa4f45f75a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:34.423197 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-40b3f80a-85b5-47cf-a1aa-c51bdc1a5968 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:34.423833 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-40b3f80a-85b5-47cf-a1aa-c51bdc1a5968 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:34.429531 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-40b3f80a-85b5-47cf-a1aa-c51bdc1a5968 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:34.429985 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-40b3f80a-85b5-47cf-a1aa-c51bdc1a5968 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:34.430763 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-40b3f80a-85b5-47cf-a1aa-c51bdc1a5968 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:34.431195 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-40b3f80a-85b5-47cf-a1aa-c51bdc1a5968 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:34.496162 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b1f66f5d-847a-4751-ba99-85aa4f45f75a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:34.504924 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b1f66f5d-847a-4751-ba99-85aa4f45f75a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.153972 Mar 03 02:55:34.505502 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1447/2648] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:34 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:34.510031 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-65533370-7da6-4d45-be1f-a0706e3187fa tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:34.510636 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-65533370-7da6-4d45-be1f-a0706e3187fa tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:34.517165 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-65533370-7da6-4d45-be1f-a0706e3187fa tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:34.517616 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-65533370-7da6-4d45-be1f-a0706e3187fa tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:34.518396 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-65533370-7da6-4d45-be1f-a0706e3187fa tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:34.518831 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-65533370-7da6-4d45-be1f-a0706e3187fa tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:34.565545 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-40b3f80a-85b5-47cf-a1aa-c51bdc1a5968 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:34.573323 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-40b3f80a-85b5-47cf-a1aa-c51bdc1a5968 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.154492 Mar 03 02:55:34.573891 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1202/2649] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:34 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:34.580894 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-65533370-7da6-4d45-be1f-a0706e3187fa tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:34.588626 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-65533370-7da6-4d45-be1f-a0706e3187fa tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.082190 Mar 03 02:55:34.589180 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1448/2650] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:34 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:35.050295 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-de5bc250-55ef-46b1-b361-42848aee30c4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:35.050907 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-de5bc250-55ef-46b1-b361-42848aee30c4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:35.057253 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-de5bc250-55ef-46b1-b361-42848aee30c4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:35.057705 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-de5bc250-55ef-46b1-b361-42848aee30c4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:35.058513 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-de5bc250-55ef-46b1-b361-42848aee30c4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:35.058951 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-de5bc250-55ef-46b1-b361-42848aee30c4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:35.188220 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-de5bc250-55ef-46b1-b361-42848aee30c4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:35.196567 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-de5bc250-55ef-46b1-b361-42848aee30c4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.149833 Mar 03 02:55:35.197379 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1203/2651] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:35 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:35.522227 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e5c9b5eb-a6f1-4432-a446-3fa77299581b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:35.522816 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e5c9b5eb-a6f1-4432-a446-3fa77299581b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:35.528573 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e5c9b5eb-a6f1-4432-a446-3fa77299581b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:35.529021 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e5c9b5eb-a6f1-4432-a446-3fa77299581b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:35.530418 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e5c9b5eb-a6f1-4432-a446-3fa77299581b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:35.530861 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e5c9b5eb-a6f1-4432-a446-3fa77299581b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:35.590251 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1634c87f-d7c4-4f54-bbab-52d215085dae tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:35.590864 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1634c87f-d7c4-4f54-bbab-52d215085dae tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:35.597140 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1634c87f-d7c4-4f54-bbab-52d215085dae tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:35.597597 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1634c87f-d7c4-4f54-bbab-52d215085dae tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:35.598381 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1634c87f-d7c4-4f54-bbab-52d215085dae tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:35.598829 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1634c87f-d7c4-4f54-bbab-52d215085dae tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:35.661752 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e5c9b5eb-a6f1-4432-a446-3fa77299581b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:35.669362 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e5c9b5eb-a6f1-4432-a446-3fa77299581b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.151181 Mar 03 02:55:35.669927 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1449/2652] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:35 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:35.675102 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-18cf6e12-cd09-42aa-9fde-c68e8fcabf0b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:35.675954 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-18cf6e12-cd09-42aa-9fde-c68e8fcabf0b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:35.681442 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-18cf6e12-cd09-42aa-9fde-c68e8fcabf0b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:35.682101 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-18cf6e12-cd09-42aa-9fde-c68e8fcabf0b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:35.682876 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-18cf6e12-cd09-42aa-9fde-c68e8fcabf0b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:35.683313 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-18cf6e12-cd09-42aa-9fde-c68e8fcabf0b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:35.733770 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1634c87f-d7c4-4f54-bbab-52d215085dae tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:35.741663 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1634c87f-d7c4-4f54-bbab-52d215085dae tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.155252 Mar 03 02:55:35.742324 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1204/2653] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:35 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:35.742707 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-18cf6e12-cd09-42aa-9fde-c68e8fcabf0b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:35.750636 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-18cf6e12-cd09-42aa-9fde-c68e8fcabf0b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.078964 Mar 03 02:55:35.751198 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1450/2654] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:35 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:36.213618 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-95b72107-8329-453a-bc66-bb1afda2890b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:36.214159 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-95b72107-8329-453a-bc66-bb1afda2890b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:36.220608 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-95b72107-8329-453a-bc66-bb1afda2890b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:36.221064 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-95b72107-8329-453a-bc66-bb1afda2890b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:36.222190 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-95b72107-8329-453a-bc66-bb1afda2890b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:36.222637 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-95b72107-8329-453a-bc66-bb1afda2890b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:36.352484 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-95b72107-8329-453a-bc66-bb1afda2890b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:36.360436 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-95b72107-8329-453a-bc66-bb1afda2890b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.150765 Mar 03 02:55:36.361024 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1205/2655] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:36 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:36.687671 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-04049c46-bd9b-4be5-a751-f5d3d1240712 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:36.688285 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-04049c46-bd9b-4be5-a751-f5d3d1240712 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:36.694637 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-04049c46-bd9b-4be5-a751-f5d3d1240712 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:36.695093 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-04049c46-bd9b-4be5-a751-f5d3d1240712 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:36.695918 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-04049c46-bd9b-4be5-a751-f5d3d1240712 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:36.696357 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-04049c46-bd9b-4be5-a751-f5d3d1240712 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:36.758233 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-bc2f66ae-f753-4f98-90e3-350ae7e60e1b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:36.758845 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-bc2f66ae-f753-4f98-90e3-350ae7e60e1b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:36.765368 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bc2f66ae-f753-4f98-90e3-350ae7e60e1b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:36.765817 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bc2f66ae-f753-4f98-90e3-350ae7e60e1b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:36.766601 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bc2f66ae-f753-4f98-90e3-350ae7e60e1b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:36.767040 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bc2f66ae-f753-4f98-90e3-350ae7e60e1b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:36.832796 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-04049c46-bd9b-4be5-a751-f5d3d1240712 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:36.840508 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-04049c46-bd9b-4be5-a751-f5d3d1240712 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.157079 Mar 03 02:55:36.841079 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1451/2656] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:36 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:36.847050 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7772d738-9b61-4dd3-a074-e164a5106253 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:36.847671 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7772d738-9b61-4dd3-a074-e164a5106253 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:36.853266 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7772d738-9b61-4dd3-a074-e164a5106253 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:36.853870 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7772d738-9b61-4dd3-a074-e164a5106253 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:36.854646 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7772d738-9b61-4dd3-a074-e164a5106253 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:36.855080 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7772d738-9b61-4dd3-a074-e164a5106253 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:36.901365 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-bc2f66ae-f753-4f98-90e3-350ae7e60e1b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:36.911361 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-bc2f66ae-f753-4f98-90e3-350ae7e60e1b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.156893 Mar 03 02:55:36.912306 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1206/2657] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:36 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:36.914638 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-7772d738-9b61-4dd3-a074-e164a5106253 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:36.922570 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7772d738-9b61-4dd3-a074-e164a5106253 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080557 Mar 03 02:55:36.923127 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1452/2658] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:36 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:37.377386 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4624628f-0d6c-485b-8b64-4f6bb74d3f3c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:37.377967 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4624628f-0d6c-485b-8b64-4f6bb74d3f3c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:37.384173 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4624628f-0d6c-485b-8b64-4f6bb74d3f3c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:37.384621 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4624628f-0d6c-485b-8b64-4f6bb74d3f3c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:37.385386 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4624628f-0d6c-485b-8b64-4f6bb74d3f3c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:37.385819 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4624628f-0d6c-485b-8b64-4f6bb74d3f3c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:37.515353 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4624628f-0d6c-485b-8b64-4f6bb74d3f3c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:37.523065 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4624628f-0d6c-485b-8b64-4f6bb74d3f3c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.150271 Mar 03 02:55:37.523647 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1207/2659] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:37 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:37.858945 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-63034163-44d0-4133-9c15-0a474a0fb3f1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:37.859547 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-63034163-44d0-4133-9c15-0a474a0fb3f1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:37.865775 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-63034163-44d0-4133-9c15-0a474a0fb3f1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:37.866220 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-63034163-44d0-4133-9c15-0a474a0fb3f1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:37.866984 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-63034163-44d0-4133-9c15-0a474a0fb3f1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:37.867417 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-63034163-44d0-4133-9c15-0a474a0fb3f1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:37.928594 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3c38b294-ff58-4ef1-a144-e2c134e345e3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:37.929200 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3c38b294-ff58-4ef1-a144-e2c134e345e3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:37.935154 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3c38b294-ff58-4ef1-a144-e2c134e345e3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:37.935679 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3c38b294-ff58-4ef1-a144-e2c134e345e3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:37.936471 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3c38b294-ff58-4ef1-a144-e2c134e345e3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:37.936902 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3c38b294-ff58-4ef1-a144-e2c134e345e3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:38.000545 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-63034163-44d0-4133-9c15-0a474a0fb3f1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:38.008600 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-63034163-44d0-4133-9c15-0a474a0fb3f1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.154461 Mar 03 02:55:38.009178 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1453/2660] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:37 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:38.013736 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3521d8fb-ee5f-41dc-ad78-5d860c2118e1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:38.014382 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3521d8fb-ee5f-41dc-ad78-5d860c2118e1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:38.019977 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3521d8fb-ee5f-41dc-ad78-5d860c2118e1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:38.020422 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3521d8fb-ee5f-41dc-ad78-5d860c2118e1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:38.021229 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3521d8fb-ee5f-41dc-ad78-5d860c2118e1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:38.021612 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3521d8fb-ee5f-41dc-ad78-5d860c2118e1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:38.075097 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3c38b294-ff58-4ef1-a144-e2c134e345e3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:38.082530 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-3521d8fb-ee5f-41dc-ad78-5d860c2118e1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:38.083704 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3c38b294-ff58-4ef1-a144-e2c134e345e3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.158930 Mar 03 02:55:38.084465 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1208/2661] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:37 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:38.090700 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3521d8fb-ee5f-41dc-ad78-5d860c2118e1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080581 Mar 03 02:55:38.091256 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1454/2662] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:38 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:38.540172 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5e67224a-d32a-4977-bd31-b48aa2facf1c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:38.540798 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5e67224a-d32a-4977-bd31-b48aa2facf1c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:38.548033 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5e67224a-d32a-4977-bd31-b48aa2facf1c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:38.548488 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5e67224a-d32a-4977-bd31-b48aa2facf1c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:38.549262 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5e67224a-d32a-4977-bd31-b48aa2facf1c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:38.549695 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5e67224a-d32a-4977-bd31-b48aa2facf1c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:38.682990 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5e67224a-d32a-4977-bd31-b48aa2facf1c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:38.690972 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5e67224a-d32a-4977-bd31-b48aa2facf1c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.154635 Mar 03 02:55:38.691547 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1209/2663] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:38 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:39.026334 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f6b15b84-6556-434f-8234-d62907399276 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:39.026972 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f6b15b84-6556-434f-8234-d62907399276 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:39.034123 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f6b15b84-6556-434f-8234-d62907399276 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:39.034571 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f6b15b84-6556-434f-8234-d62907399276 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:39.035344 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f6b15b84-6556-434f-8234-d62907399276 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:39.035813 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f6b15b84-6556-434f-8234-d62907399276 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:39.101446 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5d6c98f4-cc9a-46e1-b480-6b3d4602b6d0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:39.102151 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5d6c98f4-cc9a-46e1-b480-6b3d4602b6d0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:39.108482 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5d6c98f4-cc9a-46e1-b480-6b3d4602b6d0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:39.108937 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5d6c98f4-cc9a-46e1-b480-6b3d4602b6d0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:39.109762 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5d6c98f4-cc9a-46e1-b480-6b3d4602b6d0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:39.110200 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5d6c98f4-cc9a-46e1-b480-6b3d4602b6d0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:39.173066 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f6b15b84-6556-434f-8234-d62907399276 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:39.180944 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f6b15b84-6556-434f-8234-d62907399276 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.158491 Mar 03 02:55:39.191746 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1455/2664] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:39 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:39.191746 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5c0e0d14-4e94-4b94-be29-85ea19c73cdd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:39.191746 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5c0e0d14-4e94-4b94-be29-85ea19c73cdd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:39.193089 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5c0e0d14-4e94-4b94-be29-85ea19c73cdd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:39.193544 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5c0e0d14-4e94-4b94-be29-85ea19c73cdd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:39.194333 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5c0e0d14-4e94-4b94-be29-85ea19c73cdd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:39.194772 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5c0e0d14-4e94-4b94-be29-85ea19c73cdd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:39.242666 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5d6c98f4-cc9a-46e1-b480-6b3d4602b6d0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:39.250986 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5d6c98f4-cc9a-46e1-b480-6b3d4602b6d0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.153449 Mar 03 02:55:39.251551 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1210/2665] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:39 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:39.254692 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5c0e0d14-4e94-4b94-be29-85ea19c73cdd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:39.262475 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5c0e0d14-4e94-4b94-be29-85ea19c73cdd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079986 Mar 03 02:55:39.263030 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1456/2666] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:39 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:39.707950 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ed34cf2c-ada1-4e4c-bcbf-49878068a6f3 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:39.708560 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ed34cf2c-ada1-4e4c-bcbf-49878068a6f3 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:39.714815 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ed34cf2c-ada1-4e4c-bcbf-49878068a6f3 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:39.715269 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ed34cf2c-ada1-4e4c-bcbf-49878068a6f3 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:39.716068 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ed34cf2c-ada1-4e4c-bcbf-49878068a6f3 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:39.716508 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ed34cf2c-ada1-4e4c-bcbf-49878068a6f3 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:39.851514 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ed34cf2c-ada1-4e4c-bcbf-49878068a6f3 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:39.860238 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ed34cf2c-ada1-4e4c-bcbf-49878068a6f3 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.156134 Mar 03 02:55:39.860805 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1211/2667] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:39 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:40.198821 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-814b67da-0992-4644-aa6e-e961095a04ce tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:40.199423 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-814b67da-0992-4644-aa6e-e961095a04ce tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:40.205955 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-814b67da-0992-4644-aa6e-e961095a04ce tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:40.206408 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-814b67da-0992-4644-aa6e-e961095a04ce tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:40.207215 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-814b67da-0992-4644-aa6e-e961095a04ce tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:40.207680 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-814b67da-0992-4644-aa6e-e961095a04ce tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:40.268213 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ec9f0cd6-7db2-4b5a-ab0b-ab247e09d610 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:40.268852 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ec9f0cd6-7db2-4b5a-ab0b-ab247e09d610 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:40.274619 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ec9f0cd6-7db2-4b5a-ab0b-ab247e09d610 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:40.275075 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ec9f0cd6-7db2-4b5a-ab0b-ab247e09d610 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:40.275891 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ec9f0cd6-7db2-4b5a-ab0b-ab247e09d610 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:40.276334 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ec9f0cd6-7db2-4b5a-ab0b-ab247e09d610 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:40.343149 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-814b67da-0992-4644-aa6e-e961095a04ce tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:40.350992 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-814b67da-0992-4644-aa6e-e961095a04ce tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.155974 Mar 03 02:55:40.351596 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1457/2668] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:40 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:40.356269 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-39a59ab3-f4cf-4166-a869-7e59f76c70f7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:40.356864 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-39a59ab3-f4cf-4166-a869-7e59f76c70f7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:40.362505 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-39a59ab3-f4cf-4166-a869-7e59f76c70f7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:40.362986 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-39a59ab3-f4cf-4166-a869-7e59f76c70f7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:40.363786 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-39a59ab3-f4cf-4166-a869-7e59f76c70f7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:40.364514 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-39a59ab3-f4cf-4166-a869-7e59f76c70f7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:40.411082 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ec9f0cd6-7db2-4b5a-ab0b-ab247e09d610 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:40.420480 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ec9f0cd6-7db2-4b5a-ab0b-ab247e09d610 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.156366 Mar 03 02:55:40.421341 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1212/2669] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:40 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:40.423415 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-39a59ab3-f4cf-4166-a869-7e59f76c70f7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:40.431115 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-39a59ab3-f4cf-4166-a869-7e59f76c70f7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.078521 Mar 03 02:55:40.431677 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1458/2670] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:40 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:40.877699 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5b34564a-e2f9-42bf-8e40-1ff14c726056 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:40.878314 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5b34564a-e2f9-42bf-8e40-1ff14c726056 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:40.884511 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5b34564a-e2f9-42bf-8e40-1ff14c726056 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:40.884958 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5b34564a-e2f9-42bf-8e40-1ff14c726056 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:40.885725 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5b34564a-e2f9-42bf-8e40-1ff14c726056 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:40.886160 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5b34564a-e2f9-42bf-8e40-1ff14c726056 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:41.023259 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5b34564a-e2f9-42bf-8e40-1ff14c726056 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:41.031463 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5b34564a-e2f9-42bf-8e40-1ff14c726056 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.158273 Mar 03 02:55:41.032341 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1213/2671] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:40 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:41.368553 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-92cfdb27-6ce1-43ca-ac8b-0ff24f4fcf0f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:41.369160 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-92cfdb27-6ce1-43ca-ac8b-0ff24f4fcf0f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:41.375342 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-92cfdb27-6ce1-43ca-ac8b-0ff24f4fcf0f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:41.375828 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-92cfdb27-6ce1-43ca-ac8b-0ff24f4fcf0f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:41.376595 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-92cfdb27-6ce1-43ca-ac8b-0ff24f4fcf0f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:41.377024 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-92cfdb27-6ce1-43ca-ac8b-0ff24f4fcf0f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:41.438523 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e63d9581-c6e3-43a0-8844-f3e1b735c8db tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:41.439135 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e63d9581-c6e3-43a0-8844-f3e1b735c8db tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:41.444889 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e63d9581-c6e3-43a0-8844-f3e1b735c8db tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:41.445345 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e63d9581-c6e3-43a0-8844-f3e1b735c8db tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:41.446127 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e63d9581-c6e3-43a0-8844-f3e1b735c8db tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:41.446593 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e63d9581-c6e3-43a0-8844-f3e1b735c8db tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:41.510501 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-92cfdb27-6ce1-43ca-ac8b-0ff24f4fcf0f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:41.519764 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-92cfdb27-6ce1-43ca-ac8b-0ff24f4fcf0f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.155066 Mar 03 02:55:41.520350 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1459/2672] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:41 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:41.524949 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-76f34581-1e0f-49ef-98c5-5e4f0c00b760 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:41.525551 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-76f34581-1e0f-49ef-98c5-5e4f0c00b760 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:41.531863 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-76f34581-1e0f-49ef-98c5-5e4f0c00b760 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:41.532321 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-76f34581-1e0f-49ef-98c5-5e4f0c00b760 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:41.533107 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-76f34581-1e0f-49ef-98c5-5e4f0c00b760 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:41.533551 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-76f34581-1e0f-49ef-98c5-5e4f0c00b760 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:41.578792 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e63d9581-c6e3-43a0-8844-f3e1b735c8db tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:41.586574 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e63d9581-c6e3-43a0-8844-f3e1b735c8db tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.152620 Mar 03 02:55:41.587141 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1214/2673] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:41 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:41.593930 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-76f34581-1e0f-49ef-98c5-5e4f0c00b760 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:41.601640 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-76f34581-1e0f-49ef-98c5-5e4f0c00b760 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080328 Mar 03 02:55:41.602198 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1460/2674] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:41 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:42.049125 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3da94090-7b0d-4119-908d-9343347a2bb9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:42.049764 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3da94090-7b0d-4119-908d-9343347a2bb9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:42.056012 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3da94090-7b0d-4119-908d-9343347a2bb9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:42.056458 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3da94090-7b0d-4119-908d-9343347a2bb9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:42.057231 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3da94090-7b0d-4119-908d-9343347a2bb9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:42.057665 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3da94090-7b0d-4119-908d-9343347a2bb9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:42.189158 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3da94090-7b0d-4119-908d-9343347a2bb9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:42.196843 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3da94090-7b0d-4119-908d-9343347a2bb9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.152153 Mar 03 02:55:42.197412 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1215/2675] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:42 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:42.536928 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ead2dce1-21f7-4b41-828f-08d8dad2319c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:42.537539 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ead2dce1-21f7-4b41-828f-08d8dad2319c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:42.543838 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ead2dce1-21f7-4b41-828f-08d8dad2319c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:42.544290 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ead2dce1-21f7-4b41-828f-08d8dad2319c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:42.545686 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ead2dce1-21f7-4b41-828f-08d8dad2319c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:42.546661 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ead2dce1-21f7-4b41-828f-08d8dad2319c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:42.603712 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-984c1726-7756-4c32-9870-9c4ef9267b36 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:42.604317 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-984c1726-7756-4c32-9870-9c4ef9267b36 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:42.610713 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-984c1726-7756-4c32-9870-9c4ef9267b36 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:42.611163 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-984c1726-7756-4c32-9870-9c4ef9267b36 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:42.612077 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-984c1726-7756-4c32-9870-9c4ef9267b36 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:42.612514 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-984c1726-7756-4c32-9870-9c4ef9267b36 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:42.681009 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ead2dce1-21f7-4b41-828f-08d8dad2319c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:42.689085 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ead2dce1-21f7-4b41-828f-08d8dad2319c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.156048 Mar 03 02:55:42.689665 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1461/2676] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:42 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:42.694190 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3fa678fa-62bb-46f6-8c57-01e731e84e2a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:42.694795 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3fa678fa-62bb-46f6-8c57-01e731e84e2a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:42.702559 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3fa678fa-62bb-46f6-8c57-01e731e84e2a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:42.703052 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3fa678fa-62bb-46f6-8c57-01e731e84e2a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:42.703888 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3fa678fa-62bb-46f6-8c57-01e731e84e2a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:42.704326 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3fa678fa-62bb-46f6-8c57-01e731e84e2a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:42.751008 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-984c1726-7756-4c32-9870-9c4ef9267b36 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:42.758799 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-984c1726-7756-4c32-9870-9c4ef9267b36 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.158957 Mar 03 02:55:42.759365 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1216/2677] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:42 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:42.765141 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-3fa678fa-62bb-46f6-8c57-01e731e84e2a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:42.772813 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3fa678fa-62bb-46f6-8c57-01e731e84e2a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.082214 Mar 03 02:55:42.773597 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1462/2678] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:42 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:42.997003 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 02:55:42.997247 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: Thu Mar 3 02:55:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 03 02:55:43.213630 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c6e587bb-afd7-4662-b057-0dd283e98a10 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:43.214249 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c6e587bb-afd7-4662-b057-0dd283e98a10 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:43.220623 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c6e587bb-afd7-4662-b057-0dd283e98a10 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:43.221083 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c6e587bb-afd7-4662-b057-0dd283e98a10 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:43.221866 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c6e587bb-afd7-4662-b057-0dd283e98a10 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:43.222311 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c6e587bb-afd7-4662-b057-0dd283e98a10 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:43.354136 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c6e587bb-afd7-4662-b057-0dd283e98a10 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:43.362759 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c6e587bb-afd7-4662-b057-0dd283e98a10 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.152905 Mar 03 02:55:43.363369 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1217/2679] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:43 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:43.706212 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-de9762ec-493c-4d25-ad4c-372b71e4b4ea tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:43.706801 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-de9762ec-493c-4d25-ad4c-372b71e4b4ea tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:43.713917 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-de9762ec-493c-4d25-ad4c-372b71e4b4ea tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:43.714363 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-de9762ec-493c-4d25-ad4c-372b71e4b4ea tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:43.715559 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-de9762ec-493c-4d25-ad4c-372b71e4b4ea tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:43.716216 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-de9762ec-493c-4d25-ad4c-372b71e4b4ea tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:43.776272 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1ff97914-0555-442e-838d-db50ea975f20 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:43.776881 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1ff97914-0555-442e-838d-db50ea975f20 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:43.783043 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1ff97914-0555-442e-838d-db50ea975f20 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:43.783490 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1ff97914-0555-442e-838d-db50ea975f20 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:43.784453 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1ff97914-0555-442e-838d-db50ea975f20 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:43.784759 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1ff97914-0555-442e-838d-db50ea975f20 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:43.849596 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-de9762ec-493c-4d25-ad4c-372b71e4b4ea tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:43.858499 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-de9762ec-493c-4d25-ad4c-372b71e4b4ea tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.155349 Mar 03 02:55:43.859282 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1463/2680] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:43 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:43.863921 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b395d04d-5569-42c7-a183-6dc7ba80bf5c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:43.864531 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b395d04d-5569-42c7-a183-6dc7ba80bf5c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:43.870470 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b395d04d-5569-42c7-a183-6dc7ba80bf5c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:43.871087 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b395d04d-5569-42c7-a183-6dc7ba80bf5c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:43.872004 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b395d04d-5569-42c7-a183-6dc7ba80bf5c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:43.872440 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b395d04d-5569-42c7-a183-6dc7ba80bf5c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:43.934147 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1ff97914-0555-442e-838d-db50ea975f20 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:43.940758 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b395d04d-5569-42c7-a183-6dc7ba80bf5c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:43.942749 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1ff97914-0555-442e-838d-db50ea975f20 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.170483 Mar 03 02:55:43.943327 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1218/2681] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:43 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:43.948653 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b395d04d-5569-42c7-a183-6dc7ba80bf5c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.088404 Mar 03 02:55:43.949201 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1464/2682] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:43 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:44.379871 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2f5f533a-6411-465f-9b11-0bab81c79909 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:44.380466 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2f5f533a-6411-465f-9b11-0bab81c79909 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:44.386630 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f5f533a-6411-465f-9b11-0bab81c79909 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:44.387077 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f5f533a-6411-465f-9b11-0bab81c79909 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:44.387868 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f5f533a-6411-465f-9b11-0bab81c79909 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:44.388301 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f5f533a-6411-465f-9b11-0bab81c79909 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:44.518930 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2f5f533a-6411-465f-9b11-0bab81c79909 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:44.526575 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2f5f533a-6411-465f-9b11-0bab81c79909 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.150496 Mar 03 02:55:44.527141 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1219/2683] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:44 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:44.875964 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8e015565-d32e-4002-a00e-748bdb9120fb tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:44.876605 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8e015565-d32e-4002-a00e-748bdb9120fb tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:44.882843 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8e015565-d32e-4002-a00e-748bdb9120fb tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:44.883295 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8e015565-d32e-4002-a00e-748bdb9120fb tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:44.884117 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8e015565-d32e-4002-a00e-748bdb9120fb tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:44.884550 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8e015565-d32e-4002-a00e-748bdb9120fb tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:44.960538 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ecf5af97-0dfa-4ed2-a860-8319ee1127c3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:44.961218 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ecf5af97-0dfa-4ed2-a860-8319ee1127c3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:44.967200 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ecf5af97-0dfa-4ed2-a860-8319ee1127c3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:44.967868 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ecf5af97-0dfa-4ed2-a860-8319ee1127c3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:44.968375 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ecf5af97-0dfa-4ed2-a860-8319ee1127c3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:44.968817 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ecf5af97-0dfa-4ed2-a860-8319ee1127c3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:45.017814 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8e015565-d32e-4002-a00e-748bdb9120fb tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:45.025493 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8e015565-d32e-4002-a00e-748bdb9120fb tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.154089 Mar 03 02:55:45.026057 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1465/2684] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:44 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:45.030675 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7c6da447-9d5d-4206-98be-01ba5728b945 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:45.031275 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7c6da447-9d5d-4206-98be-01ba5728b945 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:45.036807 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c6da447-9d5d-4206-98be-01ba5728b945 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:45.037260 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c6da447-9d5d-4206-98be-01ba5728b945 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:45.038032 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c6da447-9d5d-4206-98be-01ba5728b945 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:45.038464 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c6da447-9d5d-4206-98be-01ba5728b945 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:45.100740 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-7c6da447-9d5d-4206-98be-01ba5728b945 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:45.104582 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ecf5af97-0dfa-4ed2-a860-8319ee1127c3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:45.109327 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7c6da447-9d5d-4206-98be-01ba5728b945 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.082310 Mar 03 02:55:45.109895 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1466/2685] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:45 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:45.113142 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ecf5af97-0dfa-4ed2-a860-8319ee1127c3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.156508 Mar 03 02:55:45.113699 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1220/2686] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:44 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:45.543724 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2cc86e12-edcc-4a4c-8d65-b40b18eb2fa2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:45.544332 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2cc86e12-edcc-4a4c-8d65-b40b18eb2fa2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:45.551300 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2cc86e12-edcc-4a4c-8d65-b40b18eb2fa2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:45.551779 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2cc86e12-edcc-4a4c-8d65-b40b18eb2fa2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:45.552551 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2cc86e12-edcc-4a4c-8d65-b40b18eb2fa2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:45.552983 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2cc86e12-edcc-4a4c-8d65-b40b18eb2fa2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:45.685901 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2cc86e12-edcc-4a4c-8d65-b40b18eb2fa2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:45.693503 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2cc86e12-edcc-4a4c-8d65-b40b18eb2fa2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.153736 Mar 03 02:55:45.694075 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1467/2687] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:45 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:46.042872 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-610c9ebe-a605-4235-83fd-c99a386bec33 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:46.043498 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-610c9ebe-a605-4235-83fd-c99a386bec33 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:46.049931 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-610c9ebe-a605-4235-83fd-c99a386bec33 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:46.050381 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-610c9ebe-a605-4235-83fd-c99a386bec33 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:46.051163 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-610c9ebe-a605-4235-83fd-c99a386bec33 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:46.051592 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-610c9ebe-a605-4235-83fd-c99a386bec33 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:46.126480 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9b52a451-697e-4421-91d9-4606a0a99f25 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:46.127119 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9b52a451-697e-4421-91d9-4606a0a99f25 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:46.133353 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9b52a451-697e-4421-91d9-4606a0a99f25 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:46.133766 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9b52a451-697e-4421-91d9-4606a0a99f25 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:46.134530 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9b52a451-697e-4421-91d9-4606a0a99f25 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:46.134961 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9b52a451-697e-4421-91d9-4606a0a99f25 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:46.184983 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-610c9ebe-a605-4235-83fd-c99a386bec33 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:46.194054 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-610c9ebe-a605-4235-83fd-c99a386bec33 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.155443 Mar 03 02:55:46.194605 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9b52a451-697e-4421-91d9-4606a0a99f25 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:46.194767 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1221/2688] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:46 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:46.199004 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-babbd138-9362-49e9-b154-6d83f5940363 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:46.199860 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-babbd138-9362-49e9-b154-6d83f5940363 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:46.203169 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9b52a451-697e-4421-91d9-4606a0a99f25 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.081130 Mar 03 02:55:46.203922 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1468/2689] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:46 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:46.206829 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-babbd138-9362-49e9-b154-6d83f5940363 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:46.207290 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-babbd138-9362-49e9-b154-6d83f5940363 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:46.208109 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-babbd138-9362-49e9-b154-6d83f5940363 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:46.208539 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-babbd138-9362-49e9-b154-6d83f5940363 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:46.339145 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-babbd138-9362-49e9-b154-6d83f5940363 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:46.347228 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-babbd138-9362-49e9-b154-6d83f5940363 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.151681 Mar 03 02:55:46.347827 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1222/2690] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:46 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:46.710892 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0010c3b8-e2da-4fe0-80d6-3dab9f1c7839 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:46.711499 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0010c3b8-e2da-4fe0-80d6-3dab9f1c7839 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:46.717847 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0010c3b8-e2da-4fe0-80d6-3dab9f1c7839 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:46.718295 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0010c3b8-e2da-4fe0-80d6-3dab9f1c7839 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:46.719069 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0010c3b8-e2da-4fe0-80d6-3dab9f1c7839 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:46.719508 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0010c3b8-e2da-4fe0-80d6-3dab9f1c7839 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:46.848192 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0010c3b8-e2da-4fe0-80d6-3dab9f1c7839 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:46.856192 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0010c3b8-e2da-4fe0-80d6-3dab9f1c7839 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.148917 Mar 03 02:55:46.856751 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1469/2691] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:46 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:47.211933 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c5ed892b-67b0-4c56-9a9f-c5716ed5d02e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:47.212539 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c5ed892b-67b0-4c56-9a9f-c5716ed5d02e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:47.219439 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c5ed892b-67b0-4c56-9a9f-c5716ed5d02e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:47.219923 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c5ed892b-67b0-4c56-9a9f-c5716ed5d02e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:47.220117 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-48715800-d7c6-4bf7-a682-3ca90bfc56be tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:47.220704 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c5ed892b-67b0-4c56-9a9f-c5716ed5d02e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:47.220829 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-48715800-d7c6-4bf7-a682-3ca90bfc56be tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:47.221137 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c5ed892b-67b0-4c56-9a9f-c5716ed5d02e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:47.226851 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-48715800-d7c6-4bf7-a682-3ca90bfc56be tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:47.227298 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-48715800-d7c6-4bf7-a682-3ca90bfc56be tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:47.228113 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-48715800-d7c6-4bf7-a682-3ca90bfc56be tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:47.228551 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-48715800-d7c6-4bf7-a682-3ca90bfc56be tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:47.290838 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-48715800-d7c6-4bf7-a682-3ca90bfc56be tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:47.298737 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-48715800-d7c6-4bf7-a682-3ca90bfc56be tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.083098 Mar 03 02:55:47.299511 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1470/2692] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:47 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:47.358455 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c5ed892b-67b0-4c56-9a9f-c5716ed5d02e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:47.364512 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ec9b8f93-d8c5-4a22-8faf-8b534b2ecd7e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:47.365122 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ec9b8f93-d8c5-4a22-8faf-8b534b2ecd7e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:47.366594 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c5ed892b-67b0-4c56-9a9f-c5716ed5d02e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.158476 Mar 03 02:55:47.367323 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1223/2693] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:47 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:47.371188 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ec9b8f93-d8c5-4a22-8faf-8b534b2ecd7e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:47.371690 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ec9b8f93-d8c5-4a22-8faf-8b534b2ecd7e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:47.372466 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ec9b8f93-d8c5-4a22-8faf-8b534b2ecd7e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:47.372934 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ec9b8f93-d8c5-4a22-8faf-8b534b2ecd7e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:47.504106 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ec9b8f93-d8c5-4a22-8faf-8b534b2ecd7e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:47.511688 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ec9b8f93-d8c5-4a22-8faf-8b534b2ecd7e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.150985 Mar 03 02:55:47.512248 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1471/2694] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:47 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:47.874320 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-05756c7d-582b-4596-b5b3-02b2085889c3 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:47.874936 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-05756c7d-582b-4596-b5b3-02b2085889c3 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:47.880890 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-05756c7d-582b-4596-b5b3-02b2085889c3 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:47.881345 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-05756c7d-582b-4596-b5b3-02b2085889c3 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:47.882130 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-05756c7d-582b-4596-b5b3-02b2085889c3 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:47.882579 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-05756c7d-582b-4596-b5b3-02b2085889c3 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:48.012758 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-05756c7d-582b-4596-b5b3-02b2085889c3 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:48.021105 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-05756c7d-582b-4596-b5b3-02b2085889c3 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.150797 Mar 03 02:55:48.021674 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1224/2695] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:47 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:48.315849 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-091ec3e4-3a81-4266-822a-729f6818eec2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:48.316416 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-091ec3e4-3a81-4266-822a-729f6818eec2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:48.322604 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-091ec3e4-3a81-4266-822a-729f6818eec2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:48.323052 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-091ec3e4-3a81-4266-822a-729f6818eec2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:48.323845 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-091ec3e4-3a81-4266-822a-729f6818eec2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:48.324279 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-091ec3e4-3a81-4266-822a-729f6818eec2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:48.382829 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-091ec3e4-3a81-4266-822a-729f6818eec2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:48.383822 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-61f1d838-0c6f-4e60-8eac-10799f31ce5f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:48.384464 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-61f1d838-0c6f-4e60-8eac-10799f31ce5f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:48.391210 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-61f1d838-0c6f-4e60-8eac-10799f31ce5f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:48.391592 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-091ec3e4-3a81-4266-822a-729f6818eec2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079637 Mar 03 02:55:48.391736 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-61f1d838-0c6f-4e60-8eac-10799f31ce5f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:48.392185 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1472/2696] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:48 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:48.392458 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-61f1d838-0c6f-4e60-8eac-10799f31ce5f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:48.392963 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-61f1d838-0c6f-4e60-8eac-10799f31ce5f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:48.526582 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-61f1d838-0c6f-4e60-8eac-10799f31ce5f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:48.528566 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-177c0f58-e20a-4d91-bb12-a68ff786bcd9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:48.529188 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-177c0f58-e20a-4d91-bb12-a68ff786bcd9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:48.534403 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-61f1d838-0c6f-4e60-8eac-10799f31ce5f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.154463 Mar 03 02:55:48.534752 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-177c0f58-e20a-4d91-bb12-a68ff786bcd9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:48.534964 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1225/2697] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:48 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:48.535198 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-177c0f58-e20a-4d91-bb12-a68ff786bcd9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:48.535997 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-177c0f58-e20a-4d91-bb12-a68ff786bcd9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:48.536424 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-177c0f58-e20a-4d91-bb12-a68ff786bcd9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:48.673994 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-177c0f58-e20a-4d91-bb12-a68ff786bcd9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:48.681624 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-177c0f58-e20a-4d91-bb12-a68ff786bcd9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.156880 Mar 03 02:55:48.682188 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1473/2698] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:48 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:49.038295 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5640169f-8377-44a1-94d2-46540279d190 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:49.038823 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5640169f-8377-44a1-94d2-46540279d190 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:49.044845 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5640169f-8377-44a1-94d2-46540279d190 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:49.045848 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5640169f-8377-44a1-94d2-46540279d190 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:49.046644 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5640169f-8377-44a1-94d2-46540279d190 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:49.047083 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5640169f-8377-44a1-94d2-46540279d190 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:49.178002 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5640169f-8377-44a1-94d2-46540279d190 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:49.185825 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5640169f-8377-44a1-94d2-46540279d190 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.151354 Mar 03 02:55:49.186399 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1226/2699] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:49 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:49.409116 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0a197da3-d16b-493b-b3b8-c15d695f2ed4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:49.409783 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0a197da3-d16b-493b-b3b8-c15d695f2ed4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:49.415879 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0a197da3-d16b-493b-b3b8-c15d695f2ed4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:49.416328 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0a197da3-d16b-493b-b3b8-c15d695f2ed4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:49.417099 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0a197da3-d16b-493b-b3b8-c15d695f2ed4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:49.417535 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0a197da3-d16b-493b-b3b8-c15d695f2ed4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:49.476088 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0a197da3-d16b-493b-b3b8-c15d695f2ed4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:49.483815 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0a197da3-d16b-493b-b3b8-c15d695f2ed4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079550 Mar 03 02:55:49.484378 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1474/2700] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:49 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:49.551897 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3c62434f-05be-44b0-8a8f-8aa16703d340 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:49.552511 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3c62434f-05be-44b0-8a8f-8aa16703d340 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:49.558667 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3c62434f-05be-44b0-8a8f-8aa16703d340 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:49.559120 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3c62434f-05be-44b0-8a8f-8aa16703d340 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:49.559942 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3c62434f-05be-44b0-8a8f-8aa16703d340 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:49.560392 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3c62434f-05be-44b0-8a8f-8aa16703d340 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:49.693830 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3c62434f-05be-44b0-8a8f-8aa16703d340 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:49.699292 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ed1eb1d4-1c4e-40b8-94cf-d230599176cc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:49.699936 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ed1eb1d4-1c4e-40b8-94cf-d230599176cc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:49.702267 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3c62434f-05be-44b0-8a8f-8aa16703d340 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.154261 Mar 03 02:55:49.703199 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1227/2701] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:49 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:49.706204 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ed1eb1d4-1c4e-40b8-94cf-d230599176cc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:49.706651 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ed1eb1d4-1c4e-40b8-94cf-d230599176cc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:49.707422 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ed1eb1d4-1c4e-40b8-94cf-d230599176cc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:49.707897 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ed1eb1d4-1c4e-40b8-94cf-d230599176cc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:49.836830 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ed1eb1d4-1c4e-40b8-94cf-d230599176cc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:49.845054 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ed1eb1d4-1c4e-40b8-94cf-d230599176cc tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.149657 Mar 03 02:55:49.845618 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1475/2702] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:49 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:50.203848 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8fbfb705-1411-4824-82b9-f2b177b353e8 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:50.204460 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8fbfb705-1411-4824-82b9-f2b177b353e8 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:50.210340 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8fbfb705-1411-4824-82b9-f2b177b353e8 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:50.210736 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8fbfb705-1411-4824-82b9-f2b177b353e8 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:50.211509 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8fbfb705-1411-4824-82b9-f2b177b353e8 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:50.211976 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8fbfb705-1411-4824-82b9-f2b177b353e8 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:50.346907 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8fbfb705-1411-4824-82b9-f2b177b353e8 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:50.354499 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8fbfb705-1411-4824-82b9-f2b177b353e8 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.155479 Mar 03 02:55:50.355059 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1228/2703] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:50 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:50.500785 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-77fccfff-cab9-4233-a75a-136cbe3d19bd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:50.501316 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-77fccfff-cab9-4233-a75a-136cbe3d19bd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:50.507445 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-77fccfff-cab9-4233-a75a-136cbe3d19bd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:50.507933 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-77fccfff-cab9-4233-a75a-136cbe3d19bd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:50.508716 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-77fccfff-cab9-4233-a75a-136cbe3d19bd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:50.509153 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-77fccfff-cab9-4233-a75a-136cbe3d19bd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:50.567970 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-77fccfff-cab9-4233-a75a-136cbe3d19bd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:50.575744 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-77fccfff-cab9-4233-a75a-136cbe3d19bd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079268 Mar 03 02:55:50.577037 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1476/2704] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:50 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:50.720328 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d8ce2a61-a4b9-4b78-85f4-3fe6aed223d7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:50.720938 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d8ce2a61-a4b9-4b78-85f4-3fe6aed223d7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:50.727105 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d8ce2a61-a4b9-4b78-85f4-3fe6aed223d7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:50.727559 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d8ce2a61-a4b9-4b78-85f4-3fe6aed223d7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:50.728359 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d8ce2a61-a4b9-4b78-85f4-3fe6aed223d7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:50.728796 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d8ce2a61-a4b9-4b78-85f4-3fe6aed223d7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:50.860744 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d8ce2a61-a4b9-4b78-85f4-3fe6aed223d7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:50.862137 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-05800ddd-f9da-4986-9306-adfe1347e65e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:50.862754 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-05800ddd-f9da-4986-9306-adfe1347e65e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:50.868634 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d8ce2a61-a4b9-4b78-85f4-3fe6aed223d7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.152680 Mar 03 02:55:50.868825 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-05800ddd-f9da-4986-9306-adfe1347e65e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:50.869181 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-05800ddd-f9da-4986-9306-adfe1347e65e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:50.869329 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1229/2705] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:50 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:50.869969 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-05800ddd-f9da-4986-9306-adfe1347e65e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:50.870408 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-05800ddd-f9da-4986-9306-adfe1347e65e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:51.002434 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-05800ddd-f9da-4986-9306-adfe1347e65e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:51.010224 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-05800ddd-f9da-4986-9306-adfe1347e65e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.152034 Mar 03 02:55:51.010791 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1477/2706] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:50 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:51.371535 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ea5c19ed-77fd-49fb-a797-672f6baf34f2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:51.372173 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ea5c19ed-77fd-49fb-a797-672f6baf34f2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:51.378583 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ea5c19ed-77fd-49fb-a797-672f6baf34f2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:51.379043 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ea5c19ed-77fd-49fb-a797-672f6baf34f2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:51.379884 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ea5c19ed-77fd-49fb-a797-672f6baf34f2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:51.380326 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ea5c19ed-77fd-49fb-a797-672f6baf34f2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:51.514231 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ea5c19ed-77fd-49fb-a797-672f6baf34f2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:51.521910 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ea5c19ed-77fd-49fb-a797-672f6baf34f2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.154225 Mar 03 02:55:51.522470 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1230/2707] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:51 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:51.593639 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-05d8a568-4127-4269-8e6a-a943de9e1800 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:51.594270 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-05d8a568-4127-4269-8e6a-a943de9e1800 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:51.600526 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-05d8a568-4127-4269-8e6a-a943de9e1800 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:51.600975 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-05d8a568-4127-4269-8e6a-a943de9e1800 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:51.601742 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-05d8a568-4127-4269-8e6a-a943de9e1800 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:51.602175 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-05d8a568-4127-4269-8e6a-a943de9e1800 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:51.661376 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-05d8a568-4127-4269-8e6a-a943de9e1800 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:51.669032 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-05d8a568-4127-4269-8e6a-a943de9e1800 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079906 Mar 03 02:55:51.669607 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1478/2708] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:51 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:51.885849 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4b66b5d7-3a6a-48a3-be9a-4ab32b047221 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:51.886481 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4b66b5d7-3a6a-48a3-be9a-4ab32b047221 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:51.892719 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4b66b5d7-3a6a-48a3-be9a-4ab32b047221 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:51.893169 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4b66b5d7-3a6a-48a3-be9a-4ab32b047221 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:51.893946 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4b66b5d7-3a6a-48a3-be9a-4ab32b047221 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:51.894381 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4b66b5d7-3a6a-48a3-be9a-4ab32b047221 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:51.921422 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-67160e0f-936a-419c-bdab-99b3f5295d5a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:51.921994 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-67160e0f-936a-419c-bdab-99b3f5295d5a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: 70518a58-de77-4946-ae7f-ec562c0556ea] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:51.928010 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-67160e0f-936a-419c-bdab-99b3f5295d5a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:51.928463 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-67160e0f-936a-419c-bdab-99b3f5295d5a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:51.929249 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-67160e0f-936a-419c-bdab-99b3f5295d5a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:51.929687 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-67160e0f-936a-419c-bdab-99b3f5295d5a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:51.953755 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-67160e0f-936a-419c-bdab-99b3f5295d5a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: 70518a58-de77-4946-ae7f-ec562c0556ea] Going to try to terminate instance {{(pid=116858) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 03 02:55:52.031927 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4b66b5d7-3a6a-48a3-be9a-4ab32b047221 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:52.037761 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-67160e0f-936a-419c-bdab-99b3f5295d5a tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "DELETE /compute/v2.1/servers/70518a58-de77-4946-ae7f-ec562c0556ea" status: 204 len: 0 microversion: 2.20 time: 0.120837 Mar 03 02:55:52.038344 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1479/2709] 10.222.0.30 () {60 vars in 1279 bytes} [Thu Mar 3 02:55:51 2022] DELETE /compute/v2.1/servers/70518a58-de77-4946-ae7f-ec562c0556ea => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Mar 03 02:55:52.040625 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4b66b5d7-3a6a-48a3-be9a-4ab32b047221 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.158551 Mar 03 02:55:52.050692 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1231/2710] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:51 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:52.050888 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-de1ae158-8209-4a6c-9bf9-13594dd26a6b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:52.050888 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-de1ae158-8209-4a6c-9bf9-13594dd26a6b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:52.051133 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-39158c1a-3eca-465e-95ad-961aa602033b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:52.051133 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-39158c1a-3eca-465e-95ad-961aa602033b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: 70518a58-de77-4946-ae7f-ec562c0556ea] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:52.051306 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-de1ae158-8209-4a6c-9bf9-13594dd26a6b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:52.051765 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-de1ae158-8209-4a6c-9bf9-13594dd26a6b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:52.052311 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-de1ae158-8209-4a6c-9bf9-13594dd26a6b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:52.053176 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-de1ae158-8209-4a6c-9bf9-13594dd26a6b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:52.054417 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-39158c1a-3eca-465e-95ad-961aa602033b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:52.054877 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-39158c1a-3eca-465e-95ad-961aa602033b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:52.055697 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-39158c1a-3eca-465e-95ad-961aa602033b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:52.056141 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-39158c1a-3eca-465e-95ad-961aa602033b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:52.189099 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-de1ae158-8209-4a6c-9bf9-13594dd26a6b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:52.191311 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-39158c1a-3eca-465e-95ad-961aa602033b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:52.196839 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-de1ae158-8209-4a6c-9bf9-13594dd26a6b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.157238 Mar 03 02:55:52.197412 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1480/2711] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:52 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:52.198794 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-39158c1a-3eca-465e-95ad-961aa602033b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:52.200335 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-39158c1a-3eca-465e-95ad-961aa602033b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:52.201603 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-39158c1a-3eca-465e-95ad-961aa602033b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/70518a58-de77-4946-ae7f-ec562c0556ea" status: 200 len: 1724 microversion: 2.20 time: 0.159002 Mar 03 02:55:52.202146 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1232/2712] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:55:52 2022] GET /compute/v2.1/servers/70518a58-de77-4946-ae7f-ec562c0556ea => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:55:52.538750 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0ffe8c06-6d00-46dd-bd91-a4392d8ca6cb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:52.539282 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0ffe8c06-6d00-46dd-bd91-a4392d8ca6cb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:52.545652 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0ffe8c06-6d00-46dd-bd91-a4392d8ca6cb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:52.546106 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0ffe8c06-6d00-46dd-bd91-a4392d8ca6cb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:52.546875 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0ffe8c06-6d00-46dd-bd91-a4392d8ca6cb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:52.547313 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0ffe8c06-6d00-46dd-bd91-a4392d8ca6cb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:52.679154 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0ffe8c06-6d00-46dd-bd91-a4392d8ca6cb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:52.686721 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-afb9cad5-5f36-499f-bfaa-7a00207e1d8e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:52.687320 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-afb9cad5-5f36-499f-bfaa-7a00207e1d8e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:52.687662 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0ffe8c06-6d00-46dd-bd91-a4392d8ca6cb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.152845 Mar 03 02:55:52.688229 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1481/2713] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:52 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:52.693195 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-afb9cad5-5f36-499f-bfaa-7a00207e1d8e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:52.693640 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-afb9cad5-5f36-499f-bfaa-7a00207e1d8e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:52.694415 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-afb9cad5-5f36-499f-bfaa-7a00207e1d8e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:52.694850 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-afb9cad5-5f36-499f-bfaa-7a00207e1d8e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:52.754794 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-afb9cad5-5f36-499f-bfaa-7a00207e1d8e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:52.762538 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-afb9cad5-5f36-499f-bfaa-7a00207e1d8e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080304 Mar 03 02:55:52.763101 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1233/2714] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:52 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:53.058262 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ef266307-48ef-4e7d-8f9b-354e18d6f1d6 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:53.058862 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ef266307-48ef-4e7d-8f9b-354e18d6f1d6 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:53.064867 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ef266307-48ef-4e7d-8f9b-354e18d6f1d6 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:53.065315 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ef266307-48ef-4e7d-8f9b-354e18d6f1d6 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:53.066080 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ef266307-48ef-4e7d-8f9b-354e18d6f1d6 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:53.066513 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ef266307-48ef-4e7d-8f9b-354e18d6f1d6 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:53.194963 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ef266307-48ef-4e7d-8f9b-354e18d6f1d6 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:53.204099 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ef266307-48ef-4e7d-8f9b-354e18d6f1d6 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.149691 Mar 03 02:55:53.204681 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1482/2715] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:53 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:53.214157 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f3347d77-f114-450e-89ee-259888adb8ef tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:53.214787 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f3347d77-f114-450e-89ee-259888adb8ef tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:53.221408 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b8cfeea4-f798-4bed-82f5-59749e1e3e3d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:53.222012 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b8cfeea4-f798-4bed-82f5-59749e1e3e3d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: 70518a58-de77-4946-ae7f-ec562c0556ea] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:53.222152 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f3347d77-f114-450e-89ee-259888adb8ef tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:53.222523 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f3347d77-f114-450e-89ee-259888adb8ef tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:53.223316 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f3347d77-f114-450e-89ee-259888adb8ef tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:53.223798 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f3347d77-f114-450e-89ee-259888adb8ef tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:53.227636 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b8cfeea4-f798-4bed-82f5-59749e1e3e3d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:53.228089 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b8cfeea4-f798-4bed-82f5-59749e1e3e3d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:53.228858 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b8cfeea4-f798-4bed-82f5-59749e1e3e3d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:53.229289 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b8cfeea4-f798-4bed-82f5-59749e1e3e3d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:53.362195 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f3347d77-f114-450e-89ee-259888adb8ef tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:53.363172 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b8cfeea4-f798-4bed-82f5-59749e1e3e3d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:53.369920 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f3347d77-f114-450e-89ee-259888adb8ef tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.159640 Mar 03 02:55:53.370479 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1234/2716] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:53 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:53.371106 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b8cfeea4-f798-4bed-82f5-59749e1e3e3d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:53.372655 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b8cfeea4-f798-4bed-82f5-59749e1e3e3d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:53.373848 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b8cfeea4-f798-4bed-82f5-59749e1e3e3d tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/70518a58-de77-4946-ae7f-ec562c0556ea" status: 200 len: 1724 microversion: 2.20 time: 0.157121 Mar 03 02:55:53.374406 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1483/2717] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:55:53 2022] GET /compute/v2.1/servers/70518a58-de77-4946-ae7f-ec562c0556ea => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 03 02:55:53.705754 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-276b5843-2882-47a5-993c-3a482effc834 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:53.706493 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-276b5843-2882-47a5-993c-3a482effc834 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:53.712626 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-276b5843-2882-47a5-993c-3a482effc834 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:53.712894 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-276b5843-2882-47a5-993c-3a482effc834 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:53.713686 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-276b5843-2882-47a5-993c-3a482effc834 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:53.714128 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-276b5843-2882-47a5-993c-3a482effc834 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:53.780512 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ae15935e-9d0b-4fdc-8e62-fe7eacdb8321 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:53.781180 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ae15935e-9d0b-4fdc-8e62-fe7eacdb8321 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:53.789381 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ae15935e-9d0b-4fdc-8e62-fe7eacdb8321 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:53.789928 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ae15935e-9d0b-4fdc-8e62-fe7eacdb8321 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:53.790802 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ae15935e-9d0b-4fdc-8e62-fe7eacdb8321 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:53.791313 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ae15935e-9d0b-4fdc-8e62-fe7eacdb8321 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:53.858693 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-276b5843-2882-47a5-993c-3a482effc834 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:53.866686 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-276b5843-2882-47a5-993c-3a482effc834 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.165494 Mar 03 02:55:53.867462 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1235/2718] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:53 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:53.891968 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ae15935e-9d0b-4fdc-8e62-fe7eacdb8321 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:53.899819 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ae15935e-9d0b-4fdc-8e62-fe7eacdb8321 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.124029 Mar 03 02:55:53.900389 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1484/2719] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:53 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:54.222507 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d409bb36-3689-4d31-be51-96eb32a6f6f8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:54.223121 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d409bb36-3689-4d31-be51-96eb32a6f6f8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:54.229771 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d409bb36-3689-4d31-be51-96eb32a6f6f8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:54.230445 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d409bb36-3689-4d31-be51-96eb32a6f6f8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:54.231491 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d409bb36-3689-4d31-be51-96eb32a6f6f8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:54.231965 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d409bb36-3689-4d31-be51-96eb32a6f6f8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:54.371777 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [req-faaa7143-a62a-4f38-bb22-1c0481d13d1c req-5f9a60de-137e-47ab-bd0a-2d58a3e234a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70518a58-de77-4946-ae7f-ec562c0556ea", "name": "network-vif-deleted", "tag": "87e88395-b84f-4eff-8c83-30f91c7e179c"}]} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:55:54.383539 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d409bb36-3689-4d31-be51-96eb32a6f6f8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:54.384836 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-faaa7143-a62a-4f38-bb22-1c0481d13d1c req-5f9a60de-137e-47ab-bd0a-2d58a3e234a1 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:54.385545 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-faaa7143-a62a-4f38-bb22-1c0481d13d1c req-5f9a60de-137e-47ab-bd0a-2d58a3e234a1 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:54.394891 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d409bb36-3689-4d31-be51-96eb32a6f6f8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.175823 Mar 03 02:55:54.396403 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1236/2720] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:54 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:54.401240 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.compute.server_external_events [req-faaa7143-a62a-4f38-bb22-1c0481d13d1c req-5f9a60de-137e-47ab-bd0a-2d58a3e234a1 service nova] Creating event network-vif-deleted:87e88395-b84f-4eff-8c83-30f91c7e179c for instance 70518a58-de77-4946-ae7f-ec562c0556ea on hv-cinder-81977 Mar 03 02:55:54.403047 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-22763121-e527-4c5c-a27b-cd67a8fbfbc1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:54.403948 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-22763121-e527-4c5c-a27b-cd67a8fbfbc1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:54.409410 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [req-faaa7143-a62a-4f38-bb22-1c0481d13d1c req-5f9a60de-137e-47ab-bd0a-2d58a3e234a1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041149 Mar 03 02:55:54.411050 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1485/2721] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:55:54.415564 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-22763121-e527-4c5c-a27b-cd67a8fbfbc1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:54.416987 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-22763121-e527-4c5c-a27b-cd67a8fbfbc1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:54.418361 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-22763121-e527-4c5c-a27b-cd67a8fbfbc1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:54.418975 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-22763121-e527-4c5c-a27b-cd67a8fbfbc1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:54.432414 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f2c6fca9-d9ea-49c3-aafd-70e9ec507992 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:54.433498 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f2c6fca9-d9ea-49c3-aafd-70e9ec507992 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: 70518a58-de77-4946-ae7f-ec562c0556ea] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:54.444015 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f2c6fca9-d9ea-49c3-aafd-70e9ec507992 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:54.444914 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f2c6fca9-d9ea-49c3-aafd-70e9ec507992 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:54.445974 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f2c6fca9-d9ea-49c3-aafd-70e9ec507992 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:54.447542 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f2c6fca9-d9ea-49c3-aafd-70e9ec507992 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:54.550272 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f2c6fca9-d9ea-49c3-aafd-70e9ec507992 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:54.560775 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f2c6fca9-d9ea-49c3-aafd-70e9ec507992 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:54.562290 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f2c6fca9-d9ea-49c3-aafd-70e9ec507992 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2f87d12584b4465b93c30d79d1ba832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c4069c31144128952334c19272d2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:54.563713 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f2c6fca9-d9ea-49c3-aafd-70e9ec507992 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/70518a58-de77-4946-ae7f-ec562c0556ea" status: 200 len: 1366 microversion: 2.20 time: 0.151015 Mar 03 02:55:54.565046 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1486/2722] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:55:54 2022] GET /compute/v2.1/servers/70518a58-de77-4946-ae7f-ec562c0556ea => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 03 02:55:54.578554 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-22763121-e527-4c5c-a27b-cd67a8fbfbc1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:54.586934 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-22763121-e527-4c5c-a27b-cd67a8fbfbc1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.189284 Mar 03 02:55:54.587651 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1237/2723] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:54 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:54.884399 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ef6b36d0-268c-4518-b9c7-c2e7c41517c1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:54.885041 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ef6b36d0-268c-4518-b9c7-c2e7c41517c1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:54.891944 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ef6b36d0-268c-4518-b9c7-c2e7c41517c1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:54.892398 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ef6b36d0-268c-4518-b9c7-c2e7c41517c1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:54.893175 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ef6b36d0-268c-4518-b9c7-c2e7c41517c1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:54.893697 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ef6b36d0-268c-4518-b9c7-c2e7c41517c1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:54.916926 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5532eaac-4db5-4ad1-b94e-d50ed78c2600 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:54.917824 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5532eaac-4db5-4ad1-b94e-d50ed78c2600 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:54.924686 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5532eaac-4db5-4ad1-b94e-d50ed78c2600 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:54.925367 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5532eaac-4db5-4ad1-b94e-d50ed78c2600 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:54.926360 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5532eaac-4db5-4ad1-b94e-d50ed78c2600 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:54.926959 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5532eaac-4db5-4ad1-b94e-d50ed78c2600 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:55.007164 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5532eaac-4db5-4ad1-b94e-d50ed78c2600 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:55.014782 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5532eaac-4db5-4ad1-b94e-d50ed78c2600 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.102757 Mar 03 02:55:55.015664 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1238/2724] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:54 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:55.047911 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ef6b36d0-268c-4518-b9c7-c2e7c41517c1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:55.056124 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ef6b36d0-268c-4518-b9c7-c2e7c41517c1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.175868 Mar 03 02:55:55.056703 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1487/2725] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:54 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:55.413706 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a48ff359-c326-404f-a9d4-9f059172a22d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:55.414399 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a48ff359-c326-404f-a9d4-9f059172a22d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:55.421945 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a48ff359-c326-404f-a9d4-9f059172a22d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:55.422405 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a48ff359-c326-404f-a9d4-9f059172a22d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:55.423194 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a48ff359-c326-404f-a9d4-9f059172a22d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:55.423659 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a48ff359-c326-404f-a9d4-9f059172a22d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:55.561052 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a48ff359-c326-404f-a9d4-9f059172a22d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:55.568890 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a48ff359-c326-404f-a9d4-9f059172a22d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.159041 Mar 03 02:55:55.569452 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1239/2726] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:55 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:55.583264 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6649eb1a-5f46-42e3-ba5a-70eb675f6243 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:55.583907 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6649eb1a-5f46-42e3-ba5a-70eb675f6243 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: 70518a58-de77-4946-ae7f-ec562c0556ea] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:55.589641 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6649eb1a-5f46-42e3-ba5a-70eb675f6243 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:55.590088 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6649eb1a-5f46-42e3-ba5a-70eb675f6243 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:55.590991 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6649eb1a-5f46-42e3-ba5a-70eb675f6243 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:55.591315 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6649eb1a-5f46-42e3-ba5a-70eb675f6243 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:55.604155 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-87b126e4-8f9e-42fe-9b6d-c23342ea544a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:55.604908 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-87b126e4-8f9e-42fe-9b6d-c23342ea544a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:55.605036 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.wsgi [None req-6649eb1a-5f46-42e3-ba5a-70eb675f6243 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] HTTP exception thrown: Instance 70518a58-de77-4946-ae7f-ec562c0556ea could not be found. Mar 03 02:55:55.605576 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6649eb1a-5f46-42e3-ba5a-70eb675f6243 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Returning 404 to user: Instance 70518a58-de77-4946-ae7f-ec562c0556ea could not be found. {{(pid=116858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:55:55.606642 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6649eb1a-5f46-42e3-ba5a-70eb675f6243 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/70518a58-de77-4946-ae7f-ec562c0556ea" status: 404 len: 111 microversion: 2.20 time: 0.027782 Mar 03 02:55:55.607698 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1488/2727] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:55:55 2022] GET /compute/v2.1/servers/70518a58-de77-4946-ae7f-ec562c0556ea => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Mar 03 02:55:55.611812 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-87b126e4-8f9e-42fe-9b6d-c23342ea544a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:55.612394 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-87b126e4-8f9e-42fe-9b6d-c23342ea544a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:55.613292 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-87b126e4-8f9e-42fe-9b6d-c23342ea544a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:55.613837 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-87b126e4-8f9e-42fe-9b6d-c23342ea544a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:55.615381 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b3988f8c-a692-41f8-a2d7-331134c9493b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '.version_select at 0x7fb3c82e5160>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:55.632525 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b3988f8c-a692-41f8-a2d7-331134c9493b tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1381735626" status: 204 len: 0 microversion: 2.20 time: 0.020602 Mar 03 02:55:55.633517 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1489/2728] 10.222.0.30 () {60 vars in 1261 bytes} [Thu Mar 3 02:55:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1381735626 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Mar 03 02:55:55.828937 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-87b126e4-8f9e-42fe-9b6d-c23342ea544a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:55.838698 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-87b126e4-8f9e-42fe-9b6d-c23342ea544a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.238496 Mar 03 02:55:55.848715 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1240/2729] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:55 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:56.032214 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-974f70e8-e832-42ce-9a1f-b14b0757bac5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:56.032817 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-974f70e8-e832-42ce-9a1f-b14b0757bac5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:56.039885 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-974f70e8-e832-42ce-9a1f-b14b0757bac5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:56.040724 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-974f70e8-e832-42ce-9a1f-b14b0757bac5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:56.041703 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-974f70e8-e832-42ce-9a1f-b14b0757bac5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:56.042371 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-974f70e8-e832-42ce-9a1f-b14b0757bac5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:56.073148 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f4025f89-ccd2-452e-acaa-55fdb3487fa5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:56.074062 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f4025f89-ccd2-452e-acaa-55fdb3487fa5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:56.081459 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f4025f89-ccd2-452e-acaa-55fdb3487fa5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:56.082162 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f4025f89-ccd2-452e-acaa-55fdb3487fa5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:56.082993 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f4025f89-ccd2-452e-acaa-55fdb3487fa5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:56.083410 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f4025f89-ccd2-452e-acaa-55fdb3487fa5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:56.115496 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-974f70e8-e832-42ce-9a1f-b14b0757bac5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:56.128469 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-974f70e8-e832-42ce-9a1f-b14b0757bac5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.100890 Mar 03 02:55:56.129318 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1490/2730] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:56 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:56.220838 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f4025f89-ccd2-452e-acaa-55fdb3487fa5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:56.228866 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f4025f89-ccd2-452e-acaa-55fdb3487fa5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.160183 Mar 03 02:55:56.229527 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1241/2731] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:56 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:56.479794 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d46e50c8-c143-4602-a969-dc87355ef3ce tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:56.480347 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d46e50c8-c143-4602-a969-dc87355ef3ce tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: 70518a58-de77-4946-ae7f-ec562c0556ea] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:56.487789 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d46e50c8-c143-4602-a969-dc87355ef3ce tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:56.488471 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d46e50c8-c143-4602-a969-dc87355ef3ce tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:56.489431 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d46e50c8-c143-4602-a969-dc87355ef3ce tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:56.490025 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d46e50c8-c143-4602-a969-dc87355ef3ce tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:56.503992 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.wsgi [None req-d46e50c8-c143-4602-a969-dc87355ef3ce tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] HTTP exception thrown: Instance 70518a58-de77-4946-ae7f-ec562c0556ea could not be found. Mar 03 02:55:56.505043 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d46e50c8-c143-4602-a969-dc87355ef3ce tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Returning 404 to user: Instance 70518a58-de77-4946-ae7f-ec562c0556ea could not be found. {{(pid=116858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:55:56.506044 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d46e50c8-c143-4602-a969-dc87355ef3ce tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "DELETE /compute/v2.1/servers/70518a58-de77-4946-ae7f-ec562c0556ea" status: 404 len: 111 microversion: 2.20 time: 0.030422 Mar 03 02:55:56.509829 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1491/2732] 10.222.0.30 () {60 vars in 1279 bytes} [Thu Mar 3 02:55:56 2022] DELETE /compute/v2.1/servers/70518a58-de77-4946-ae7f-ec562c0556ea => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 03 02:55:56.515055 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-885f5b05-48eb-4485-a5dc-3aaab4d61e9f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:56.515916 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-885f5b05-48eb-4485-a5dc-3aaab4d61e9f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: 70518a58-de77-4946-ae7f-ec562c0556ea] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:56.522920 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-885f5b05-48eb-4485-a5dc-3aaab4d61e9f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:56.523456 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-885f5b05-48eb-4485-a5dc-3aaab4d61e9f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:56.524375 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-885f5b05-48eb-4485-a5dc-3aaab4d61e9f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:56.524939 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-885f5b05-48eb-4485-a5dc-3aaab4d61e9f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:56.539407 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.wsgi [None req-885f5b05-48eb-4485-a5dc-3aaab4d61e9f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] HTTP exception thrown: Instance 70518a58-de77-4946-ae7f-ec562c0556ea could not be found. Mar 03 02:55:56.540166 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-885f5b05-48eb-4485-a5dc-3aaab4d61e9f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Returning 404 to user: Instance 70518a58-de77-4946-ae7f-ec562c0556ea could not be found. {{(pid=116859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:55:56.541083 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-885f5b05-48eb-4485-a5dc-3aaab4d61e9f tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/70518a58-de77-4946-ae7f-ec562c0556ea" status: 404 len: 111 microversion: 2.20 time: 0.030185 Mar 03 02:55:56.542021 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1242/2733] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 02:55:56 2022] GET /compute/v2.1/servers/70518a58-de77-4946-ae7f-ec562c0556ea => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 03 02:55:56.587563 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8b6e5681-a301-4869-bc34-0aaad6002823 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:56.588218 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8b6e5681-a301-4869-bc34-0aaad6002823 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:56.594395 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b6e5681-a301-4869-bc34-0aaad6002823 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:56.594849 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b6e5681-a301-4869-bc34-0aaad6002823 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:56.595645 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b6e5681-a301-4869-bc34-0aaad6002823 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:56.596088 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b6e5681-a301-4869-bc34-0aaad6002823 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:56.853021 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8b6e5681-a301-4869-bc34-0aaad6002823 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:56.856492 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5994dd67-6ea2-4433-ae87-9c90b9d8c13d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:56.857738 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5994dd67-6ea2-4433-ae87-9c90b9d8c13d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:56.862050 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8b6e5681-a301-4869-bc34-0aaad6002823 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.278259 Mar 03 02:55:56.862629 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1492/2734] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:56 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:56.863775 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5994dd67-6ea2-4433-ae87-9c90b9d8c13d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:56.864466 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5994dd67-6ea2-4433-ae87-9c90b9d8c13d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:56.865265 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5994dd67-6ea2-4433-ae87-9c90b9d8c13d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:56.865699 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5994dd67-6ea2-4433-ae87-9c90b9d8c13d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:57.007243 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5994dd67-6ea2-4433-ae87-9c90b9d8c13d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:57.016413 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5994dd67-6ea2-4433-ae87-9c90b9d8c13d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.164098 Mar 03 02:55:57.017179 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1243/2735] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:56 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:57.145757 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-13fc4d3b-84d5-4c7d-b747-a3111fe4c836 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:57.147115 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-13fc4d3b-84d5-4c7d-b747-a3111fe4c836 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:57.153794 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-13fc4d3b-84d5-4c7d-b747-a3111fe4c836 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:57.154871 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-13fc4d3b-84d5-4c7d-b747-a3111fe4c836 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:57.155694 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-13fc4d3b-84d5-4c7d-b747-a3111fe4c836 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:57.156130 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-13fc4d3b-84d5-4c7d-b747-a3111fe4c836 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:57.219553 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-13fc4d3b-84d5-4c7d-b747-a3111fe4c836 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:57.227586 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-13fc4d3b-84d5-4c7d-b747-a3111fe4c836 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.085893 Mar 03 02:55:57.228199 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1493/2736] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:57 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:57.246492 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c13c1fb1-9975-4910-bf25-541f0d2ea528 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:57.247113 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c13c1fb1-9975-4910-bf25-541f0d2ea528 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:57.253871 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c13c1fb1-9975-4910-bf25-541f0d2ea528 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:57.254317 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c13c1fb1-9975-4910-bf25-541f0d2ea528 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:57.255114 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c13c1fb1-9975-4910-bf25-541f0d2ea528 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:57.255559 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c13c1fb1-9975-4910-bf25-541f0d2ea528 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:57.396826 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c13c1fb1-9975-4910-bf25-541f0d2ea528 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:57.405010 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c13c1fb1-9975-4910-bf25-541f0d2ea528 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.162530 Mar 03 02:55:57.405633 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1244/2737] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:57 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:57.879563 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-38183943-bcae-453d-bdab-3eaf4430daea tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:57.880200 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-38183943-bcae-453d-bdab-3eaf4430daea tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:57.885979 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-38183943-bcae-453d-bdab-3eaf4430daea tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:57.886427 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-38183943-bcae-453d-bdab-3eaf4430daea tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:57.887186 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-38183943-bcae-453d-bdab-3eaf4430daea tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:57.887634 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-38183943-bcae-453d-bdab-3eaf4430daea tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:58.024226 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-38183943-bcae-453d-bdab-3eaf4430daea tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:58.033538 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-59b229be-770e-40ba-9d01-a02fbc5b2b1e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:58.034157 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-59b229be-770e-40ba-9d01-a02fbc5b2b1e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:58.041583 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-59b229be-770e-40ba-9d01-a02fbc5b2b1e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:58.042188 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-59b229be-770e-40ba-9d01-a02fbc5b2b1e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:58.043210 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-59b229be-770e-40ba-9d01-a02fbc5b2b1e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:58.044250 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-59b229be-770e-40ba-9d01-a02fbc5b2b1e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:58.062536 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-38183943-bcae-453d-bdab-3eaf4430daea tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.165587 Mar 03 02:55:58.073101 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1494/2738] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:57 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:58.187369 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-59b229be-770e-40ba-9d01-a02fbc5b2b1e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:58.195065 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-59b229be-770e-40ba-9d01-a02fbc5b2b1e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.165423 Mar 03 02:55:58.195650 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1245/2739] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:58 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:58.244683 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5ff39ca4-8931-4201-9678-ba4234093ce4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:58.245265 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5ff39ca4-8931-4201-9678-ba4234093ce4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:58.252575 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5ff39ca4-8931-4201-9678-ba4234093ce4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:58.253025 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5ff39ca4-8931-4201-9678-ba4234093ce4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:58.253796 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5ff39ca4-8931-4201-9678-ba4234093ce4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:58.254232 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5ff39ca4-8931-4201-9678-ba4234093ce4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:58.313706 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5ff39ca4-8931-4201-9678-ba4234093ce4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:58.321476 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5ff39ca4-8931-4201-9678-ba4234093ce4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080708 Mar 03 02:55:58.322056 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1495/2740] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:58 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:58.421983 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d6de127f-55b9-4334-b6bb-3a7d9ed0d448 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:58.422620 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d6de127f-55b9-4334-b6bb-3a7d9ed0d448 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:58.428489 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d6de127f-55b9-4334-b6bb-3a7d9ed0d448 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:58.428950 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d6de127f-55b9-4334-b6bb-3a7d9ed0d448 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:58.429734 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d6de127f-55b9-4334-b6bb-3a7d9ed0d448 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:58.430178 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d6de127f-55b9-4334-b6bb-3a7d9ed0d448 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:58.561419 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d6de127f-55b9-4334-b6bb-3a7d9ed0d448 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:58.569103 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d6de127f-55b9-4334-b6bb-3a7d9ed0d448 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.151504 Mar 03 02:55:58.569672 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1246/2741] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:58 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:59.080252 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-58cfb7b7-1540-43db-a870-6a3d317da865 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:59.080858 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-58cfb7b7-1540-43db-a870-6a3d317da865 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:59.086683 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-58cfb7b7-1540-43db-a870-6a3d317da865 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:59.087129 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-58cfb7b7-1540-43db-a870-6a3d317da865 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:59.087925 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-58cfb7b7-1540-43db-a870-6a3d317da865 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:59.088359 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-58cfb7b7-1540-43db-a870-6a3d317da865 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:59.213025 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4a8541d8-2f5a-45e4-9c58-a122963473af tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:59.213625 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4a8541d8-2f5a-45e4-9c58-a122963473af tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:59.218467 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-58cfb7b7-1540-43db-a870-6a3d317da865 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:59.220663 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4a8541d8-2f5a-45e4-9c58-a122963473af tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:59.221113 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4a8541d8-2f5a-45e4-9c58-a122963473af tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:59.221897 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4a8541d8-2f5a-45e4-9c58-a122963473af tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:59.222332 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4a8541d8-2f5a-45e4-9c58-a122963473af tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:59.226095 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-58cfb7b7-1540-43db-a870-6a3d317da865 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.150734 Mar 03 02:55:59.226659 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1496/2742] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:59 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:55:59.338338 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a8d29f4a-9f2d-47a3-bcf6-30aeb7407c35 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:59.339021 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a8d29f4a-9f2d-47a3-bcf6-30aeb7407c35 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:59.345585 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a8d29f4a-9f2d-47a3-bcf6-30aeb7407c35 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:59.346027 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a8d29f4a-9f2d-47a3-bcf6-30aeb7407c35 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:59.346832 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a8d29f4a-9f2d-47a3-bcf6-30aeb7407c35 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:59.347457 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a8d29f4a-9f2d-47a3-bcf6-30aeb7407c35 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:59.352693 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4a8541d8-2f5a-45e4-9c58-a122963473af tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:59.361788 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4a8541d8-2f5a-45e4-9c58-a122963473af tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.152544 Mar 03 02:55:59.362363 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1247/2743] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:59 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:59.411254 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a8d29f4a-9f2d-47a3-bcf6-30aeb7407c35 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:59.419092 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a8d29f4a-9f2d-47a3-bcf6-30aeb7407c35 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.084550 Mar 03 02:55:59.420184 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1497/2744] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:59 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:55:59.586591 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f6a10b83-b789-4c1e-b9b3-4619438ccd0c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:55:59.587228 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f6a10b83-b789-4c1e-b9b3-4619438ccd0c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:55:59.593756 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f6a10b83-b789-4c1e-b9b3-4619438ccd0c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:59.594203 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f6a10b83-b789-4c1e-b9b3-4619438ccd0c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:59.594967 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f6a10b83-b789-4c1e-b9b3-4619438ccd0c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:55:59.595401 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f6a10b83-b789-4c1e-b9b3-4619438ccd0c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:55:59.726414 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f6a10b83-b789-4c1e-b9b3-4619438ccd0c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:55:59.734806 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f6a10b83-b789-4c1e-b9b3-4619438ccd0c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.152101 Mar 03 02:55:59.735396 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1248/2745] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:55:59 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:00.244395 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-296b979c-27c3-4366-a3b4-e9836778807b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:00.244928 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-296b979c-27c3-4366-a3b4-e9836778807b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:00.251230 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-296b979c-27c3-4366-a3b4-e9836778807b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:00.251700 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-296b979c-27c3-4366-a3b4-e9836778807b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:00.252464 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-296b979c-27c3-4366-a3b4-e9836778807b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:00.252898 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-296b979c-27c3-4366-a3b4-e9836778807b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:00.380024 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1d7f12d7-eec8-45c8-893a-2949b2ef8531 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:00.380634 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1d7f12d7-eec8-45c8-893a-2949b2ef8531 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:00.381017 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-296b979c-27c3-4366-a3b4-e9836778807b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:00.386886 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1d7f12d7-eec8-45c8-893a-2949b2ef8531 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:00.387342 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1d7f12d7-eec8-45c8-893a-2949b2ef8531 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:00.388145 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1d7f12d7-eec8-45c8-893a-2949b2ef8531 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:00.389517 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1d7f12d7-eec8-45c8-893a-2949b2ef8531 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:00.389998 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-296b979c-27c3-4366-a3b4-e9836778807b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.148317 Mar 03 02:56:00.390577 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1498/2746] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:00 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:00.436989 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-dcdf4509-191d-4667-af42-a2fff7ff180a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:00.437590 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-dcdf4509-191d-4667-af42-a2fff7ff180a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:00.443335 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dcdf4509-191d-4667-af42-a2fff7ff180a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:00.443817 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dcdf4509-191d-4667-af42-a2fff7ff180a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:00.444587 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dcdf4509-191d-4667-af42-a2fff7ff180a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:00.445010 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dcdf4509-191d-4667-af42-a2fff7ff180a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:00.503989 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-dcdf4509-191d-4667-af42-a2fff7ff180a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:00.511860 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-dcdf4509-191d-4667-af42-a2fff7ff180a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079170 Mar 03 02:56:00.512428 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1499/2747] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:00 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:00.523024 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1d7f12d7-eec8-45c8-893a-2949b2ef8531 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:00.531084 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1d7f12d7-eec8-45c8-893a-2949b2ef8531 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.154889 Mar 03 02:56:00.531657 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1249/2748] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:00 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:00.751861 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-db562702-dda7-4ec1-bcb2-f395188a0555 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:00.752387 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-db562702-dda7-4ec1-bcb2-f395188a0555 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:00.758121 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-db562702-dda7-4ec1-bcb2-f395188a0555 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:00.758565 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-db562702-dda7-4ec1-bcb2-f395188a0555 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:00.759327 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-db562702-dda7-4ec1-bcb2-f395188a0555 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:00.759797 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-db562702-dda7-4ec1-bcb2-f395188a0555 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:00.895019 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-db562702-dda7-4ec1-bcb2-f395188a0555 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:00.902695 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-db562702-dda7-4ec1-bcb2-f395188a0555 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.155258 Mar 03 02:56:00.903262 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1500/2749] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:00 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:01.407977 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-35c9833a-2408-4522-8d3f-e942dbc2660b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:01.408593 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-35c9833a-2408-4522-8d3f-e942dbc2660b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:01.414843 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-35c9833a-2408-4522-8d3f-e942dbc2660b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:01.415303 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-35c9833a-2408-4522-8d3f-e942dbc2660b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:01.416118 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-35c9833a-2408-4522-8d3f-e942dbc2660b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:01.416563 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-35c9833a-2408-4522-8d3f-e942dbc2660b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:01.530157 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e2f23f9c-2aaf-4d20-b46f-8657d903a3a5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:01.530869 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e2f23f9c-2aaf-4d20-b46f-8657d903a3a5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:01.537187 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e2f23f9c-2aaf-4d20-b46f-8657d903a3a5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:01.537711 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e2f23f9c-2aaf-4d20-b46f-8657d903a3a5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:01.538565 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e2f23f9c-2aaf-4d20-b46f-8657d903a3a5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:01.539009 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e2f23f9c-2aaf-4d20-b46f-8657d903a3a5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:01.553537 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-35c9833a-2408-4522-8d3f-e942dbc2660b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:01.561952 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-35c9833a-2408-4522-8d3f-e942dbc2660b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.158460 Mar 03 02:56:01.562533 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1250/2750] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:01 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:01.567015 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-49656229-f577-40a9-b3e1-1e0204820243 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:01.567627 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-49656229-f577-40a9-b3e1-1e0204820243 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:01.573508 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-49656229-f577-40a9-b3e1-1e0204820243 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:01.573986 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-49656229-f577-40a9-b3e1-1e0204820243 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:01.574768 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-49656229-f577-40a9-b3e1-1e0204820243 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:01.575204 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-49656229-f577-40a9-b3e1-1e0204820243 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:01.598624 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e2f23f9c-2aaf-4d20-b46f-8657d903a3a5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:01.606553 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e2f23f9c-2aaf-4d20-b46f-8657d903a3a5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080848 Mar 03 02:56:01.607364 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1501/2751] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:01 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:01.707296 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-49656229-f577-40a9-b3e1-1e0204820243 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:01.714949 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-49656229-f577-40a9-b3e1-1e0204820243 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.151482 Mar 03 02:56:01.715510 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1251/2752] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:01 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:01.919086 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-674dd758-5724-4ae3-906e-4d2c5a5b8653 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:01.919636 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-674dd758-5724-4ae3-906e-4d2c5a5b8653 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:01.925693 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-674dd758-5724-4ae3-906e-4d2c5a5b8653 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:01.926142 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-674dd758-5724-4ae3-906e-4d2c5a5b8653 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:01.926911 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-674dd758-5724-4ae3-906e-4d2c5a5b8653 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:01.927343 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-674dd758-5724-4ae3-906e-4d2c5a5b8653 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:02.056271 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-674dd758-5724-4ae3-906e-4d2c5a5b8653 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:02.064642 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-674dd758-5724-4ae3-906e-4d2c5a5b8653 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.149404 Mar 03 02:56:02.065208 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1502/2753] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:01 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:02.579097 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6fdfcd49-1c03-484c-8988-16a57fbee7ec tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:02.579723 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6fdfcd49-1c03-484c-8988-16a57fbee7ec tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:02.585964 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6fdfcd49-1c03-484c-8988-16a57fbee7ec tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:02.586408 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6fdfcd49-1c03-484c-8988-16a57fbee7ec tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:02.587173 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6fdfcd49-1c03-484c-8988-16a57fbee7ec tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:02.587624 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6fdfcd49-1c03-484c-8988-16a57fbee7ec tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:02.623332 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d77ef625-3757-4362-ba0b-674612a393f9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:02.623958 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d77ef625-3757-4362-ba0b-674612a393f9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:02.630286 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d77ef625-3757-4362-ba0b-674612a393f9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:02.630738 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d77ef625-3757-4362-ba0b-674612a393f9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:02.631531 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d77ef625-3757-4362-ba0b-674612a393f9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:02.631992 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d77ef625-3757-4362-ba0b-674612a393f9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:02.691767 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d77ef625-3757-4362-ba0b-674612a393f9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:02.699332 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d77ef625-3757-4362-ba0b-674612a393f9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079912 Mar 03 02:56:02.700122 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1503/2754] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:02 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:02.719721 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-6fdfcd49-1c03-484c-8988-16a57fbee7ec tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:02.727438 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6fdfcd49-1c03-484c-8988-16a57fbee7ec tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.152276 Mar 03 02:56:02.728047 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1252/2755] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:02 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:02.733570 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-71cee581-8c00-487c-8903-b0b269dab7ef tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:02.734176 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-71cee581-8c00-487c-8903-b0b269dab7ef tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:02.739951 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-71cee581-8c00-487c-8903-b0b269dab7ef tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:02.740409 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-71cee581-8c00-487c-8903-b0b269dab7ef tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:02.741178 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-71cee581-8c00-487c-8903-b0b269dab7ef tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:02.741615 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-71cee581-8c00-487c-8903-b0b269dab7ef tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:02.874756 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-71cee581-8c00-487c-8903-b0b269dab7ef tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:02.882445 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-71cee581-8c00-487c-8903-b0b269dab7ef tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.153660 Mar 03 02:56:02.883010 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1504/2756] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:02 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:03.082024 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-077b2c6b-c061-4b65-867c-ac66c2d09aeb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:03.082662 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-077b2c6b-c061-4b65-867c-ac66c2d09aeb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:03.088609 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-077b2c6b-c061-4b65-867c-ac66c2d09aeb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:03.089069 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-077b2c6b-c061-4b65-867c-ac66c2d09aeb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:03.089854 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-077b2c6b-c061-4b65-867c-ac66c2d09aeb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:03.090298 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-077b2c6b-c061-4b65-867c-ac66c2d09aeb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:03.225930 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-077b2c6b-c061-4b65-867c-ac66c2d09aeb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:03.233950 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-077b2c6b-c061-4b65-867c-ac66c2d09aeb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.155861 Mar 03 02:56:03.234517 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1253/2757] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:03 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:03.715982 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e46a91c6-6eef-4627-b968-594d913beab5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:03.717133 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e46a91c6-6eef-4627-b968-594d913beab5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:03.723708 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e46a91c6-6eef-4627-b968-594d913beab5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:03.724154 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e46a91c6-6eef-4627-b968-594d913beab5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:03.724924 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e46a91c6-6eef-4627-b968-594d913beab5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:03.725353 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e46a91c6-6eef-4627-b968-594d913beab5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:03.745714 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d4b7b1a7-7a3a-490b-8fca-e8505e27f1ef tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:03.746326 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d4b7b1a7-7a3a-490b-8fca-e8505e27f1ef tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:03.753164 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d4b7b1a7-7a3a-490b-8fca-e8505e27f1ef tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:03.753619 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d4b7b1a7-7a3a-490b-8fca-e8505e27f1ef tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:03.754408 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d4b7b1a7-7a3a-490b-8fca-e8505e27f1ef tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:03.754845 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d4b7b1a7-7a3a-490b-8fca-e8505e27f1ef tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:03.785915 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e46a91c6-6eef-4627-b968-594d913beab5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:03.797213 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e46a91c6-6eef-4627-b968-594d913beab5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.085150 Mar 03 02:56:03.797801 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1505/2758] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:03 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:03.887782 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d4b7b1a7-7a3a-490b-8fca-e8505e27f1ef tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:03.895939 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d4b7b1a7-7a3a-490b-8fca-e8505e27f1ef tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.154100 Mar 03 02:56:03.896505 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1254/2759] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:03 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:03.900177 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8b3ae2a4-8d62-49e4-96b1-c2546e3cdcfe tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:03.900793 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8b3ae2a4-8d62-49e4-96b1-c2546e3cdcfe tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:03.907383 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b3ae2a4-8d62-49e4-96b1-c2546e3cdcfe tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:03.907879 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b3ae2a4-8d62-49e4-96b1-c2546e3cdcfe tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:03.908666 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b3ae2a4-8d62-49e4-96b1-c2546e3cdcfe tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:03.909107 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b3ae2a4-8d62-49e4-96b1-c2546e3cdcfe tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:04.041598 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8b3ae2a4-8d62-49e4-96b1-c2546e3cdcfe tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:04.049959 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8b3ae2a4-8d62-49e4-96b1-c2546e3cdcfe tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.153769 Mar 03 02:56:04.050541 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1506/2760] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:03 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:04.251587 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e5b61d02-1842-4b74-a71c-8e831be9bfff tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:04.252151 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e5b61d02-1842-4b74-a71c-8e831be9bfff tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:04.257926 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e5b61d02-1842-4b74-a71c-8e831be9bfff tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:04.258375 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e5b61d02-1842-4b74-a71c-8e831be9bfff tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:04.259165 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e5b61d02-1842-4b74-a71c-8e831be9bfff tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:04.259626 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e5b61d02-1842-4b74-a71c-8e831be9bfff tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:04.392673 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e5b61d02-1842-4b74-a71c-8e831be9bfff tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:04.400390 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e5b61d02-1842-4b74-a71c-8e831be9bfff tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.153594 Mar 03 02:56:04.400960 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1255/2761] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:04 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:04.817284 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-17025d98-ab0b-4cdc-a13a-432b010ef718 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:04.817879 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-17025d98-ab0b-4cdc-a13a-432b010ef718 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:04.824217 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-17025d98-ab0b-4cdc-a13a-432b010ef718 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:04.824668 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-17025d98-ab0b-4cdc-a13a-432b010ef718 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:04.825438 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-17025d98-ab0b-4cdc-a13a-432b010ef718 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:04.825920 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-17025d98-ab0b-4cdc-a13a-432b010ef718 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:04.886506 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-17025d98-ab0b-4cdc-a13a-432b010ef718 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:04.894443 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-17025d98-ab0b-4cdc-a13a-432b010ef718 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.084807 Mar 03 02:56:04.895000 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1507/2762] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:04 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:04.913116 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-44fa14f6-b36f-482a-a45a-3b50b0eeb322 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:04.913871 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-44fa14f6-b36f-482a-a45a-3b50b0eeb322 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:04.921329 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-44fa14f6-b36f-482a-a45a-3b50b0eeb322 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:04.921896 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-44fa14f6-b36f-482a-a45a-3b50b0eeb322 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:04.922814 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-44fa14f6-b36f-482a-a45a-3b50b0eeb322 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:04.923267 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-44fa14f6-b36f-482a-a45a-3b50b0eeb322 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:05.053118 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-44fa14f6-b36f-482a-a45a-3b50b0eeb322 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:05.060495 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-44fa14f6-b36f-482a-a45a-3b50b0eeb322 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.151162 Mar 03 02:56:05.061065 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1256/2763] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:04 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:05.066809 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a2f52d21-410b-4c4d-b293-7aee516bb5c3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:05.067414 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a2f52d21-410b-4c4d-b293-7aee516bb5c3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:05.073282 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a2f52d21-410b-4c4d-b293-7aee516bb5c3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:05.073755 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a2f52d21-410b-4c4d-b293-7aee516bb5c3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:05.074521 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a2f52d21-410b-4c4d-b293-7aee516bb5c3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:05.074950 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a2f52d21-410b-4c4d-b293-7aee516bb5c3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:05.207061 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a2f52d21-410b-4c4d-b293-7aee516bb5c3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:05.215002 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a2f52d21-410b-4c4d-b293-7aee516bb5c3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.152092 Mar 03 02:56:05.215658 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1508/2764] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:05 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:05.418247 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-be7c0ae7-b97f-45d9-9c34-64cd488b86fe tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:05.418777 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-be7c0ae7-b97f-45d9-9c34-64cd488b86fe tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:05.424938 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-be7c0ae7-b97f-45d9-9c34-64cd488b86fe tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:05.425392 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-be7c0ae7-b97f-45d9-9c34-64cd488b86fe tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:05.426171 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-be7c0ae7-b97f-45d9-9c34-64cd488b86fe tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:05.426644 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-be7c0ae7-b97f-45d9-9c34-64cd488b86fe tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:05.557175 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-be7c0ae7-b97f-45d9-9c34-64cd488b86fe tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:05.565478 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-be7c0ae7-b97f-45d9-9c34-64cd488b86fe tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.151307 Mar 03 02:56:05.566033 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1257/2765] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:05 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:05.911001 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8b94b8da-90eb-4c41-a6e3-2b83229256ac tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:05.911621 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8b94b8da-90eb-4c41-a6e3-2b83229256ac tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:05.917584 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b94b8da-90eb-4c41-a6e3-2b83229256ac tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:05.918027 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b94b8da-90eb-4c41-a6e3-2b83229256ac tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:05.918795 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b94b8da-90eb-4c41-a6e3-2b83229256ac tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:05.919226 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b94b8da-90eb-4c41-a6e3-2b83229256ac tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:05.979622 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8b94b8da-90eb-4c41-a6e3-2b83229256ac tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:05.988101 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8b94b8da-90eb-4c41-a6e3-2b83229256ac tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.081338 Mar 03 02:56:05.988659 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1509/2766] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:05 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:06.077669 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3948f5e0-7451-431b-8cc8-fdd9cd89bdb4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:06.078284 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3948f5e0-7451-431b-8cc8-fdd9cd89bdb4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:06.084149 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3948f5e0-7451-431b-8cc8-fdd9cd89bdb4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:06.084605 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3948f5e0-7451-431b-8cc8-fdd9cd89bdb4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:06.085392 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3948f5e0-7451-431b-8cc8-fdd9cd89bdb4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:06.085836 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3948f5e0-7451-431b-8cc8-fdd9cd89bdb4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:06.220729 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3948f5e0-7451-431b-8cc8-fdd9cd89bdb4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:06.228523 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3948f5e0-7451-431b-8cc8-fdd9cd89bdb4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.154838 Mar 03 02:56:06.229097 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1258/2767] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:06 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:06.233333 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a64c4a3a-b1b9-46b8-82a1-05b9b8cbb830 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:06.233934 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a64c4a3a-b1b9-46b8-82a1-05b9b8cbb830 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:06.240100 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a64c4a3a-b1b9-46b8-82a1-05b9b8cbb830 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:06.240545 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a64c4a3a-b1b9-46b8-82a1-05b9b8cbb830 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:06.241389 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a64c4a3a-b1b9-46b8-82a1-05b9b8cbb830 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:06.241863 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a64c4a3a-b1b9-46b8-82a1-05b9b8cbb830 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:06.381031 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a64c4a3a-b1b9-46b8-82a1-05b9b8cbb830 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:06.388611 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a64c4a3a-b1b9-46b8-82a1-05b9b8cbb830 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.160002 Mar 03 02:56:06.389176 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1510/2768] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:06 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:06.582811 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a7da2850-de7e-43c9-983e-be3aa79baf18 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:06.583422 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a7da2850-de7e-43c9-983e-be3aa79baf18 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:06.589732 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a7da2850-de7e-43c9-983e-be3aa79baf18 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:06.590184 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a7da2850-de7e-43c9-983e-be3aa79baf18 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:06.590992 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a7da2850-de7e-43c9-983e-be3aa79baf18 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:06.591431 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a7da2850-de7e-43c9-983e-be3aa79baf18 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:06.722206 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a7da2850-de7e-43c9-983e-be3aa79baf18 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:06.729999 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a7da2850-de7e-43c9-983e-be3aa79baf18 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.151094 Mar 03 02:56:06.730818 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1259/2769] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:06 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:07.004735 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-531cba93-cfde-4eb4-9212-ac32c694b96a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:07.005270 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-531cba93-cfde-4eb4-9212-ac32c694b96a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:07.011153 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-531cba93-cfde-4eb4-9212-ac32c694b96a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:07.011634 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-531cba93-cfde-4eb4-9212-ac32c694b96a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:07.012417 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-531cba93-cfde-4eb4-9212-ac32c694b96a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:07.012859 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-531cba93-cfde-4eb4-9212-ac32c694b96a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:07.071216 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-531cba93-cfde-4eb4-9212-ac32c694b96a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:07.079528 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-531cba93-cfde-4eb4-9212-ac32c694b96a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.078777 Mar 03 02:56:07.080119 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1511/2770] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:06 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:07.246213 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e7cd632b-d4aa-4bb7-92e6-8aca2681cda2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:07.246823 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e7cd632b-d4aa-4bb7-92e6-8aca2681cda2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:07.253346 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e7cd632b-d4aa-4bb7-92e6-8aca2681cda2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:07.253794 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e7cd632b-d4aa-4bb7-92e6-8aca2681cda2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:07.254598 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e7cd632b-d4aa-4bb7-92e6-8aca2681cda2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:07.255083 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e7cd632b-d4aa-4bb7-92e6-8aca2681cda2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:07.385951 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e7cd632b-d4aa-4bb7-92e6-8aca2681cda2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:07.393709 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e7cd632b-d4aa-4bb7-92e6-8aca2681cda2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.151351 Mar 03 02:56:07.394267 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1260/2771] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:07 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:07.405089 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7c58a7f7-0259-4fc7-a516-07ede3aadf5f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:07.405711 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7c58a7f7-0259-4fc7-a516-07ede3aadf5f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:07.411884 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c58a7f7-0259-4fc7-a516-07ede3aadf5f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:07.412338 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c58a7f7-0259-4fc7-a516-07ede3aadf5f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:07.413093 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c58a7f7-0259-4fc7-a516-07ede3aadf5f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:07.413522 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c58a7f7-0259-4fc7-a516-07ede3aadf5f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:07.542149 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-7c58a7f7-0259-4fc7-a516-07ede3aadf5f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:07.549839 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7c58a7f7-0259-4fc7-a516-07ede3aadf5f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.148643 Mar 03 02:56:07.550400 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1512/2772] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:07 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:07.748196 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0e1b7c25-ac2c-47e3-90bc-2ebdf080903c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:07.748938 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0e1b7c25-ac2c-47e3-90bc-2ebdf080903c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:07.755107 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0e1b7c25-ac2c-47e3-90bc-2ebdf080903c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:07.755555 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0e1b7c25-ac2c-47e3-90bc-2ebdf080903c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:07.756358 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0e1b7c25-ac2c-47e3-90bc-2ebdf080903c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:07.756789 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0e1b7c25-ac2c-47e3-90bc-2ebdf080903c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:07.887024 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0e1b7c25-ac2c-47e3-90bc-2ebdf080903c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:07.895634 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0e1b7c25-ac2c-47e3-90bc-2ebdf080903c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.151974 Mar 03 02:56:07.896189 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1261/2773] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:07 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:08.095857 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-bbb66808-ea9d-4ee2-b5f0-696d7e26d7e5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:08.096505 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-bbb66808-ea9d-4ee2-b5f0-696d7e26d7e5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:08.102372 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bbb66808-ea9d-4ee2-b5f0-696d7e26d7e5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:08.102830 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bbb66808-ea9d-4ee2-b5f0-696d7e26d7e5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:08.103631 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bbb66808-ea9d-4ee2-b5f0-696d7e26d7e5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:08.104077 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bbb66808-ea9d-4ee2-b5f0-696d7e26d7e5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:08.165732 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-bbb66808-ea9d-4ee2-b5f0-696d7e26d7e5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:08.174131 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-bbb66808-ea9d-4ee2-b5f0-696d7e26d7e5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.082195 Mar 03 02:56:08.174693 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1513/2774] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:08 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:08.411841 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4fd88274-e656-4237-af1c-cfdb20b84fe4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:08.412486 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4fd88274-e656-4237-af1c-cfdb20b84fe4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:08.418264 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4fd88274-e656-4237-af1c-cfdb20b84fe4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:08.418719 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4fd88274-e656-4237-af1c-cfdb20b84fe4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:08.420023 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4fd88274-e656-4237-af1c-cfdb20b84fe4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:08.420474 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4fd88274-e656-4237-af1c-cfdb20b84fe4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:08.552789 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4fd88274-e656-4237-af1c-cfdb20b84fe4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:08.561075 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4fd88274-e656-4237-af1c-cfdb20b84fe4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.153098 Mar 03 02:56:08.561618 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1262/2775] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:08 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:08.566224 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-50a8b19b-09bc-4045-99eb-23d39e65e77b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:08.566841 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-50a8b19b-09bc-4045-99eb-23d39e65e77b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:08.572987 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-50a8b19b-09bc-4045-99eb-23d39e65e77b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:08.573430 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-50a8b19b-09bc-4045-99eb-23d39e65e77b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:08.574202 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-50a8b19b-09bc-4045-99eb-23d39e65e77b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:08.574640 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-50a8b19b-09bc-4045-99eb-23d39e65e77b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:08.706323 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-50a8b19b-09bc-4045-99eb-23d39e65e77b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:08.713953 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-50a8b19b-09bc-4045-99eb-23d39e65e77b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.151570 Mar 03 02:56:08.714514 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1514/2776] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:08 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:08.912908 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-58a02991-5ad8-49ea-9447-9081f2278fd6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:08.913509 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-58a02991-5ad8-49ea-9447-9081f2278fd6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:08.920411 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-58a02991-5ad8-49ea-9447-9081f2278fd6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:08.920858 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-58a02991-5ad8-49ea-9447-9081f2278fd6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:08.921628 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-58a02991-5ad8-49ea-9447-9081f2278fd6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:08.922060 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-58a02991-5ad8-49ea-9447-9081f2278fd6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:09.051301 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-58a02991-5ad8-49ea-9447-9081f2278fd6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:09.059087 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-58a02991-5ad8-49ea-9447-9081f2278fd6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.150079 Mar 03 02:56:09.059670 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1263/2777] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:08 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:09.191024 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-efb29caa-5d7f-4300-af29-7e54017ae608 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:09.191654 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-efb29caa-5d7f-4300-af29-7e54017ae608 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:09.197497 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-efb29caa-5d7f-4300-af29-7e54017ae608 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:09.197948 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-efb29caa-5d7f-4300-af29-7e54017ae608 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:09.198715 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-efb29caa-5d7f-4300-af29-7e54017ae608 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:09.199147 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-efb29caa-5d7f-4300-af29-7e54017ae608 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:09.257833 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-efb29caa-5d7f-4300-af29-7e54017ae608 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:09.265408 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-efb29caa-5d7f-4300-af29-7e54017ae608 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.078227 Mar 03 02:56:09.265972 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1515/2778] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:09 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:09.578864 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-784c45b4-7547-4738-9c0b-482168471f27 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:09.579455 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-784c45b4-7547-4738-9c0b-482168471f27 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:09.585583 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-784c45b4-7547-4738-9c0b-482168471f27 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:09.586030 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-784c45b4-7547-4738-9c0b-482168471f27 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:09.586799 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-784c45b4-7547-4738-9c0b-482168471f27 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:09.587230 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-784c45b4-7547-4738-9c0b-482168471f27 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:09.717121 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-784c45b4-7547-4738-9c0b-482168471f27 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:09.724767 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-784c45b4-7547-4738-9c0b-482168471f27 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.150657 Mar 03 02:56:09.725334 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1264/2779] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:09 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:09.730170 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c8ed287c-d02c-421c-86a5-c0ccdb6d3ac2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:09.731038 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c8ed287c-d02c-421c-86a5-c0ccdb6d3ac2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:09.737371 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c8ed287c-d02c-421c-86a5-c0ccdb6d3ac2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:09.737825 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c8ed287c-d02c-421c-86a5-c0ccdb6d3ac2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:09.738598 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c8ed287c-d02c-421c-86a5-c0ccdb6d3ac2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:09.739035 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c8ed287c-d02c-421c-86a5-c0ccdb6d3ac2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:09.870398 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c8ed287c-d02c-421c-86a5-c0ccdb6d3ac2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:09.878005 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c8ed287c-d02c-421c-86a5-c0ccdb6d3ac2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.151703 Mar 03 02:56:09.878564 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1516/2780] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:09 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:10.077527 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8deeecc6-5377-475e-9e1a-f584bcd6352b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:10.078138 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8deeecc6-5377-475e-9e1a-f584bcd6352b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:10.084678 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8deeecc6-5377-475e-9e1a-f584bcd6352b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:10.085121 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8deeecc6-5377-475e-9e1a-f584bcd6352b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:10.085898 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8deeecc6-5377-475e-9e1a-f584bcd6352b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:10.086333 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8deeecc6-5377-475e-9e1a-f584bcd6352b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:10.220015 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8deeecc6-5377-475e-9e1a-f584bcd6352b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:10.227559 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8deeecc6-5377-475e-9e1a-f584bcd6352b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.154628 Mar 03 02:56:10.228165 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1265/2781] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:10 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:10.281952 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c35ee20c-f0a5-444d-b210-594cf601603c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:10.282562 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c35ee20c-f0a5-444d-b210-594cf601603c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:10.288385 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c35ee20c-f0a5-444d-b210-594cf601603c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:10.288844 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c35ee20c-f0a5-444d-b210-594cf601603c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:10.289622 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c35ee20c-f0a5-444d-b210-594cf601603c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:10.290064 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c35ee20c-f0a5-444d-b210-594cf601603c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:10.347571 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c35ee20c-f0a5-444d-b210-594cf601603c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:10.355080 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c35ee20c-f0a5-444d-b210-594cf601603c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.077190 Mar 03 02:56:10.356144 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1517/2782] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:10 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:10.742101 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-41e192c0-7bf6-46c7-bf03-9b2613d5da7f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:10.742712 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-41e192c0-7bf6-46c7-bf03-9b2613d5da7f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:10.749101 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-41e192c0-7bf6-46c7-bf03-9b2613d5da7f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:10.749555 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-41e192c0-7bf6-46c7-bf03-9b2613d5da7f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:10.750335 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-41e192c0-7bf6-46c7-bf03-9b2613d5da7f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:10.750775 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-41e192c0-7bf6-46c7-bf03-9b2613d5da7f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:10.879217 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-41e192c0-7bf6-46c7-bf03-9b2613d5da7f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:10.886972 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-41e192c0-7bf6-46c7-bf03-9b2613d5da7f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.148733 Mar 03 02:56:10.887536 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1266/2783] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:10 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:10.894260 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-976993ad-363c-428c-8b48-dacf17d7024e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:10.894862 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-976993ad-363c-428c-8b48-dacf17d7024e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:10.900958 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-976993ad-363c-428c-8b48-dacf17d7024e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:10.901403 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-976993ad-363c-428c-8b48-dacf17d7024e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:10.902173 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-976993ad-363c-428c-8b48-dacf17d7024e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:10.902674 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-976993ad-363c-428c-8b48-dacf17d7024e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:11.031748 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-976993ad-363c-428c-8b48-dacf17d7024e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:11.039286 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-976993ad-363c-428c-8b48-dacf17d7024e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.148835 Mar 03 02:56:11.039879 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1518/2784] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:10 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:11.245928 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-da8cc1db-16f3-47d4-938c-406608e7ca67 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:11.246508 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-da8cc1db-16f3-47d4-938c-406608e7ca67 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:11.252810 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-da8cc1db-16f3-47d4-938c-406608e7ca67 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:11.253263 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-da8cc1db-16f3-47d4-938c-406608e7ca67 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:11.254037 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-da8cc1db-16f3-47d4-938c-406608e7ca67 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:11.254477 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-da8cc1db-16f3-47d4-938c-406608e7ca67 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:11.372445 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1759f923-3858-4d89-b023-dbea4c99663a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:11.373635 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1759f923-3858-4d89-b023-dbea4c99663a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:11.379427 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1759f923-3858-4d89-b023-dbea4c99663a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:11.379908 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1759f923-3858-4d89-b023-dbea4c99663a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:11.380689 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1759f923-3858-4d89-b023-dbea4c99663a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:11.381128 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1759f923-3858-4d89-b023-dbea4c99663a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:11.388462 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-da8cc1db-16f3-47d4-938c-406608e7ca67 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:11.396694 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-da8cc1db-16f3-47d4-938c-406608e7ca67 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.154773 Mar 03 02:56:11.397262 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1267/2785] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:11 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:11.442914 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1759f923-3858-4d89-b023-dbea4c99663a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:11.451272 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1759f923-3858-4d89-b023-dbea4c99663a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.082018 Mar 03 02:56:11.451965 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1519/2786] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:11 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:11.906294 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9ce79c0b-c843-4e3c-9e96-1271b991918d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:11.906902 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9ce79c0b-c843-4e3c-9e96-1271b991918d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:11.913078 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9ce79c0b-c843-4e3c-9e96-1271b991918d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:11.913533 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9ce79c0b-c843-4e3c-9e96-1271b991918d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:11.914306 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9ce79c0b-c843-4e3c-9e96-1271b991918d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:11.914739 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9ce79c0b-c843-4e3c-9e96-1271b991918d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:12.050599 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9ce79c0b-c843-4e3c-9e96-1271b991918d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:12.058410 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5952d8cf-aa46-47d1-bcba-cfbb0f2fdbbf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:12.059022 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5952d8cf-aa46-47d1-bcba-cfbb0f2fdbbf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:12.059763 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9ce79c0b-c843-4e3c-9e96-1271b991918d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.157867 Mar 03 02:56:12.061101 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1268/2787] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:11 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:12.066019 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5952d8cf-aa46-47d1-bcba-cfbb0f2fdbbf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:12.066482 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5952d8cf-aa46-47d1-bcba-cfbb0f2fdbbf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:12.067270 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5952d8cf-aa46-47d1-bcba-cfbb0f2fdbbf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:12.067753 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5952d8cf-aa46-47d1-bcba-cfbb0f2fdbbf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:12.194245 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5952d8cf-aa46-47d1-bcba-cfbb0f2fdbbf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:12.201915 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5952d8cf-aa46-47d1-bcba-cfbb0f2fdbbf tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.148488 Mar 03 02:56:12.202480 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1520/2788] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:12 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:12.414835 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7f145184-fb87-4aea-a849-c58738bf136e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:12.415435 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7f145184-fb87-4aea-a849-c58738bf136e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:12.422305 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7f145184-fb87-4aea-a849-c58738bf136e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:12.422755 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7f145184-fb87-4aea-a849-c58738bf136e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:12.423523 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7f145184-fb87-4aea-a849-c58738bf136e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:12.423984 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7f145184-fb87-4aea-a849-c58738bf136e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:12.468304 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a7a47ee8-d553-4b9c-abbc-a4b98062fcd5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:12.468841 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a7a47ee8-d553-4b9c-abbc-a4b98062fcd5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:12.474527 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a7a47ee8-d553-4b9c-abbc-a4b98062fcd5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:12.474980 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a7a47ee8-d553-4b9c-abbc-a4b98062fcd5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:12.475794 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a7a47ee8-d553-4b9c-abbc-a4b98062fcd5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:12.476233 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a7a47ee8-d553-4b9c-abbc-a4b98062fcd5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:12.536669 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a7a47ee8-d553-4b9c-abbc-a4b98062fcd5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:12.545091 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a7a47ee8-d553-4b9c-abbc-a4b98062fcd5 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080672 Mar 03 02:56:12.545833 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1521/2789] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:12 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:12.558153 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-7f145184-fb87-4aea-a849-c58738bf136e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:12.566014 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7f145184-fb87-4aea-a849-c58738bf136e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.155073 Mar 03 02:56:12.566574 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1269/2790] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:12 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:13.078473 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-45bcf526-ad35-4dcf-b955-99ab70c1f95b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:13.079072 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-45bcf526-ad35-4dcf-b955-99ab70c1f95b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:13.085291 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-45bcf526-ad35-4dcf-b955-99ab70c1f95b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:13.085724 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-45bcf526-ad35-4dcf-b955-99ab70c1f95b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:13.086504 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-45bcf526-ad35-4dcf-b955-99ab70c1f95b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:13.086937 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-45bcf526-ad35-4dcf-b955-99ab70c1f95b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:13.218266 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-45bcf526-ad35-4dcf-b955-99ab70c1f95b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:13.220046 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0ee15965-3b31-499f-99cc-5c11616dd378 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:13.220665 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0ee15965-3b31-499f-99cc-5c11616dd378 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:13.225971 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-45bcf526-ad35-4dcf-b955-99ab70c1f95b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.152074 Mar 03 02:56:13.226356 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0ee15965-3b31-499f-99cc-5c11616dd378 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:13.227243 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0ee15965-3b31-499f-99cc-5c11616dd378 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:13.227432 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1522/2791] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:13 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:13.227617 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0ee15965-3b31-499f-99cc-5c11616dd378 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:13.228063 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0ee15965-3b31-499f-99cc-5c11616dd378 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:13.358083 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0ee15965-3b31-499f-99cc-5c11616dd378 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:13.365805 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0ee15965-3b31-499f-99cc-5c11616dd378 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.150835 Mar 03 02:56:13.366373 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1270/2792] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:13 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:13.562646 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1bc5c42c-6694-43c0-bfb2-0c696ead4c80 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:13.563174 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1bc5c42c-6694-43c0-bfb2-0c696ead4c80 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:13.569018 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1bc5c42c-6694-43c0-bfb2-0c696ead4c80 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:13.569473 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1bc5c42c-6694-43c0-bfb2-0c696ead4c80 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:13.570248 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1bc5c42c-6694-43c0-bfb2-0c696ead4c80 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:13.570686 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1bc5c42c-6694-43c0-bfb2-0c696ead4c80 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:13.582659 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-767dd201-87a8-4e62-8b4e-aee6c1c6a8cb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:13.583276 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-767dd201-87a8-4e62-8b4e-aee6c1c6a8cb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:13.589454 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-767dd201-87a8-4e62-8b4e-aee6c1c6a8cb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:13.589897 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-767dd201-87a8-4e62-8b4e-aee6c1c6a8cb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:13.590667 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-767dd201-87a8-4e62-8b4e-aee6c1c6a8cb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:13.591097 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-767dd201-87a8-4e62-8b4e-aee6c1c6a8cb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:13.630886 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1bc5c42c-6694-43c0-bfb2-0c696ead4c80 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:13.638745 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1bc5c42c-6694-43c0-bfb2-0c696ead4c80 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080823 Mar 03 02:56:13.639315 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1523/2793] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:13 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:13.725280 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-767dd201-87a8-4e62-8b4e-aee6c1c6a8cb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:13.733836 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-767dd201-87a8-4e62-8b4e-aee6c1c6a8cb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.155329 Mar 03 02:56:13.734400 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1271/2794] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:13 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:14.244155 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-80cfc868-c6b0-43d1-9b5d-93392c0087a8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:14.244689 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-80cfc868-c6b0-43d1-9b5d-93392c0087a8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:14.251352 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-80cfc868-c6b0-43d1-9b5d-93392c0087a8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:14.252192 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-80cfc868-c6b0-43d1-9b5d-93392c0087a8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:14.252973 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-80cfc868-c6b0-43d1-9b5d-93392c0087a8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:14.253412 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-80cfc868-c6b0-43d1-9b5d-93392c0087a8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:14.381830 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-80cfc868-c6b0-43d1-9b5d-93392c0087a8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:14.382122 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9b5952a9-6613-4a14-8870-6b23e69a2309 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:14.382742 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9b5952a9-6613-4a14-8870-6b23e69a2309 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:14.389034 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9b5952a9-6613-4a14-8870-6b23e69a2309 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:14.389657 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9b5952a9-6613-4a14-8870-6b23e69a2309 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:14.390447 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9b5952a9-6613-4a14-8870-6b23e69a2309 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:14.390581 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-80cfc868-c6b0-43d1-9b5d-93392c0087a8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.150252 Mar 03 02:56:14.390889 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9b5952a9-6613-4a14-8870-6b23e69a2309 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:14.391359 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1524/2795] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:14 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:14.525094 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9b5952a9-6613-4a14-8870-6b23e69a2309 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:14.533624 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9b5952a9-6613-4a14-8870-6b23e69a2309 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.155399 Mar 03 02:56:14.534187 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1272/2796] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:14 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:14.655477 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5a87dfb7-3827-40a8-b909-1e5a0e214d7a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:14.656121 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5a87dfb7-3827-40a8-b909-1e5a0e214d7a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:14.661819 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5a87dfb7-3827-40a8-b909-1e5a0e214d7a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:14.662267 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5a87dfb7-3827-40a8-b909-1e5a0e214d7a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:14.663051 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5a87dfb7-3827-40a8-b909-1e5a0e214d7a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:14.663491 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5a87dfb7-3827-40a8-b909-1e5a0e214d7a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:14.725478 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5a87dfb7-3827-40a8-b909-1e5a0e214d7a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:14.733999 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5a87dfb7-3827-40a8-b909-1e5a0e214d7a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.082875 Mar 03 02:56:14.734571 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1525/2797] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:14 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:14.750894 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6ce86175-7ca7-45ca-b42e-f40b9464b3df tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:14.751495 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6ce86175-7ca7-45ca-b42e-f40b9464b3df tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:14.757734 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6ce86175-7ca7-45ca-b42e-f40b9464b3df tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:14.758180 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6ce86175-7ca7-45ca-b42e-f40b9464b3df tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:14.758951 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6ce86175-7ca7-45ca-b42e-f40b9464b3df tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:14.759382 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6ce86175-7ca7-45ca-b42e-f40b9464b3df tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:14.891152 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-6ce86175-7ca7-45ca-b42e-f40b9464b3df tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:14.898776 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6ce86175-7ca7-45ca-b42e-f40b9464b3df tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.152186 Mar 03 02:56:14.899339 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1273/2798] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:14 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:15.408358 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-51250e0f-777c-4ab1-baac-a00086a67a84 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:15.408966 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-51250e0f-777c-4ab1-baac-a00086a67a84 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:15.415165 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-51250e0f-777c-4ab1-baac-a00086a67a84 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:15.415688 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-51250e0f-777c-4ab1-baac-a00086a67a84 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:15.416415 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-51250e0f-777c-4ab1-baac-a00086a67a84 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:15.416847 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-51250e0f-777c-4ab1-baac-a00086a67a84 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:15.551735 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a1872e70-da57-477a-aaff-d8cd5b13ff29 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:15.552344 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a1872e70-da57-477a-aaff-d8cd5b13ff29 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:15.558517 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a1872e70-da57-477a-aaff-d8cd5b13ff29 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:15.558979 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a1872e70-da57-477a-aaff-d8cd5b13ff29 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:15.559832 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a1872e70-da57-477a-aaff-d8cd5b13ff29 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:15.560287 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a1872e70-da57-477a-aaff-d8cd5b13ff29 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:15.699993 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a1872e70-da57-477a-aaff-d8cd5b13ff29 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:15.708448 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a1872e70-da57-477a-aaff-d8cd5b13ff29 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.161016 Mar 03 02:56:15.709019 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1274/2799] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:15 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:15.750094 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-eb74b423-0a23-4597-b440-a0c216e6f38b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:15.750824 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-eb74b423-0a23-4597-b440-a0c216e6f38b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:15.756954 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eb74b423-0a23-4597-b440-a0c216e6f38b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:15.757405 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eb74b423-0a23-4597-b440-a0c216e6f38b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:15.758180 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eb74b423-0a23-4597-b440-a0c216e6f38b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:15.758616 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eb74b423-0a23-4597-b440-a0c216e6f38b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:15.781900 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-51250e0f-777c-4ab1-baac-a00086a67a84 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:15.789712 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-51250e0f-777c-4ab1-baac-a00086a67a84 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.385967 Mar 03 02:56:15.790287 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1526/2800] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:15 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:15.818211 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-eb74b423-0a23-4597-b440-a0c216e6f38b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:15.826411 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-eb74b423-0a23-4597-b440-a0c216e6f38b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080215 Mar 03 02:56:15.826971 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1275/2801] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:15 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:15.915868 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b0e02d31-e661-4f43-a0b2-6b3c75dbc776 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:15.916481 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b0e02d31-e661-4f43-a0b2-6b3c75dbc776 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:15.922327 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b0e02d31-e661-4f43-a0b2-6b3c75dbc776 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:15.922774 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b0e02d31-e661-4f43-a0b2-6b3c75dbc776 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:15.923539 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b0e02d31-e661-4f43-a0b2-6b3c75dbc776 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:15.924001 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b0e02d31-e661-4f43-a0b2-6b3c75dbc776 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:16.054652 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b0e02d31-e661-4f43-a0b2-6b3c75dbc776 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:16.062931 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b0e02d31-e661-4f43-a0b2-6b3c75dbc776 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.150914 Mar 03 02:56:16.063497 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1527/2802] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:15 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:16.725288 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c3b2139c-0c18-478a-880f-9ada2edc1d6f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:16.725902 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c3b2139c-0c18-478a-880f-9ada2edc1d6f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:16.732165 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c3b2139c-0c18-478a-880f-9ada2edc1d6f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:16.732688 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c3b2139c-0c18-478a-880f-9ada2edc1d6f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:16.733478 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c3b2139c-0c18-478a-880f-9ada2edc1d6f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:16.733923 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c3b2139c-0c18-478a-880f-9ada2edc1d6f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:16.806228 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a38b77b6-e802-4878-b918-4cf09b4e7225 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:16.806849 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a38b77b6-e802-4878-b918-4cf09b4e7225 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:16.813838 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a38b77b6-e802-4878-b918-4cf09b4e7225 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:16.814459 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a38b77b6-e802-4878-b918-4cf09b4e7225 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:16.815070 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a38b77b6-e802-4878-b918-4cf09b4e7225 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:16.815527 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a38b77b6-e802-4878-b918-4cf09b4e7225 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:16.865884 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c3b2139c-0c18-478a-880f-9ada2edc1d6f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:16.874391 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c3b2139c-0c18-478a-880f-9ada2edc1d6f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.153034 Mar 03 02:56:16.874959 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1276/2803] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:16 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:16.879408 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9ae95621-131a-407b-a073-4f7c4f4f3ca2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:16.880034 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9ae95621-131a-407b-a073-4f7c4f4f3ca2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:16.885523 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9ae95621-131a-407b-a073-4f7c4f4f3ca2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:16.885966 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9ae95621-131a-407b-a073-4f7c4f4f3ca2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:16.886738 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9ae95621-131a-407b-a073-4f7c4f4f3ca2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:16.887167 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9ae95621-131a-407b-a073-4f7c4f4f3ca2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:16.946040 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9ae95621-131a-407b-a073-4f7c4f4f3ca2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:16.951843 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a38b77b6-e802-4878-b918-4cf09b4e7225 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:16.955030 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9ae95621-131a-407b-a073-4f7c4f4f3ca2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079103 Mar 03 02:56:16.955623 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1277/2804] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:16 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:16.959526 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a38b77b6-e802-4878-b918-4cf09b4e7225 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.157166 Mar 03 02:56:16.960132 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1528/2805] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:16 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:17.080036 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-66936457-c9e1-424e-bfff-20eaef71f96c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:17.080646 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-66936457-c9e1-424e-bfff-20eaef71f96c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:17.086541 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-66936457-c9e1-424e-bfff-20eaef71f96c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:17.086994 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-66936457-c9e1-424e-bfff-20eaef71f96c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:17.087806 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-66936457-c9e1-424e-bfff-20eaef71f96c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:17.088247 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-66936457-c9e1-424e-bfff-20eaef71f96c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:17.221167 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-66936457-c9e1-424e-bfff-20eaef71f96c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:17.228765 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-66936457-c9e1-424e-bfff-20eaef71f96c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.153744 Mar 03 02:56:17.229333 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1278/2806] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:17 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:17.892221 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-250ba815-1bcd-43a6-87c4-70f9fbadbae9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:17.892823 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-250ba815-1bcd-43a6-87c4-70f9fbadbae9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:17.899048 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-250ba815-1bcd-43a6-87c4-70f9fbadbae9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:17.899501 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-250ba815-1bcd-43a6-87c4-70f9fbadbae9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:17.900314 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-250ba815-1bcd-43a6-87c4-70f9fbadbae9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:17.900753 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-250ba815-1bcd-43a6-87c4-70f9fbadbae9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:17.973167 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4ef265ff-4899-42d0-a4f8-925f48d0084a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:17.973919 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4ef265ff-4899-42d0-a4f8-925f48d0084a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:17.980113 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4ef265ff-4899-42d0-a4f8-925f48d0084a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:17.980892 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4ef265ff-4899-42d0-a4f8-925f48d0084a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:17.981805 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4ef265ff-4899-42d0-a4f8-925f48d0084a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:17.982268 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4ef265ff-4899-42d0-a4f8-925f48d0084a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:18.035161 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-250ba815-1bcd-43a6-87c4-70f9fbadbae9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:18.041559 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4ef265ff-4899-42d0-a4f8-925f48d0084a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:18.043115 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-250ba815-1bcd-43a6-87c4-70f9fbadbae9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.155845 Mar 03 02:56:18.043703 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1529/2807] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:17 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:18.048267 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-bb250dbf-d7f3-4cc0-9c16-fd26c8054b5b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:18.048872 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-bb250dbf-d7f3-4cc0-9c16-fd26c8054b5b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:18.050088 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4ef265ff-4899-42d0-a4f8-925f48d0084a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.082603 Mar 03 02:56:18.050826 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1279/2808] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:17 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:18.054958 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bb250dbf-d7f3-4cc0-9c16-fd26c8054b5b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:18.055478 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bb250dbf-d7f3-4cc0-9c16-fd26c8054b5b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:18.056378 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bb250dbf-d7f3-4cc0-9c16-fd26c8054b5b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:18.056896 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bb250dbf-d7f3-4cc0-9c16-fd26c8054b5b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:18.189261 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-bb250dbf-d7f3-4cc0-9c16-fd26c8054b5b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:18.196945 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-bb250dbf-d7f3-4cc0-9c16-fd26c8054b5b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.152273 Mar 03 02:56:18.197518 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1530/2809] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:18 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:18.246163 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-96b3ddac-9ca1-4d1d-9887-28ade76ed294 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:18.246774 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-96b3ddac-9ca1-4d1d-9887-28ade76ed294 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:18.253114 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-96b3ddac-9ca1-4d1d-9887-28ade76ed294 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:18.253570 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-96b3ddac-9ca1-4d1d-9887-28ade76ed294 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:18.254358 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-96b3ddac-9ca1-4d1d-9887-28ade76ed294 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:18.254798 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-96b3ddac-9ca1-4d1d-9887-28ade76ed294 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:18.389072 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-96b3ddac-9ca1-4d1d-9887-28ade76ed294 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:18.396666 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-96b3ddac-9ca1-4d1d-9887-28ade76ed294 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.154403 Mar 03 02:56:18.397211 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1280/2810] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:18 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:19.059976 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-78dda28f-c78e-4554-adc6-d40d8d4939f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:19.060584 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-78dda28f-c78e-4554-adc6-d40d8d4939f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:19.065964 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b9368c9d-8ca1-41b7-8cde-eb1e48b47035 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:19.066621 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b9368c9d-8ca1-41b7-8cde-eb1e48b47035 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:19.067201 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-78dda28f-c78e-4554-adc6-d40d8d4939f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:19.067672 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-78dda28f-c78e-4554-adc6-d40d8d4939f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:19.068452 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-78dda28f-c78e-4554-adc6-d40d8d4939f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:19.068883 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-78dda28f-c78e-4554-adc6-d40d8d4939f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:19.072778 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b9368c9d-8ca1-41b7-8cde-eb1e48b47035 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:19.073230 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b9368c9d-8ca1-41b7-8cde-eb1e48b47035 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:19.074037 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b9368c9d-8ca1-41b7-8cde-eb1e48b47035 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:19.074465 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b9368c9d-8ca1-41b7-8cde-eb1e48b47035 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:19.132713 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b9368c9d-8ca1-41b7-8cde-eb1e48b47035 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:19.140377 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b9368c9d-8ca1-41b7-8cde-eb1e48b47035 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.078189 Mar 03 02:56:19.140972 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1281/2811] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:19 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:19.199308 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-78dda28f-c78e-4554-adc6-d40d8d4939f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:19.207442 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-78dda28f-c78e-4554-adc6-d40d8d4939f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.151330 Mar 03 02:56:19.208289 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1531/2812] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:19 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:19.214023 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-eb37879f-367c-4b66-bf9b-7e16cdb9e560 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:19.214713 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-eb37879f-367c-4b66-bf9b-7e16cdb9e560 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:19.220895 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eb37879f-367c-4b66-bf9b-7e16cdb9e560 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:19.221357 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eb37879f-367c-4b66-bf9b-7e16cdb9e560 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:19.222143 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eb37879f-367c-4b66-bf9b-7e16cdb9e560 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:19.222586 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eb37879f-367c-4b66-bf9b-7e16cdb9e560 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:19.354156 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-eb37879f-367c-4b66-bf9b-7e16cdb9e560 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:19.362633 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-eb37879f-367c-4b66-bf9b-7e16cdb9e560 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.152378 Mar 03 02:56:19.363198 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1282/2813] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:19 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:19.412467 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4e82070a-e60a-4e86-aa80-5d83ccc9e72e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:19.413075 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4e82070a-e60a-4e86-aa80-5d83ccc9e72e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:19.418737 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4e82070a-e60a-4e86-aa80-5d83ccc9e72e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:19.420337 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4e82070a-e60a-4e86-aa80-5d83ccc9e72e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:19.421120 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4e82070a-e60a-4e86-aa80-5d83ccc9e72e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:19.421563 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4e82070a-e60a-4e86-aa80-5d83ccc9e72e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:19.553876 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4e82070a-e60a-4e86-aa80-5d83ccc9e72e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:19.562334 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4e82070a-e60a-4e86-aa80-5d83ccc9e72e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.153664 Mar 03 02:56:19.562896 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1532/2814] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:19 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:20.158304 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-46725ce8-a4f0-44e4-bd72-62c694f4b353 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:20.158956 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-46725ce8-a4f0-44e4-bd72-62c694f4b353 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:20.165214 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-46725ce8-a4f0-44e4-bd72-62c694f4b353 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:20.165666 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-46725ce8-a4f0-44e4-bd72-62c694f4b353 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:20.166445 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-46725ce8-a4f0-44e4-bd72-62c694f4b353 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:20.166883 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-46725ce8-a4f0-44e4-bd72-62c694f4b353 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:20.224875 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d8fa7154-d10b-441e-bdd6-ffc078fec048 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:20.225495 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d8fa7154-d10b-441e-bdd6-ffc078fec048 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:20.225740 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-46725ce8-a4f0-44e4-bd72-62c694f4b353 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:20.233082 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d8fa7154-d10b-441e-bdd6-ffc078fec048 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:20.233540 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d8fa7154-d10b-441e-bdd6-ffc078fec048 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:20.234321 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d8fa7154-d10b-441e-bdd6-ffc078fec048 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:20.234477 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-46725ce8-a4f0-44e4-bd72-62c694f4b353 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.081154 Mar 03 02:56:20.234777 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d8fa7154-d10b-441e-bdd6-ffc078fec048 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:20.235047 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1283/2815] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:20 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:20.362220 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d8fa7154-d10b-441e-bdd6-ffc078fec048 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:20.369771 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d8fa7154-d10b-441e-bdd6-ffc078fec048 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.148798 Mar 03 02:56:20.370334 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1533/2816] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:20 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:20.379590 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9e16da2c-3bed-46c3-8edc-1cc402e70d96 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:20.380218 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9e16da2c-3bed-46c3-8edc-1cc402e70d96 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:20.385921 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9e16da2c-3bed-46c3-8edc-1cc402e70d96 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:20.386372 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9e16da2c-3bed-46c3-8edc-1cc402e70d96 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:20.387145 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9e16da2c-3bed-46c3-8edc-1cc402e70d96 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:20.387585 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9e16da2c-3bed-46c3-8edc-1cc402e70d96 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:20.520718 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9e16da2c-3bed-46c3-8edc-1cc402e70d96 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:20.529017 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9e16da2c-3bed-46c3-8edc-1cc402e70d96 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.152662 Mar 03 02:56:20.529673 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1284/2817] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:20 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:20.579452 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a1fee715-31ed-48c6-86cd-d2c2c09ee2d8 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:20.580088 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a1fee715-31ed-48c6-86cd-d2c2c09ee2d8 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:20.585818 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a1fee715-31ed-48c6-86cd-d2c2c09ee2d8 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:20.586266 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a1fee715-31ed-48c6-86cd-d2c2c09ee2d8 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:20.587055 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a1fee715-31ed-48c6-86cd-d2c2c09ee2d8 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:20.587489 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a1fee715-31ed-48c6-86cd-d2c2c09ee2d8 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:20.714126 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a1fee715-31ed-48c6-86cd-d2c2c09ee2d8 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:20.721832 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a1fee715-31ed-48c6-86cd-d2c2c09ee2d8 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.146973 Mar 03 02:56:20.722398 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1534/2818] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:20 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:21.250968 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6a3c9a74-fb2a-4df8-822c-0c2487850ab3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:21.251572 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6a3c9a74-fb2a-4df8-822c-0c2487850ab3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:21.257775 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6a3c9a74-fb2a-4df8-822c-0c2487850ab3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:21.258228 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6a3c9a74-fb2a-4df8-822c-0c2487850ab3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:21.259010 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6a3c9a74-fb2a-4df8-822c-0c2487850ab3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:21.259450 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6a3c9a74-fb2a-4df8-822c-0c2487850ab3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:21.318636 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-6a3c9a74-fb2a-4df8-822c-0c2487850ab3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:21.326804 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6a3c9a74-fb2a-4df8-822c-0c2487850ab3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079742 Mar 03 02:56:21.327368 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1285/2819] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:21 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:21.387157 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-580faadc-6d1d-40d4-9c16-37e805ca425c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:21.387849 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-580faadc-6d1d-40d4-9c16-37e805ca425c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:21.394693 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-580faadc-6d1d-40d4-9c16-37e805ca425c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:21.395153 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-580faadc-6d1d-40d4-9c16-37e805ca425c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:21.395961 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-580faadc-6d1d-40d4-9c16-37e805ca425c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:21.396403 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-580faadc-6d1d-40d4-9c16-37e805ca425c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:21.529421 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-580faadc-6d1d-40d4-9c16-37e805ca425c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:21.537098 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-580faadc-6d1d-40d4-9c16-37e805ca425c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.153875 Mar 03 02:56:21.537665 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1535/2820] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:21 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:21.545540 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-91cd740a-4498-4532-b91b-837ddb5be0d0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:21.546148 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-91cd740a-4498-4532-b91b-837ddb5be0d0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:21.551838 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-91cd740a-4498-4532-b91b-837ddb5be0d0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:21.552320 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-91cd740a-4498-4532-b91b-837ddb5be0d0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:21.553097 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-91cd740a-4498-4532-b91b-837ddb5be0d0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:21.553532 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-91cd740a-4498-4532-b91b-837ddb5be0d0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:21.681467 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-91cd740a-4498-4532-b91b-837ddb5be0d0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:21.690272 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-91cd740a-4498-4532-b91b-837ddb5be0d0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.148636 Mar 03 02:56:21.695749 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1286/2821] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:21 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:21.738817 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d3e1439b-a456-4c6a-930e-ab6c828f9a7c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:21.739463 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d3e1439b-a456-4c6a-930e-ab6c828f9a7c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:21.745294 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d3e1439b-a456-4c6a-930e-ab6c828f9a7c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:21.745752 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d3e1439b-a456-4c6a-930e-ab6c828f9a7c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:21.746532 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d3e1439b-a456-4c6a-930e-ab6c828f9a7c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:21.746974 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d3e1439b-a456-4c6a-930e-ab6c828f9a7c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:21.879863 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d3e1439b-a456-4c6a-930e-ab6c828f9a7c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:21.887534 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d3e1439b-a456-4c6a-930e-ab6c828f9a7c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.152564 Mar 03 02:56:21.888599 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1536/2822] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:21 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:22.343597 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0d91c57a-00d9-48a8-844e-ac4786350a28 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:22.344235 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0d91c57a-00d9-48a8-844e-ac4786350a28 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:22.350498 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0d91c57a-00d9-48a8-844e-ac4786350a28 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:22.350958 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0d91c57a-00d9-48a8-844e-ac4786350a28 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:22.351782 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0d91c57a-00d9-48a8-844e-ac4786350a28 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:22.352226 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0d91c57a-00d9-48a8-844e-ac4786350a28 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:22.415442 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0d91c57a-00d9-48a8-844e-ac4786350a28 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:22.424079 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0d91c57a-00d9-48a8-844e-ac4786350a28 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.084456 Mar 03 02:56:22.424639 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1287/2823] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:22 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:22.554419 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f6d899c4-de62-4151-9024-548bffadfa54 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:22.555059 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f6d899c4-de62-4151-9024-548bffadfa54 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:22.562036 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f6d899c4-de62-4151-9024-548bffadfa54 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:22.562501 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f6d899c4-de62-4151-9024-548bffadfa54 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:22.563261 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f6d899c4-de62-4151-9024-548bffadfa54 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:22.563723 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f6d899c4-de62-4151-9024-548bffadfa54 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:22.693699 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f6d899c4-de62-4151-9024-548bffadfa54 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:22.701999 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f6d899c4-de62-4151-9024-548bffadfa54 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.151378 Mar 03 02:56:22.702576 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1537/2824] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:22 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:22.707582 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a46f4c40-c41f-405d-abae-e564bf3473ba tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:22.708219 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a46f4c40-c41f-405d-abae-e564bf3473ba tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:22.715057 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a46f4c40-c41f-405d-abae-e564bf3473ba tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:22.715518 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a46f4c40-c41f-405d-abae-e564bf3473ba tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:22.716882 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a46f4c40-c41f-405d-abae-e564bf3473ba tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:22.717324 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a46f4c40-c41f-405d-abae-e564bf3473ba tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:22.846866 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a46f4c40-c41f-405d-abae-e564bf3473ba tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:22.854515 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a46f4c40-c41f-405d-abae-e564bf3473ba tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.150950 Mar 03 02:56:22.855079 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1288/2825] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:22 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:22.905607 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b794ac9b-6a4d-413f-941f-9c7fe2c57166 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:22.906054 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b794ac9b-6a4d-413f-941f-9c7fe2c57166 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:22.912517 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b794ac9b-6a4d-413f-941f-9c7fe2c57166 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:22.912977 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b794ac9b-6a4d-413f-941f-9c7fe2c57166 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:22.913760 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b794ac9b-6a4d-413f-941f-9c7fe2c57166 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:22.914202 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b794ac9b-6a4d-413f-941f-9c7fe2c57166 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:23.046244 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b794ac9b-6a4d-413f-941f-9c7fe2c57166 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:23.054367 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b794ac9b-6a4d-413f-941f-9c7fe2c57166 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.153293 Mar 03 02:56:23.054950 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1538/2826] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:22 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:23.440565 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-01e5e837-cefa-4882-bb1f-51709eaf4c33 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:23.441185 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-01e5e837-cefa-4882-bb1f-51709eaf4c33 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:23.447435 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-01e5e837-cefa-4882-bb1f-51709eaf4c33 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:23.447995 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-01e5e837-cefa-4882-bb1f-51709eaf4c33 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:23.448784 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-01e5e837-cefa-4882-bb1f-51709eaf4c33 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:23.449226 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-01e5e837-cefa-4882-bb1f-51709eaf4c33 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:23.509056 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-01e5e837-cefa-4882-bb1f-51709eaf4c33 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:23.517559 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-01e5e837-cefa-4882-bb1f-51709eaf4c33 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080885 Mar 03 02:56:23.518126 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1289/2827] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:23 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:23.718879 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b14ca172-e659-4d65-a47e-1a85adaf0cb1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:23.720134 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b14ca172-e659-4d65-a47e-1a85adaf0cb1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:23.726295 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b14ca172-e659-4d65-a47e-1a85adaf0cb1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:23.726750 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b14ca172-e659-4d65-a47e-1a85adaf0cb1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:23.727534 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b14ca172-e659-4d65-a47e-1a85adaf0cb1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:23.727998 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b14ca172-e659-4d65-a47e-1a85adaf0cb1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:23.859531 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b14ca172-e659-4d65-a47e-1a85adaf0cb1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:23.867362 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b14ca172-e659-4d65-a47e-1a85adaf0cb1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.152882 Mar 03 02:56:23.867967 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1539/2828] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:23 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:23.872668 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5504be31-75f0-43b4-a0b7-da0880a6bf42 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:23.873314 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5504be31-75f0-43b4-a0b7-da0880a6bf42 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:23.879056 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5504be31-75f0-43b4-a0b7-da0880a6bf42 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:23.879505 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5504be31-75f0-43b4-a0b7-da0880a6bf42 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:23.880312 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5504be31-75f0-43b4-a0b7-da0880a6bf42 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:23.880744 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5504be31-75f0-43b4-a0b7-da0880a6bf42 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:24.013489 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5504be31-75f0-43b4-a0b7-da0880a6bf42 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:24.021310 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5504be31-75f0-43b4-a0b7-da0880a6bf42 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.152659 Mar 03 02:56:24.021876 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1290/2829] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:23 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:24.071325 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7f762ba1-3cb0-4442-b73e-59fcf14728f2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:24.071970 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7f762ba1-3cb0-4442-b73e-59fcf14728f2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:24.078608 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7f762ba1-3cb0-4442-b73e-59fcf14728f2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:24.079050 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7f762ba1-3cb0-4442-b73e-59fcf14728f2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:24.079904 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7f762ba1-3cb0-4442-b73e-59fcf14728f2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:24.080342 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7f762ba1-3cb0-4442-b73e-59fcf14728f2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:24.210722 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-7f762ba1-3cb0-4442-b73e-59fcf14728f2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:24.218563 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7f762ba1-3cb0-4442-b73e-59fcf14728f2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.151052 Mar 03 02:56:24.219158 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1540/2830] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:24 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:24.533975 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-04910897-ee57-497e-8fe8-ea37606b8c41 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:24.534687 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-04910897-ee57-497e-8fe8-ea37606b8c41 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:24.540897 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-04910897-ee57-497e-8fe8-ea37606b8c41 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:24.541358 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-04910897-ee57-497e-8fe8-ea37606b8c41 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:24.542165 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-04910897-ee57-497e-8fe8-ea37606b8c41 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:24.542602 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-04910897-ee57-497e-8fe8-ea37606b8c41 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:24.600660 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-04910897-ee57-497e-8fe8-ea37606b8c41 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:24.609073 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-04910897-ee57-497e-8fe8-ea37606b8c41 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079006 Mar 03 02:56:24.609636 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1291/2831] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:24 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:24.884440 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-87ed8c8f-2dd8-45c3-afab-f229f3ad550e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:24.885045 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-87ed8c8f-2dd8-45c3-afab-f229f3ad550e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:24.891348 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-87ed8c8f-2dd8-45c3-afab-f229f3ad550e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:24.891833 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-87ed8c8f-2dd8-45c3-afab-f229f3ad550e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:24.892602 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-87ed8c8f-2dd8-45c3-afab-f229f3ad550e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:24.893032 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-87ed8c8f-2dd8-45c3-afab-f229f3ad550e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:25.023809 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-87ed8c8f-2dd8-45c3-afab-f229f3ad550e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:25.032021 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-87ed8c8f-2dd8-45c3-afab-f229f3ad550e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.151386 Mar 03 02:56:25.032586 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1541/2832] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:24 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:25.038189 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4150d654-dda0-4526-ab2c-468dd1b31c5e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:25.038830 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4150d654-dda0-4526-ab2c-468dd1b31c5e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:25.045551 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4150d654-dda0-4526-ab2c-468dd1b31c5e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:25.046003 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4150d654-dda0-4526-ab2c-468dd1b31c5e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:25.046786 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4150d654-dda0-4526-ab2c-468dd1b31c5e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:25.047228 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4150d654-dda0-4526-ab2c-468dd1b31c5e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:25.175571 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4150d654-dda0-4526-ab2c-468dd1b31c5e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:25.183200 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4150d654-dda0-4526-ab2c-468dd1b31c5e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.148814 Mar 03 02:56:25.183788 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1292/2833] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:25 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:25.236441 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8cc796b9-c5af-4a2a-af62-2b38bbf85d6b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:25.237076 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8cc796b9-c5af-4a2a-af62-2b38bbf85d6b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:25.242803 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8cc796b9-c5af-4a2a-af62-2b38bbf85d6b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:25.243252 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8cc796b9-c5af-4a2a-af62-2b38bbf85d6b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:25.244049 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8cc796b9-c5af-4a2a-af62-2b38bbf85d6b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:25.244482 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8cc796b9-c5af-4a2a-af62-2b38bbf85d6b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:25.376698 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8cc796b9-c5af-4a2a-af62-2b38bbf85d6b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:25.384305 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8cc796b9-c5af-4a2a-af62-2b38bbf85d6b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.152586 Mar 03 02:56:25.384865 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1542/2834] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:25 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:25.626267 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f8bbc89c-8a55-4016-a0ee-4467e77cb1cf tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:25.626874 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f8bbc89c-8a55-4016-a0ee-4467e77cb1cf tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:25.633124 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f8bbc89c-8a55-4016-a0ee-4467e77cb1cf tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:25.633571 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f8bbc89c-8a55-4016-a0ee-4467e77cb1cf tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:25.634339 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f8bbc89c-8a55-4016-a0ee-4467e77cb1cf tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:25.634772 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f8bbc89c-8a55-4016-a0ee-4467e77cb1cf tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:25.695720 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f8bbc89c-8a55-4016-a0ee-4467e77cb1cf tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:25.703662 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f8bbc89c-8a55-4016-a0ee-4467e77cb1cf tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.081821 Mar 03 02:56:25.704221 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1293/2835] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:25 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:26.049490 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-67e0a1bb-f1a7-41b5-a22c-a567baa1038a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:26.050105 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-67e0a1bb-f1a7-41b5-a22c-a567baa1038a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:26.056435 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-67e0a1bb-f1a7-41b5-a22c-a567baa1038a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:26.056883 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-67e0a1bb-f1a7-41b5-a22c-a567baa1038a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:26.057677 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-67e0a1bb-f1a7-41b5-a22c-a567baa1038a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:26.058108 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-67e0a1bb-f1a7-41b5-a22c-a567baa1038a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:26.185572 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-67e0a1bb-f1a7-41b5-a22c-a567baa1038a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:26.193202 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-67e0a1bb-f1a7-41b5-a22c-a567baa1038a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.147634 Mar 03 02:56:26.193758 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1543/2836] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:26 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:26.201332 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-81bf6609-9593-4c8b-b4ba-6adcc2534309 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:26.201990 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-81bf6609-9593-4c8b-b4ba-6adcc2534309 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:26.207749 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-81bf6609-9593-4c8b-b4ba-6adcc2534309 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:26.208205 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-81bf6609-9593-4c8b-b4ba-6adcc2534309 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:26.208988 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-81bf6609-9593-4c8b-b4ba-6adcc2534309 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:26.209428 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-81bf6609-9593-4c8b-b4ba-6adcc2534309 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:26.337581 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-81bf6609-9593-4c8b-b4ba-6adcc2534309 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:26.345372 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-81bf6609-9593-4c8b-b4ba-6adcc2534309 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.148433 Mar 03 02:56:26.345938 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1294/2837] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:26 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:26.401432 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-33639ac7-d9cd-42ef-9b3c-ba4729003e4e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:26.402071 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-33639ac7-d9cd-42ef-9b3c-ba4729003e4e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:26.408367 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-33639ac7-d9cd-42ef-9b3c-ba4729003e4e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:26.408815 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-33639ac7-d9cd-42ef-9b3c-ba4729003e4e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:26.409588 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-33639ac7-d9cd-42ef-9b3c-ba4729003e4e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:26.410028 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-33639ac7-d9cd-42ef-9b3c-ba4729003e4e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:26.542360 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-33639ac7-d9cd-42ef-9b3c-ba4729003e4e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:26.550413 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-33639ac7-d9cd-42ef-9b3c-ba4729003e4e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.152818 Mar 03 02:56:26.550980 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1544/2838] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:26 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:26.720134 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-704d18f4-83cd-402e-9302-0243feeec4a2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:26.720737 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-704d18f4-83cd-402e-9302-0243feeec4a2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:26.726894 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-704d18f4-83cd-402e-9302-0243feeec4a2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:26.727342 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-704d18f4-83cd-402e-9302-0243feeec4a2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:26.728146 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-704d18f4-83cd-402e-9302-0243feeec4a2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:26.728582 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-704d18f4-83cd-402e-9302-0243feeec4a2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:26.789392 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-704d18f4-83cd-402e-9302-0243feeec4a2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:26.797131 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-704d18f4-83cd-402e-9302-0243feeec4a2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.081042 Mar 03 02:56:26.797635 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1295/2839] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:26 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:27.210848 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3794d674-70e3-47f8-a953-2d2e8c640eea tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:27.211460 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3794d674-70e3-47f8-a953-2d2e8c640eea tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:27.218680 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3794d674-70e3-47f8-a953-2d2e8c640eea tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:27.219130 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3794d674-70e3-47f8-a953-2d2e8c640eea tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:27.219948 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3794d674-70e3-47f8-a953-2d2e8c640eea tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:27.220386 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3794d674-70e3-47f8-a953-2d2e8c640eea tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:27.349346 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-3794d674-70e3-47f8-a953-2d2e8c640eea tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:27.357919 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3794d674-70e3-47f8-a953-2d2e8c640eea tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.150845 Mar 03 02:56:27.358488 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1545/2840] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:27 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:27.362849 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-71ddf75c-4326-4eb8-8be8-73d55c5519af tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:27.363492 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-71ddf75c-4326-4eb8-8be8-73d55c5519af tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:27.369258 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-71ddf75c-4326-4eb8-8be8-73d55c5519af tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:27.369715 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-71ddf75c-4326-4eb8-8be8-73d55c5519af tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:27.370497 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-71ddf75c-4326-4eb8-8be8-73d55c5519af tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:27.370941 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-71ddf75c-4326-4eb8-8be8-73d55c5519af tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:27.501814 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-71ddf75c-4326-4eb8-8be8-73d55c5519af tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:27.509475 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-71ddf75c-4326-4eb8-8be8-73d55c5519af tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.150439 Mar 03 02:56:27.510042 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1296/2841] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:27 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:27.567855 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-39e99d9d-b409-4ab9-a374-5b5f254087e5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:27.568459 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-39e99d9d-b409-4ab9-a374-5b5f254087e5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:27.574252 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-39e99d9d-b409-4ab9-a374-5b5f254087e5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:27.574703 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-39e99d9d-b409-4ab9-a374-5b5f254087e5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:27.576068 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-39e99d9d-b409-4ab9-a374-5b5f254087e5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:27.576506 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-39e99d9d-b409-4ab9-a374-5b5f254087e5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:27.704447 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-39e99d9d-b409-4ab9-a374-5b5f254087e5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:27.712154 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-39e99d9d-b409-4ab9-a374-5b5f254087e5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.148147 Mar 03 02:56:27.712718 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1546/2842] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:27 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:27.813946 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d6a24794-e692-4990-91d2-9ba613b2b06f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:27.814561 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d6a24794-e692-4990-91d2-9ba613b2b06f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:27.820827 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d6a24794-e692-4990-91d2-9ba613b2b06f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:27.821284 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d6a24794-e692-4990-91d2-9ba613b2b06f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:27.822067 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d6a24794-e692-4990-91d2-9ba613b2b06f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:27.822509 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d6a24794-e692-4990-91d2-9ba613b2b06f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:27.887887 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d6a24794-e692-4990-91d2-9ba613b2b06f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:27.896196 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d6a24794-e692-4990-91d2-9ba613b2b06f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.086684 Mar 03 02:56:27.896771 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1297/2843] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:27 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:28.375971 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-95cc60b8-7ee5-42fa-8a1f-c75fdb7272f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:28.376665 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-95cc60b8-7ee5-42fa-8a1f-c75fdb7272f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:28.383116 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-95cc60b8-7ee5-42fa-8a1f-c75fdb7272f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:28.383566 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-95cc60b8-7ee5-42fa-8a1f-c75fdb7272f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:28.384562 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-95cc60b8-7ee5-42fa-8a1f-c75fdb7272f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:28.384994 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-95cc60b8-7ee5-42fa-8a1f-c75fdb7272f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:28.527084 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-023e1fd5-27d9-4588-8320-57281fbdd89a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:28.527724 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-023e1fd5-27d9-4588-8320-57281fbdd89a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:28.528575 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-95cc60b8-7ee5-42fa-8a1f-c75fdb7272f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:28.535385 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-023e1fd5-27d9-4588-8320-57281fbdd89a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:28.535890 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-023e1fd5-27d9-4588-8320-57281fbdd89a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:28.536376 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-95cc60b8-7ee5-42fa-8a1f-c75fdb7272f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.165167 Mar 03 02:56:28.536733 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-023e1fd5-27d9-4588-8320-57281fbdd89a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:28.536959 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1547/2844] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:28 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:28.537172 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-023e1fd5-27d9-4588-8320-57281fbdd89a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:28.688307 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-023e1fd5-27d9-4588-8320-57281fbdd89a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:28.696000 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-023e1fd5-27d9-4588-8320-57281fbdd89a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.173038 Mar 03 02:56:28.696565 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1298/2845] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:28 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:28.729256 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1d009e72-702e-44e0-890a-3904905ae176 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:28.729861 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1d009e72-702e-44e0-890a-3904905ae176 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:28.736973 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1d009e72-702e-44e0-890a-3904905ae176 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:28.737420 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1d009e72-702e-44e0-890a-3904905ae176 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:28.738189 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1d009e72-702e-44e0-890a-3904905ae176 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:28.738629 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1d009e72-702e-44e0-890a-3904905ae176 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:28.877240 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1d009e72-702e-44e0-890a-3904905ae176 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:28.885154 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1d009e72-702e-44e0-890a-3904905ae176 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.159656 Mar 03 02:56:28.885658 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1548/2846] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:28 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:28.913335 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e662aaed-be36-42d8-b98e-148fbefa34f6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:28.913940 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e662aaed-be36-42d8-b98e-148fbefa34f6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:28.920981 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e662aaed-be36-42d8-b98e-148fbefa34f6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:28.921431 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e662aaed-be36-42d8-b98e-148fbefa34f6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:28.922206 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e662aaed-be36-42d8-b98e-148fbefa34f6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:28.922641 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e662aaed-be36-42d8-b98e-148fbefa34f6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:28.982164 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e662aaed-be36-42d8-b98e-148fbefa34f6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:28.989892 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e662aaed-be36-42d8-b98e-148fbefa34f6 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080415 Mar 03 02:56:28.990462 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1299/2847] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:28 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:29.554254 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8f394064-73e7-46de-9001-c62e52a1044b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:29.554851 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8f394064-73e7-46de-9001-c62e52a1044b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:29.561724 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8f394064-73e7-46de-9001-c62e52a1044b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:29.562174 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8f394064-73e7-46de-9001-c62e52a1044b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:29.562939 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8f394064-73e7-46de-9001-c62e52a1044b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:29.563407 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8f394064-73e7-46de-9001-c62e52a1044b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:29.695777 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8f394064-73e7-46de-9001-c62e52a1044b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:29.704151 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8f394064-73e7-46de-9001-c62e52a1044b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.153788 Mar 03 02:56:29.704719 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1549/2848] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:29 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:29.712837 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c515ad32-7275-4602-87f6-8f8b0edf6118 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:29.713456 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c515ad32-7275-4602-87f6-8f8b0edf6118 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:29.719371 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c515ad32-7275-4602-87f6-8f8b0edf6118 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:29.719927 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c515ad32-7275-4602-87f6-8f8b0edf6118 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:29.720713 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c515ad32-7275-4602-87f6-8f8b0edf6118 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:29.721211 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c515ad32-7275-4602-87f6-8f8b0edf6118 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:29.851509 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c515ad32-7275-4602-87f6-8f8b0edf6118 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:29.860016 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c515ad32-7275-4602-87f6-8f8b0edf6118 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.151038 Mar 03 02:56:29.860592 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1300/2849] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:29 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:29.901817 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5dbd4d5c-cbaa-4322-9937-bbb45dfa47ec tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:29.902421 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5dbd4d5c-cbaa-4322-9937-bbb45dfa47ec tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:29.909235 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5dbd4d5c-cbaa-4322-9937-bbb45dfa47ec tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:29.909690 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5dbd4d5c-cbaa-4322-9937-bbb45dfa47ec tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:29.910493 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5dbd4d5c-cbaa-4322-9937-bbb45dfa47ec tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:29.910931 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5dbd4d5c-cbaa-4322-9937-bbb45dfa47ec tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:30.006168 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-725b31db-0234-45bc-9ef8-007cc456f0d9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:30.006876 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-725b31db-0234-45bc-9ef8-007cc456f0d9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:30.013716 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-725b31db-0234-45bc-9ef8-007cc456f0d9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:30.014167 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-725b31db-0234-45bc-9ef8-007cc456f0d9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:30.014999 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-725b31db-0234-45bc-9ef8-007cc456f0d9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:30.015443 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-725b31db-0234-45bc-9ef8-007cc456f0d9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:30.043135 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5dbd4d5c-cbaa-4322-9937-bbb45dfa47ec tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:30.051426 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5dbd4d5c-cbaa-4322-9937-bbb45dfa47ec tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.153337 Mar 03 02:56:30.052373 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1550/2850] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:29 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:30.074371 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-725b31db-0234-45bc-9ef8-007cc456f0d9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:30.082702 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-725b31db-0234-45bc-9ef8-007cc456f0d9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080447 Mar 03 02:56:30.083266 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1301/2851] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:30 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:30.721272 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b96b6c1d-564a-45ca-8f9d-df09c7013821 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:30.721971 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b96b6c1d-564a-45ca-8f9d-df09c7013821 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:30.728183 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b96b6c1d-564a-45ca-8f9d-df09c7013821 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:30.728629 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b96b6c1d-564a-45ca-8f9d-df09c7013821 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:30.729406 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b96b6c1d-564a-45ca-8f9d-df09c7013821 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:30.729838 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b96b6c1d-564a-45ca-8f9d-df09c7013821 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:30.859594 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b96b6c1d-564a-45ca-8f9d-df09c7013821 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:30.867256 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b96b6c1d-564a-45ca-8f9d-df09c7013821 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.149895 Mar 03 02:56:30.867841 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1551/2852] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:30 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:30.877721 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-450b9fe5-7492-4d0d-9a20-dafe77ae79d5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:30.878334 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-450b9fe5-7492-4d0d-9a20-dafe77ae79d5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:30.884105 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-450b9fe5-7492-4d0d-9a20-dafe77ae79d5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:30.884565 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-450b9fe5-7492-4d0d-9a20-dafe77ae79d5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:30.885352 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-450b9fe5-7492-4d0d-9a20-dafe77ae79d5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:30.885798 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-450b9fe5-7492-4d0d-9a20-dafe77ae79d5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:31.018528 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-450b9fe5-7492-4d0d-9a20-dafe77ae79d5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:31.026305 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-450b9fe5-7492-4d0d-9a20-dafe77ae79d5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.152410 Mar 03 02:56:31.026921 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1302/2853] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:30 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:31.069133 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c5585fc0-ffb7-4bc4-995a-76cb641afaa7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:31.069745 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c5585fc0-ffb7-4bc4-995a-76cb641afaa7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:31.076140 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c5585fc0-ffb7-4bc4-995a-76cb641afaa7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:31.076596 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c5585fc0-ffb7-4bc4-995a-76cb641afaa7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:31.077373 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c5585fc0-ffb7-4bc4-995a-76cb641afaa7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:31.077812 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c5585fc0-ffb7-4bc4-995a-76cb641afaa7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:31.098072 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-37d57569-d367-4535-b0ea-516540d4fde3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:31.098679 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-37d57569-d367-4535-b0ea-516540d4fde3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:31.104685 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-37d57569-d367-4535-b0ea-516540d4fde3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:31.105136 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-37d57569-d367-4535-b0ea-516540d4fde3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:31.106208 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-37d57569-d367-4535-b0ea-516540d4fde3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:31.107361 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-37d57569-d367-4535-b0ea-516540d4fde3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:31.218700 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c5585fc0-ffb7-4bc4-995a-76cb641afaa7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:31.226910 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c5585fc0-ffb7-4bc4-995a-76cb641afaa7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.161439 Mar 03 02:56:31.227509 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1552/2854] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:31 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:31.387344 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-37d57569-d367-4535-b0ea-516540d4fde3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:31.395722 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-37d57569-d367-4535-b0ea-516540d4fde3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.301477 Mar 03 02:56:31.396281 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1303/2855] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:31 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:31.884855 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ad575a00-ff38-440d-9b19-58573a023e46 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:31.885464 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ad575a00-ff38-440d-9b19-58573a023e46 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:31.892377 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ad575a00-ff38-440d-9b19-58573a023e46 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:31.892827 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ad575a00-ff38-440d-9b19-58573a023e46 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:31.893600 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ad575a00-ff38-440d-9b19-58573a023e46 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:31.894035 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ad575a00-ff38-440d-9b19-58573a023e46 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:32.025126 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ad575a00-ff38-440d-9b19-58573a023e46 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:32.032916 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ad575a00-ff38-440d-9b19-58573a023e46 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.151913 Mar 03 02:56:32.033478 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1553/2856] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:31 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:32.043405 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-56510869-8457-4314-a4da-6f209a647e98 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:32.044105 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-56510869-8457-4314-a4da-6f209a647e98 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:32.050499 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-56510869-8457-4314-a4da-6f209a647e98 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:32.050960 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-56510869-8457-4314-a4da-6f209a647e98 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:32.051785 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-56510869-8457-4314-a4da-6f209a647e98 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:32.052447 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-56510869-8457-4314-a4da-6f209a647e98 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:32.179300 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-56510869-8457-4314-a4da-6f209a647e98 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:32.187649 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-56510869-8457-4314-a4da-6f209a647e98 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.148153 Mar 03 02:56:32.188223 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1304/2857] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:32 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:32.243861 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9b6f2459-60a4-4c66-81de-3ff0efeaf3dc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:32.244468 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9b6f2459-60a4-4c66-81de-3ff0efeaf3dc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:32.251175 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9b6f2459-60a4-4c66-81de-3ff0efeaf3dc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:32.251645 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9b6f2459-60a4-4c66-81de-3ff0efeaf3dc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:32.252428 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9b6f2459-60a4-4c66-81de-3ff0efeaf3dc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:32.252869 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9b6f2459-60a4-4c66-81de-3ff0efeaf3dc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:32.386566 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9b6f2459-60a4-4c66-81de-3ff0efeaf3dc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:32.394464 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9b6f2459-60a4-4c66-81de-3ff0efeaf3dc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.154486 Mar 03 02:56:32.395026 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1554/2858] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:32 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:32.413094 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-06add3da-630a-4afd-9a00-a70130639717 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:32.413702 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-06add3da-630a-4afd-9a00-a70130639717 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:32.420155 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-06add3da-630a-4afd-9a00-a70130639717 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:32.420604 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-06add3da-630a-4afd-9a00-a70130639717 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:32.421370 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-06add3da-630a-4afd-9a00-a70130639717 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:32.421801 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-06add3da-630a-4afd-9a00-a70130639717 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:32.478836 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-06add3da-630a-4afd-9a00-a70130639717 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:32.487865 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-06add3da-630a-4afd-9a00-a70130639717 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079119 Mar 03 02:56:32.488425 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1305/2859] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:32 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:33.050128 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a2f7ad76-1f23-47ef-8f0e-e0b12f5f4bec tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:33.050735 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a2f7ad76-1f23-47ef-8f0e-e0b12f5f4bec tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:33.057100 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a2f7ad76-1f23-47ef-8f0e-e0b12f5f4bec tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:33.057549 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a2f7ad76-1f23-47ef-8f0e-e0b12f5f4bec tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:33.058323 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a2f7ad76-1f23-47ef-8f0e-e0b12f5f4bec tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:33.058766 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a2f7ad76-1f23-47ef-8f0e-e0b12f5f4bec tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:33.188849 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a2f7ad76-1f23-47ef-8f0e-e0b12f5f4bec tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:33.196523 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a2f7ad76-1f23-47ef-8f0e-e0b12f5f4bec tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.150228 Mar 03 02:56:33.197023 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1555/2860] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:33 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:33.204589 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-39efdbae-65a6-4ad4-9b26-13e7a337a052 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:33.205233 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-39efdbae-65a6-4ad4-9b26-13e7a337a052 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:33.211439 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-39efdbae-65a6-4ad4-9b26-13e7a337a052 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:33.211924 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-39efdbae-65a6-4ad4-9b26-13e7a337a052 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:33.212702 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-39efdbae-65a6-4ad4-9b26-13e7a337a052 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:33.213143 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-39efdbae-65a6-4ad4-9b26-13e7a337a052 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:33.344092 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-39efdbae-65a6-4ad4-9b26-13e7a337a052 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:33.351791 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-39efdbae-65a6-4ad4-9b26-13e7a337a052 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.150965 Mar 03 02:56:33.352351 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1306/2861] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:33 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:33.411702 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9a553124-9aa3-4cef-bd95-e59f1ac4d91c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:33.412311 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9a553124-9aa3-4cef-bd95-e59f1ac4d91c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:33.418025 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9a553124-9aa3-4cef-bd95-e59f1ac4d91c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:33.418476 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9a553124-9aa3-4cef-bd95-e59f1ac4d91c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:33.420444 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9a553124-9aa3-4cef-bd95-e59f1ac4d91c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:33.420886 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9a553124-9aa3-4cef-bd95-e59f1ac4d91c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:33.555935 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9a553124-9aa3-4cef-bd95-e59f1ac4d91c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:33.563586 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9a553124-9aa3-4cef-bd95-e59f1ac4d91c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.155792 Mar 03 02:56:33.564235 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1556/2862] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:33 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:33.619128 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-60f77f8a-6f85-4937-844f-9a34542f767d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:33.619768 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-60f77f8a-6f85-4937-844f-9a34542f767d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:33.626518 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-60f77f8a-6f85-4937-844f-9a34542f767d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:33.627000 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-60f77f8a-6f85-4937-844f-9a34542f767d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:33.627821 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-60f77f8a-6f85-4937-844f-9a34542f767d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:33.628256 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-60f77f8a-6f85-4937-844f-9a34542f767d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:33.685962 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-60f77f8a-6f85-4937-844f-9a34542f767d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:33.693507 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-60f77f8a-6f85-4937-844f-9a34542f767d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.193147 Mar 03 02:56:33.694065 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1307/2863] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:33 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:34.213457 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7abd6d9f-9c6a-4cad-a36f-4034ba55313d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:34.214066 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7abd6d9f-9c6a-4cad-a36f-4034ba55313d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:34.220896 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7abd6d9f-9c6a-4cad-a36f-4034ba55313d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:34.221339 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7abd6d9f-9c6a-4cad-a36f-4034ba55313d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:34.222101 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7abd6d9f-9c6a-4cad-a36f-4034ba55313d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:34.222534 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7abd6d9f-9c6a-4cad-a36f-4034ba55313d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:34.352919 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-7abd6d9f-9c6a-4cad-a36f-4034ba55313d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:34.360813 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7abd6d9f-9c6a-4cad-a36f-4034ba55313d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.151202 Mar 03 02:56:34.361373 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1557/2864] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:34 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:34.369529 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-325ebd7f-91bb-48c6-8d27-2846c771a6dd tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:34.370132 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-325ebd7f-91bb-48c6-8d27-2846c771a6dd tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:34.376374 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-325ebd7f-91bb-48c6-8d27-2846c771a6dd tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:34.376824 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-325ebd7f-91bb-48c6-8d27-2846c771a6dd tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:34.377599 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-325ebd7f-91bb-48c6-8d27-2846c771a6dd tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:34.378030 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-325ebd7f-91bb-48c6-8d27-2846c771a6dd tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:34.509536 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-325ebd7f-91bb-48c6-8d27-2846c771a6dd tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:34.517836 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-325ebd7f-91bb-48c6-8d27-2846c771a6dd tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.152090 Mar 03 02:56:34.518403 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1308/2865] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:34 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:34.580679 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-fc027983-00ea-49cd-b305-51dbf2173736 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:34.581288 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-fc027983-00ea-49cd-b305-51dbf2173736 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:34.587120 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fc027983-00ea-49cd-b305-51dbf2173736 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:34.587569 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fc027983-00ea-49cd-b305-51dbf2173736 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:34.588371 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fc027983-00ea-49cd-b305-51dbf2173736 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:34.588808 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fc027983-00ea-49cd-b305-51dbf2173736 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:34.709786 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-90a934b5-7c32-4dd6-804a-fe3b6cf34b20 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:34.710493 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-90a934b5-7c32-4dd6-804a-fe3b6cf34b20 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:34.717083 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-90a934b5-7c32-4dd6-804a-fe3b6cf34b20 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:34.717536 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-90a934b5-7c32-4dd6-804a-fe3b6cf34b20 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:34.718316 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-90a934b5-7c32-4dd6-804a-fe3b6cf34b20 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:34.718725 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-fc027983-00ea-49cd-b305-51dbf2173736 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:34.718863 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-90a934b5-7c32-4dd6-804a-fe3b6cf34b20 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:34.726370 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-fc027983-00ea-49cd-b305-51dbf2173736 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.149525 Mar 03 02:56:34.726943 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1558/2866] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:34 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:34.778579 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-90a934b5-7c32-4dd6-804a-fe3b6cf34b20 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:34.786431 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-90a934b5-7c32-4dd6-804a-fe3b6cf34b20 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080579 Mar 03 02:56:34.786996 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1309/2867] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:34 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:35.377291 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e665465e-ed03-4300-9649-a70957a7d0a4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:35.377930 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e665465e-ed03-4300-9649-a70957a7d0a4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:35.383864 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e665465e-ed03-4300-9649-a70957a7d0a4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:35.384314 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e665465e-ed03-4300-9649-a70957a7d0a4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:35.385112 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e665465e-ed03-4300-9649-a70957a7d0a4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:35.385547 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e665465e-ed03-4300-9649-a70957a7d0a4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:35.521419 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e665465e-ed03-4300-9649-a70957a7d0a4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:35.529355 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e665465e-ed03-4300-9649-a70957a7d0a4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.156030 Mar 03 02:56:35.529923 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1559/2868] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:35 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:35.534817 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-aba4e405-b3c6-4207-aad5-42cdca5aa291 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:35.535433 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-aba4e405-b3c6-4207-aad5-42cdca5aa291 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:35.541408 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aba4e405-b3c6-4207-aad5-42cdca5aa291 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:35.541892 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aba4e405-b3c6-4207-aad5-42cdca5aa291 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:35.542671 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aba4e405-b3c6-4207-aad5-42cdca5aa291 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:35.543109 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aba4e405-b3c6-4207-aad5-42cdca5aa291 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:35.677107 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-aba4e405-b3c6-4207-aad5-42cdca5aa291 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:35.685842 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-aba4e405-b3c6-4207-aad5-42cdca5aa291 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.154921 Mar 03 02:56:35.686417 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1310/2869] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:35 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:35.744243 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-800d447d-dbd8-4603-adba-5128d4b58f98 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:35.744975 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-800d447d-dbd8-4603-adba-5128d4b58f98 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:35.751573 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-800d447d-dbd8-4603-adba-5128d4b58f98 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:35.752126 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-800d447d-dbd8-4603-adba-5128d4b58f98 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:35.752972 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-800d447d-dbd8-4603-adba-5128d4b58f98 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:35.753483 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-800d447d-dbd8-4603-adba-5128d4b58f98 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:35.803497 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-54242e8b-a71f-4144-822e-edb59c9ef7ed tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:35.804331 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-54242e8b-a71f-4144-822e-edb59c9ef7ed tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:35.811337 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-54242e8b-a71f-4144-822e-edb59c9ef7ed tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:35.812226 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-54242e8b-a71f-4144-822e-edb59c9ef7ed tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:35.812777 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-54242e8b-a71f-4144-822e-edb59c9ef7ed tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:35.813293 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-54242e8b-a71f-4144-822e-edb59c9ef7ed tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:35.875103 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-54242e8b-a71f-4144-822e-edb59c9ef7ed tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:35.883112 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-54242e8b-a71f-4144-822e-edb59c9ef7ed tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.083347 Mar 03 02:56:35.884358 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1311/2870] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:35 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:35.897864 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-800d447d-dbd8-4603-adba-5128d4b58f98 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:35.906419 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-800d447d-dbd8-4603-adba-5128d4b58f98 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.166028 Mar 03 02:56:35.907043 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1560/2871] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:35 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:36.545648 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-56b695a6-3870-41a4-8110-26bc22934957 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:36.546303 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-56b695a6-3870-41a4-8110-26bc22934957 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:36.552632 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-56b695a6-3870-41a4-8110-26bc22934957 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:36.553077 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-56b695a6-3870-41a4-8110-26bc22934957 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:36.553849 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-56b695a6-3870-41a4-8110-26bc22934957 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:36.554280 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-56b695a6-3870-41a4-8110-26bc22934957 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:36.687475 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-56b695a6-3870-41a4-8110-26bc22934957 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:36.695184 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-56b695a6-3870-41a4-8110-26bc22934957 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.153488 Mar 03 02:56:36.695780 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1312/2872] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:36 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:36.702234 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1458408c-2dfd-4163-920e-7c2049531bae tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:36.702845 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1458408c-2dfd-4163-920e-7c2049531bae tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:36.709364 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1458408c-2dfd-4163-920e-7c2049531bae tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:36.709820 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1458408c-2dfd-4163-920e-7c2049531bae tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:36.710600 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1458408c-2dfd-4163-920e-7c2049531bae tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:36.711045 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1458408c-2dfd-4163-920e-7c2049531bae tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:36.846279 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1458408c-2dfd-4163-920e-7c2049531bae tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:36.853919 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1458408c-2dfd-4163-920e-7c2049531bae tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.155638 Mar 03 02:56:36.854477 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1561/2873] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:36 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:36.900742 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5f9cc334-0e92-4e41-8c6c-f993b3edece9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:36.901284 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5f9cc334-0e92-4e41-8c6c-f993b3edece9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:36.907413 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5f9cc334-0e92-4e41-8c6c-f993b3edece9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:36.907969 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5f9cc334-0e92-4e41-8c6c-f993b3edece9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:36.908983 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5f9cc334-0e92-4e41-8c6c-f993b3edece9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:36.909420 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5f9cc334-0e92-4e41-8c6c-f993b3edece9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:36.924175 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-57d399f3-a690-4d3b-952b-879c42cc1e4d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:36.924779 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-57d399f3-a690-4d3b-952b-879c42cc1e4d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:36.930533 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-57d399f3-a690-4d3b-952b-879c42cc1e4d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:36.930981 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-57d399f3-a690-4d3b-952b-879c42cc1e4d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:36.931787 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-57d399f3-a690-4d3b-952b-879c42cc1e4d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:36.932223 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-57d399f3-a690-4d3b-952b-879c42cc1e4d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:36.969773 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5f9cc334-0e92-4e41-8c6c-f993b3edece9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:36.977586 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5f9cc334-0e92-4e41-8c6c-f993b3edece9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080663 Mar 03 02:56:36.978186 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1313/2874] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:36 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:37.063832 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-57d399f3-a690-4d3b-952b-879c42cc1e4d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:37.071354 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-57d399f3-a690-4d3b-952b-879c42cc1e4d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.151024 Mar 03 02:56:37.071945 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1562/2875] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:36 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:37.713116 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0347c5ca-dcb2-403c-872e-66987fd24a62 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:37.713720 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0347c5ca-dcb2-403c-872e-66987fd24a62 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:37.720859 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0347c5ca-dcb2-403c-872e-66987fd24a62 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:37.721310 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0347c5ca-dcb2-403c-872e-66987fd24a62 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:37.722082 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0347c5ca-dcb2-403c-872e-66987fd24a62 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:37.722516 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0347c5ca-dcb2-403c-872e-66987fd24a62 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:37.852054 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0347c5ca-dcb2-403c-872e-66987fd24a62 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:37.860750 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0347c5ca-dcb2-403c-872e-66987fd24a62 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.151520 Mar 03 02:56:37.861317 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1314/2876] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:37 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:37.870921 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-417a40ca-5c55-4e86-a629-d90665ef5cd0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:37.871559 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-417a40ca-5c55-4e86-a629-d90665ef5cd0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:37.877894 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-417a40ca-5c55-4e86-a629-d90665ef5cd0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:37.878347 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-417a40ca-5c55-4e86-a629-d90665ef5cd0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:37.879126 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-417a40ca-5c55-4e86-a629-d90665ef5cd0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:37.879567 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-417a40ca-5c55-4e86-a629-d90665ef5cd0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:37.995278 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-629e73ae-3342-4e0e-9501-fc423047d338 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:37.995920 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-629e73ae-3342-4e0e-9501-fc423047d338 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:38.001970 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-629e73ae-3342-4e0e-9501-fc423047d338 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:38.002499 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-629e73ae-3342-4e0e-9501-fc423047d338 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:38.003250 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-629e73ae-3342-4e0e-9501-fc423047d338 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:38.003722 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-629e73ae-3342-4e0e-9501-fc423047d338 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:38.008872 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-417a40ca-5c55-4e86-a629-d90665ef5cd0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:38.016903 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-417a40ca-5c55-4e86-a629-d90665ef5cd0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.150065 Mar 03 02:56:38.017626 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1563/2877] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:37 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:38.066085 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-629e73ae-3342-4e0e-9501-fc423047d338 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:38.074114 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-629e73ae-3342-4e0e-9501-fc423047d338 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.082776 Mar 03 02:56:38.074682 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1315/2878] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:37 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:38.087876 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f3df7bc8-0705-4e21-873c-a334dfff2fbf tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:38.088480 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f3df7bc8-0705-4e21-873c-a334dfff2fbf tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:38.094824 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f3df7bc8-0705-4e21-873c-a334dfff2fbf tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:38.095267 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f3df7bc8-0705-4e21-873c-a334dfff2fbf tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:38.096074 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f3df7bc8-0705-4e21-873c-a334dfff2fbf tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:38.096506 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f3df7bc8-0705-4e21-873c-a334dfff2fbf tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:38.227954 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f3df7bc8-0705-4e21-873c-a334dfff2fbf tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:38.236320 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f3df7bc8-0705-4e21-873c-a334dfff2fbf tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.152202 Mar 03 02:56:38.236805 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1564/2879] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:38 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:38.878542 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0bab02ae-655f-42b8-9285-349e2c55313c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:38.879143 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0bab02ae-655f-42b8-9285-349e2c55313c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:38.885407 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0bab02ae-655f-42b8-9285-349e2c55313c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:38.885864 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0bab02ae-655f-42b8-9285-349e2c55313c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:38.886651 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0bab02ae-655f-42b8-9285-349e2c55313c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:38.887095 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0bab02ae-655f-42b8-9285-349e2c55313c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:39.016641 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0bab02ae-655f-42b8-9285-349e2c55313c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:39.024559 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0bab02ae-655f-42b8-9285-349e2c55313c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.149895 Mar 03 02:56:39.025138 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1316/2880] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:38 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:39.034078 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a7b7c88c-d7cd-4335-b416-6805a4776a1a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:39.034719 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a7b7c88c-d7cd-4335-b416-6805a4776a1a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:39.040889 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a7b7c88c-d7cd-4335-b416-6805a4776a1a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:39.041345 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a7b7c88c-d7cd-4335-b416-6805a4776a1a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:39.042125 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a7b7c88c-d7cd-4335-b416-6805a4776a1a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:39.042566 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a7b7c88c-d7cd-4335-b416-6805a4776a1a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:39.092114 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d7753907-2f8c-4881-85dc-efa76175563a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:39.092825 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d7753907-2f8c-4881-85dc-efa76175563a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:39.098646 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d7753907-2f8c-4881-85dc-efa76175563a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:39.099164 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d7753907-2f8c-4881-85dc-efa76175563a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:39.100050 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d7753907-2f8c-4881-85dc-efa76175563a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:39.100551 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d7753907-2f8c-4881-85dc-efa76175563a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:39.161282 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d7753907-2f8c-4881-85dc-efa76175563a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:39.169963 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d7753907-2f8c-4881-85dc-efa76175563a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.081939 Mar 03 02:56:39.170610 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1317/2881] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:39 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:39.176940 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a7b7c88c-d7cd-4335-b416-6805a4776a1a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:39.185180 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a7b7c88c-d7cd-4335-b416-6805a4776a1a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.154383 Mar 03 02:56:39.185734 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1565/2882] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:39 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:39.253014 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2af30898-831d-47d4-abc4-444548b15271 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:39.253615 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2af30898-831d-47d4-abc4-444548b15271 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:39.259358 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2af30898-831d-47d4-abc4-444548b15271 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:39.259848 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2af30898-831d-47d4-abc4-444548b15271 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:39.260620 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2af30898-831d-47d4-abc4-444548b15271 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:39.261054 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2af30898-831d-47d4-abc4-444548b15271 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:39.393269 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2af30898-831d-47d4-abc4-444548b15271 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:39.401002 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2af30898-831d-47d4-abc4-444548b15271 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.151778 Mar 03 02:56:39.401588 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1318/2883] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:39 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:40.043228 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-87e0dfcd-9b2d-41a6-8750-809ee6f52b88 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:40.044027 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-87e0dfcd-9b2d-41a6-8750-809ee6f52b88 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:40.050324 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-87e0dfcd-9b2d-41a6-8750-809ee6f52b88 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:40.050781 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-87e0dfcd-9b2d-41a6-8750-809ee6f52b88 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:40.051572 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-87e0dfcd-9b2d-41a6-8750-809ee6f52b88 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:40.052038 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-87e0dfcd-9b2d-41a6-8750-809ee6f52b88 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:40.186210 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-87e0dfcd-9b2d-41a6-8750-809ee6f52b88 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:40.187449 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-da64f94a-53e1-4052-91b6-69288d6ea198 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:40.188097 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-da64f94a-53e1-4052-91b6-69288d6ea198 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:40.193931 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-87e0dfcd-9b2d-41a6-8750-809ee6f52b88 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.154533 Mar 03 02:56:40.194411 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-da64f94a-53e1-4052-91b6-69288d6ea198 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:40.194541 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1566/2884] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:40 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:40.194869 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-da64f94a-53e1-4052-91b6-69288d6ea198 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:40.195683 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-da64f94a-53e1-4052-91b6-69288d6ea198 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:40.196129 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-da64f94a-53e1-4052-91b6-69288d6ea198 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:40.203746 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-bf42f92d-9c3a-4591-af6b-4ce7b37b9366 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:40.204365 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-bf42f92d-9c3a-4591-af6b-4ce7b37b9366 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:40.209969 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bf42f92d-9c3a-4591-af6b-4ce7b37b9366 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:40.210426 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bf42f92d-9c3a-4591-af6b-4ce7b37b9366 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:40.211206 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bf42f92d-9c3a-4591-af6b-4ce7b37b9366 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:40.211674 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bf42f92d-9c3a-4591-af6b-4ce7b37b9366 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:40.256688 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-da64f94a-53e1-4052-91b6-69288d6ea198 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:40.265411 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-da64f94a-53e1-4052-91b6-69288d6ea198 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.082772 Mar 03 02:56:40.266001 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1319/2885] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:40 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:40.342635 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-bf42f92d-9c3a-4591-af6b-4ce7b37b9366 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:40.350237 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-bf42f92d-9c3a-4591-af6b-4ce7b37b9366 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.150825 Mar 03 02:56:40.350800 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1567/2886] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:40 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:40.418246 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1d9a2ab0-09b4-4089-9c6b-a485dc76fb4e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:40.419542 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1d9a2ab0-09b4-4089-9c6b-a485dc76fb4e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:40.425422 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1d9a2ab0-09b4-4089-9c6b-a485dc76fb4e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:40.425865 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1d9a2ab0-09b4-4089-9c6b-a485dc76fb4e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:40.426650 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1d9a2ab0-09b4-4089-9c6b-a485dc76fb4e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:40.427095 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1d9a2ab0-09b4-4089-9c6b-a485dc76fb4e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:40.555022 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1d9a2ab0-09b4-4089-9c6b-a485dc76fb4e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:40.563834 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1d9a2ab0-09b4-4089-9c6b-a485dc76fb4e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.149401 Mar 03 02:56:40.564400 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1320/2887] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:40 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:41.210784 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c7808e74-05b9-4123-9161-41abfcd5c2ff tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:41.211393 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c7808e74-05b9-4123-9161-41abfcd5c2ff tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:41.218200 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c7808e74-05b9-4123-9161-41abfcd5c2ff tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:41.218740 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c7808e74-05b9-4123-9161-41abfcd5c2ff tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:41.219562 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c7808e74-05b9-4123-9161-41abfcd5c2ff tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:41.220029 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c7808e74-05b9-4123-9161-41abfcd5c2ff tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:41.282158 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b03173ad-b6d4-4237-bfac-e367b972a52c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:41.282752 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b03173ad-b6d4-4237-bfac-e367b972a52c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:41.288952 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b03173ad-b6d4-4237-bfac-e367b972a52c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:41.289440 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b03173ad-b6d4-4237-bfac-e367b972a52c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:41.290225 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b03173ad-b6d4-4237-bfac-e367b972a52c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:41.290664 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b03173ad-b6d4-4237-bfac-e367b972a52c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:41.353226 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b03173ad-b6d4-4237-bfac-e367b972a52c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:41.358373 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c7808e74-05b9-4123-9161-41abfcd5c2ff tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:41.361412 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b03173ad-b6d4-4237-bfac-e367b972a52c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.083833 Mar 03 02:56:41.361975 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1321/2888] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:41 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:41.366408 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c7808e74-05b9-4123-9161-41abfcd5c2ff tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.159434 Mar 03 02:56:41.367221 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1568/2889] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:41 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:41.368219 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ac8d87c6-a773-4a92-ab15-781f6f853771 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:41.368827 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ac8d87c6-a773-4a92-ab15-781f6f853771 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:41.374608 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ac8d87c6-a773-4a92-ab15-781f6f853771 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:41.375056 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ac8d87c6-a773-4a92-ab15-781f6f853771 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:41.375859 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ac8d87c6-a773-4a92-ab15-781f6f853771 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:41.376297 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ac8d87c6-a773-4a92-ab15-781f6f853771 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:41.505308 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ac8d87c6-a773-4a92-ab15-781f6f853771 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:41.514173 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ac8d87c6-a773-4a92-ab15-781f6f853771 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.149683 Mar 03 02:56:41.514737 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1322/2890] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:41 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:41.581089 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f2cc52c1-0265-4bda-aa30-855c74ebd481 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:41.581895 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f2cc52c1-0265-4bda-aa30-855c74ebd481 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:41.587690 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f2cc52c1-0265-4bda-aa30-855c74ebd481 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:41.588144 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f2cc52c1-0265-4bda-aa30-855c74ebd481 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:41.588921 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f2cc52c1-0265-4bda-aa30-855c74ebd481 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:41.589358 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f2cc52c1-0265-4bda-aa30-855c74ebd481 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:41.718830 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f2cc52c1-0265-4bda-aa30-855c74ebd481 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:41.726596 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f2cc52c1-0265-4bda-aa30-855c74ebd481 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.149379 Mar 03 02:56:41.727168 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1569/2891] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:41 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:42.378474 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-53d28a88-b443-4ff7-8f0f-592c6f76372e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:42.379087 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-53d28a88-b443-4ff7-8f0f-592c6f76372e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:42.383360 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-66e346ff-d02f-47dc-98ab-69571727d3e6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:42.384007 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-66e346ff-d02f-47dc-98ab-69571727d3e6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:42.385580 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-53d28a88-b443-4ff7-8f0f-592c6f76372e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:42.386067 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-53d28a88-b443-4ff7-8f0f-592c6f76372e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:42.386857 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-53d28a88-b443-4ff7-8f0f-592c6f76372e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:42.387328 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-53d28a88-b443-4ff7-8f0f-592c6f76372e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:42.390262 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-66e346ff-d02f-47dc-98ab-69571727d3e6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:42.390713 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-66e346ff-d02f-47dc-98ab-69571727d3e6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:42.391500 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-66e346ff-d02f-47dc-98ab-69571727d3e6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:42.391970 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-66e346ff-d02f-47dc-98ab-69571727d3e6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:42.448212 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-53d28a88-b443-4ff7-8f0f-592c6f76372e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:42.456042 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-53d28a88-b443-4ff7-8f0f-592c6f76372e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.081422 Mar 03 02:56:42.456619 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1323/2892] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:42 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:42.521155 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-66e346ff-d02f-47dc-98ab-69571727d3e6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:42.529093 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-66e346ff-d02f-47dc-98ab-69571727d3e6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.149413 Mar 03 02:56:42.529614 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1570/2893] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:42 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:42.531633 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-08eeae91-8034-4c69-8564-3a478ecb0e07 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:42.532248 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-08eeae91-8034-4c69-8564-3a478ecb0e07 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:42.538048 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-08eeae91-8034-4c69-8564-3a478ecb0e07 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:42.538506 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-08eeae91-8034-4c69-8564-3a478ecb0e07 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:42.539289 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-08eeae91-8034-4c69-8564-3a478ecb0e07 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:42.539755 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-08eeae91-8034-4c69-8564-3a478ecb0e07 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:42.672351 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-08eeae91-8034-4c69-8564-3a478ecb0e07 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:42.679971 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-08eeae91-8034-4c69-8564-3a478ecb0e07 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.152663 Mar 03 02:56:42.680535 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1324/2894] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:42 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:42.744110 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4631e473-df3e-4951-8025-c16cf2f62dca tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:42.744629 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4631e473-df3e-4951-8025-c16cf2f62dca tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:42.751187 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4631e473-df3e-4951-8025-c16cf2f62dca tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:42.751664 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4631e473-df3e-4951-8025-c16cf2f62dca tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:42.752452 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4631e473-df3e-4951-8025-c16cf2f62dca tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:42.752896 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4631e473-df3e-4951-8025-c16cf2f62dca tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:42.890397 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4631e473-df3e-4951-8025-c16cf2f62dca tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:42.898686 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4631e473-df3e-4951-8025-c16cf2f62dca tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.158477 Mar 03 02:56:42.899253 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1571/2895] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:42 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:43.473018 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-71a2ece4-b548-4c53-bc50-a5357e132580 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:43.473660 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-71a2ece4-b548-4c53-bc50-a5357e132580 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:43.480011 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-71a2ece4-b548-4c53-bc50-a5357e132580 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:43.480729 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-71a2ece4-b548-4c53-bc50-a5357e132580 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:43.481507 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-71a2ece4-b548-4c53-bc50-a5357e132580 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:43.481967 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-71a2ece4-b548-4c53-bc50-a5357e132580 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:43.540034 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-71a2ece4-b548-4c53-bc50-a5357e132580 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:43.546221 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-803cec86-9fc6-4306-8ae5-bda2c762f1e5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:43.546836 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-803cec86-9fc6-4306-8ae5-bda2c762f1e5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:43.547971 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-71a2ece4-b548-4c53-bc50-a5357e132580 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.078708 Mar 03 02:56:43.548538 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1325/2896] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:43 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:43.553115 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-803cec86-9fc6-4306-8ae5-bda2c762f1e5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:43.553574 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-803cec86-9fc6-4306-8ae5-bda2c762f1e5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:43.554366 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-803cec86-9fc6-4306-8ae5-bda2c762f1e5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:43.554811 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-803cec86-9fc6-4306-8ae5-bda2c762f1e5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:43.684541 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-803cec86-9fc6-4306-8ae5-bda2c762f1e5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:43.692870 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-803cec86-9fc6-4306-8ae5-bda2c762f1e5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.150916 Mar 03 02:56:43.693443 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1572/2897] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:43 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:43.697674 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6cbe5680-6e26-4898-9a91-dcde97d42f26 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:43.698278 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6cbe5680-6e26-4898-9a91-dcde97d42f26 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:43.704591 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6cbe5680-6e26-4898-9a91-dcde97d42f26 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:43.705036 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6cbe5680-6e26-4898-9a91-dcde97d42f26 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:43.705807 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6cbe5680-6e26-4898-9a91-dcde97d42f26 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:43.706239 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6cbe5680-6e26-4898-9a91-dcde97d42f26 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:43.841177 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-6cbe5680-6e26-4898-9a91-dcde97d42f26 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:43.849281 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6cbe5680-6e26-4898-9a91-dcde97d42f26 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.155548 Mar 03 02:56:43.849852 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1326/2898] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:43 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:43.916557 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e39d0d77-d2b8-438a-927d-dd7ec4f00f09 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:43.917369 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e39d0d77-d2b8-438a-927d-dd7ec4f00f09 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:43.923654 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e39d0d77-d2b8-438a-927d-dd7ec4f00f09 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:43.924114 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e39d0d77-d2b8-438a-927d-dd7ec4f00f09 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:43.924891 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e39d0d77-d2b8-438a-927d-dd7ec4f00f09 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:43.925333 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e39d0d77-d2b8-438a-927d-dd7ec4f00f09 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:44.058909 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e39d0d77-d2b8-438a-927d-dd7ec4f00f09 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:44.067737 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e39d0d77-d2b8-438a-927d-dd7ec4f00f09 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.155246 Mar 03 02:56:44.068307 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1573/2899] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:43 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:44.563389 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d82d87f8-d7a1-45ff-8aa8-a148cfccffae tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:44.564017 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d82d87f8-d7a1-45ff-8aa8-a148cfccffae tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:44.570323 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d82d87f8-d7a1-45ff-8aa8-a148cfccffae tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:44.570784 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d82d87f8-d7a1-45ff-8aa8-a148cfccffae tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:44.571559 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d82d87f8-d7a1-45ff-8aa8-a148cfccffae tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:44.572026 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d82d87f8-d7a1-45ff-8aa8-a148cfccffae tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:44.632909 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d82d87f8-d7a1-45ff-8aa8-a148cfccffae tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:44.640890 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d82d87f8-d7a1-45ff-8aa8-a148cfccffae tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.081434 Mar 03 02:56:44.641446 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1327/2900] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:44 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:44.710100 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4b99b598-98ca-449f-a11f-ea8aa15f9305 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:44.710717 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4b99b598-98ca-449f-a11f-ea8aa15f9305 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:44.717530 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4b99b598-98ca-449f-a11f-ea8aa15f9305 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:44.717990 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4b99b598-98ca-449f-a11f-ea8aa15f9305 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:44.718763 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4b99b598-98ca-449f-a11f-ea8aa15f9305 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:44.719228 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4b99b598-98ca-449f-a11f-ea8aa15f9305 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:44.853116 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4b99b598-98ca-449f-a11f-ea8aa15f9305 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:44.861339 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4b99b598-98ca-449f-a11f-ea8aa15f9305 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.155062 Mar 03 02:56:44.861909 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1574/2901] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:44 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:44.866161 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4b5e7dbf-2129-4286-9a6c-6cf630144a05 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:44.866774 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4b5e7dbf-2129-4286-9a6c-6cf630144a05 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:44.872874 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4b5e7dbf-2129-4286-9a6c-6cf630144a05 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:44.873365 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4b5e7dbf-2129-4286-9a6c-6cf630144a05 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:44.874186 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4b5e7dbf-2129-4286-9a6c-6cf630144a05 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:44.874630 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4b5e7dbf-2129-4286-9a6c-6cf630144a05 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:45.007359 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4b5e7dbf-2129-4286-9a6c-6cf630144a05 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:45.015584 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4b5e7dbf-2129-4286-9a6c-6cf630144a05 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.153240 Mar 03 02:56:45.016238 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1328/2902] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:44 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:45.085150 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a46f39d8-4eb8-49f3-9e90-9488c51c6d00 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:45.085765 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a46f39d8-4eb8-49f3-9e90-9488c51c6d00 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:45.092467 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a46f39d8-4eb8-49f3-9e90-9488c51c6d00 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:45.092922 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a46f39d8-4eb8-49f3-9e90-9488c51c6d00 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:45.093701 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a46f39d8-4eb8-49f3-9e90-9488c51c6d00 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:45.094143 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a46f39d8-4eb8-49f3-9e90-9488c51c6d00 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:45.224071 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a46f39d8-4eb8-49f3-9e90-9488c51c6d00 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:45.232059 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a46f39d8-4eb8-49f3-9e90-9488c51c6d00 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.150730 Mar 03 02:56:45.232775 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1575/2903] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:45 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:45.657635 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6588bdfa-f9bd-407f-a486-d025219d1b9d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:45.658236 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6588bdfa-f9bd-407f-a486-d025219d1b9d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:45.664404 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6588bdfa-f9bd-407f-a486-d025219d1b9d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:45.664851 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6588bdfa-f9bd-407f-a486-d025219d1b9d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:45.665626 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6588bdfa-f9bd-407f-a486-d025219d1b9d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:45.666057 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6588bdfa-f9bd-407f-a486-d025219d1b9d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:45.725519 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-6588bdfa-f9bd-407f-a486-d025219d1b9d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:45.734183 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6588bdfa-f9bd-407f-a486-d025219d1b9d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080732 Mar 03 02:56:45.734746 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1329/2904] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:45 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:45.878674 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5c68d65e-ebbe-463e-8a38-54b4b27d441c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:45.879330 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5c68d65e-ebbe-463e-8a38-54b4b27d441c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:45.885575 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5c68d65e-ebbe-463e-8a38-54b4b27d441c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:45.886024 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5c68d65e-ebbe-463e-8a38-54b4b27d441c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:45.886791 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5c68d65e-ebbe-463e-8a38-54b4b27d441c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:45.887224 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5c68d65e-ebbe-463e-8a38-54b4b27d441c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:46.020868 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5c68d65e-ebbe-463e-8a38-54b4b27d441c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:46.029573 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5c68d65e-ebbe-463e-8a38-54b4b27d441c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.154158 Mar 03 02:56:46.030212 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1576/2905] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:45 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:46.033385 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7187baf6-775c-4989-889d-b86557711380 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:46.033977 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7187baf6-775c-4989-889d-b86557711380 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:46.039859 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7187baf6-775c-4989-889d-b86557711380 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:46.040310 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7187baf6-775c-4989-889d-b86557711380 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:46.041076 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7187baf6-775c-4989-889d-b86557711380 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:46.041511 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7187baf6-775c-4989-889d-b86557711380 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:46.174957 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-7187baf6-775c-4989-889d-b86557711380 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:46.182661 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7187baf6-775c-4989-889d-b86557711380 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.153720 Mar 03 02:56:46.183225 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1330/2906] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:46 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:46.248675 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-08a3e09d-5f46-4ef9-9029-6aa4a1047978 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:46.249210 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-08a3e09d-5f46-4ef9-9029-6aa4a1047978 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:46.255176 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-08a3e09d-5f46-4ef9-9029-6aa4a1047978 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:46.255639 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-08a3e09d-5f46-4ef9-9029-6aa4a1047978 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:46.256413 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-08a3e09d-5f46-4ef9-9029-6aa4a1047978 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:46.256846 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-08a3e09d-5f46-4ef9-9029-6aa4a1047978 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:46.384621 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-08a3e09d-5f46-4ef9-9029-6aa4a1047978 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:46.393043 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-08a3e09d-5f46-4ef9-9029-6aa4a1047978 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.148327 Mar 03 02:56:46.393606 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1577/2907] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:46 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:46.749847 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-85f40b55-a5b5-4adb-b202-7a62ab932aa7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:46.751071 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-85f40b55-a5b5-4adb-b202-7a62ab932aa7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:46.757605 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-85f40b55-a5b5-4adb-b202-7a62ab932aa7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:46.758058 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-85f40b55-a5b5-4adb-b202-7a62ab932aa7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:46.758858 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-85f40b55-a5b5-4adb-b202-7a62ab932aa7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:46.759294 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-85f40b55-a5b5-4adb-b202-7a62ab932aa7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:46.818111 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-85f40b55-a5b5-4adb-b202-7a62ab932aa7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:46.826464 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-85f40b55-a5b5-4adb-b202-7a62ab932aa7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079945 Mar 03 02:56:46.827055 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1331/2908] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:46 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:47.047029 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0e6d07f1-56b2-4e70-9237-7fd2de1c8d74 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:47.047567 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0e6d07f1-56b2-4e70-9237-7fd2de1c8d74 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:47.053829 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0e6d07f1-56b2-4e70-9237-7fd2de1c8d74 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:47.054276 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0e6d07f1-56b2-4e70-9237-7fd2de1c8d74 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:47.055048 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0e6d07f1-56b2-4e70-9237-7fd2de1c8d74 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:47.055481 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0e6d07f1-56b2-4e70-9237-7fd2de1c8d74 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:47.189466 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0e6d07f1-56b2-4e70-9237-7fd2de1c8d74 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:47.197175 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0e6d07f1-56b2-4e70-9237-7fd2de1c8d74 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.154785 Mar 03 02:56:47.197751 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1578/2909] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:47 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:47.199541 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-98cdcffb-5d27-4e1b-9016-6067c0ad10b4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:47.200176 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-98cdcffb-5d27-4e1b-9016-6067c0ad10b4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:47.207104 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-98cdcffb-5d27-4e1b-9016-6067c0ad10b4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:47.207560 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-98cdcffb-5d27-4e1b-9016-6067c0ad10b4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:47.208374 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-98cdcffb-5d27-4e1b-9016-6067c0ad10b4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:47.208816 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-98cdcffb-5d27-4e1b-9016-6067c0ad10b4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:47.337294 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-98cdcffb-5d27-4e1b-9016-6067c0ad10b4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:47.345734 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-98cdcffb-5d27-4e1b-9016-6067c0ad10b4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.149987 Mar 03 02:56:47.346299 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1332/2910] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:47 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:47.410708 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-05cd70e8-7d86-4691-b0fa-8188281951f6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:47.411310 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-05cd70e8-7d86-4691-b0fa-8188281951f6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:47.417019 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-05cd70e8-7d86-4691-b0fa-8188281951f6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:47.417465 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-05cd70e8-7d86-4691-b0fa-8188281951f6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:47.418225 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-05cd70e8-7d86-4691-b0fa-8188281951f6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:47.418658 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-05cd70e8-7d86-4691-b0fa-8188281951f6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:47.547435 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-05cd70e8-7d86-4691-b0fa-8188281951f6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:47.555036 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-05cd70e8-7d86-4691-b0fa-8188281951f6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.148240 Mar 03 02:56:47.555596 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1579/2911] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:47 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:47.844950 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-66b2bbd5-51b7-4e42-b26e-095da12257e1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:47.845563 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-66b2bbd5-51b7-4e42-b26e-095da12257e1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:47.851974 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-66b2bbd5-51b7-4e42-b26e-095da12257e1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:47.852438 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-66b2bbd5-51b7-4e42-b26e-095da12257e1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:47.853220 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-66b2bbd5-51b7-4e42-b26e-095da12257e1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:47.853662 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-66b2bbd5-51b7-4e42-b26e-095da12257e1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:47.912954 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-66b2bbd5-51b7-4e42-b26e-095da12257e1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:47.921271 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-66b2bbd5-51b7-4e42-b26e-095da12257e1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080523 Mar 03 02:56:47.921831 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1333/2912] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:47 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:48.214845 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0f938bd7-0632-4ffe-a6ca-369847d3ebd3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:48.215392 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0f938bd7-0632-4ffe-a6ca-369847d3ebd3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:48.222145 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0f938bd7-0632-4ffe-a6ca-369847d3ebd3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:48.222600 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0f938bd7-0632-4ffe-a6ca-369847d3ebd3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:48.223376 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0f938bd7-0632-4ffe-a6ca-369847d3ebd3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:48.223849 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0f938bd7-0632-4ffe-a6ca-369847d3ebd3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:48.356568 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0f938bd7-0632-4ffe-a6ca-369847d3ebd3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:48.362919 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-cb867463-c8a7-4822-b8dc-dbc87735cc83 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:48.363637 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-cb867463-c8a7-4822-b8dc-dbc87735cc83 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:48.365119 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0f938bd7-0632-4ffe-a6ca-369847d3ebd3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.154123 Mar 03 02:56:48.365703 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1580/2913] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:48 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:48.369417 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cb867463-c8a7-4822-b8dc-dbc87735cc83 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:48.369866 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cb867463-c8a7-4822-b8dc-dbc87735cc83 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:48.370637 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cb867463-c8a7-4822-b8dc-dbc87735cc83 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:48.371074 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cb867463-c8a7-4822-b8dc-dbc87735cc83 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:48.502675 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-cb867463-c8a7-4822-b8dc-dbc87735cc83 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:48.510304 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-cb867463-c8a7-4822-b8dc-dbc87735cc83 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.151270 Mar 03 02:56:48.510871 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1334/2914] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:48 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:48.572481 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2af348a7-eaa6-43f0-81fa-07eb037fd19d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:48.573095 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2af348a7-eaa6-43f0-81fa-07eb037fd19d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:48.578958 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2af348a7-eaa6-43f0-81fa-07eb037fd19d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:48.579418 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2af348a7-eaa6-43f0-81fa-07eb037fd19d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:48.580229 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2af348a7-eaa6-43f0-81fa-07eb037fd19d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:48.580673 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2af348a7-eaa6-43f0-81fa-07eb037fd19d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:48.708519 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2af348a7-eaa6-43f0-81fa-07eb037fd19d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:48.716097 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2af348a7-eaa6-43f0-81fa-07eb037fd19d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.147433 Mar 03 02:56:48.716655 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1581/2915] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:48 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:48.938215 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8c5e50e3-27a0-48a8-8878-454c5ad7612b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:48.938823 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8c5e50e3-27a0-48a8-8878-454c5ad7612b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:48.945130 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8c5e50e3-27a0-48a8-8878-454c5ad7612b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:48.945586 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8c5e50e3-27a0-48a8-8878-454c5ad7612b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:48.946359 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8c5e50e3-27a0-48a8-8878-454c5ad7612b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:48.946797 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8c5e50e3-27a0-48a8-8878-454c5ad7612b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:49.006556 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8c5e50e3-27a0-48a8-8878-454c5ad7612b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:49.014840 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8c5e50e3-27a0-48a8-8878-454c5ad7612b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.081532 Mar 03 02:56:49.015410 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1335/2916] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:48 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:49.382214 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8eb41310-8a26-4a9a-badd-ba312846719f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:49.382820 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8eb41310-8a26-4a9a-badd-ba312846719f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:49.389734 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8eb41310-8a26-4a9a-badd-ba312846719f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:49.390181 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8eb41310-8a26-4a9a-badd-ba312846719f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:49.390948 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8eb41310-8a26-4a9a-badd-ba312846719f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:49.391379 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8eb41310-8a26-4a9a-badd-ba312846719f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:49.519790 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8eb41310-8a26-4a9a-badd-ba312846719f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:49.527690 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6a10a2fe-ff06-4642-a542-120c30600656 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:49.527896 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8eb41310-8a26-4a9a-badd-ba312846719f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.149431 Mar 03 02:56:49.528297 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6a10a2fe-ff06-4642-a542-120c30600656 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:49.528429 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1582/2917] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:49 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:49.535054 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6a10a2fe-ff06-4642-a542-120c30600656 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:49.535509 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6a10a2fe-ff06-4642-a542-120c30600656 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:49.536326 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6a10a2fe-ff06-4642-a542-120c30600656 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:49.536767 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6a10a2fe-ff06-4642-a542-120c30600656 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:49.667189 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-6a10a2fe-ff06-4642-a542-120c30600656 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:49.675478 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6a10a2fe-ff06-4642-a542-120c30600656 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.151634 Mar 03 02:56:49.676243 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1336/2918] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:49 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:49.733461 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3ccb16ab-ec1e-4561-bed5-d5f4d98e743e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:49.734089 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3ccb16ab-ec1e-4561-bed5-d5f4d98e743e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:49.740023 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3ccb16ab-ec1e-4561-bed5-d5f4d98e743e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:49.740482 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3ccb16ab-ec1e-4561-bed5-d5f4d98e743e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:49.741259 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3ccb16ab-ec1e-4561-bed5-d5f4d98e743e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:49.741697 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3ccb16ab-ec1e-4561-bed5-d5f4d98e743e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:49.876405 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-3ccb16ab-ec1e-4561-bed5-d5f4d98e743e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:49.884231 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3ccb16ab-ec1e-4561-bed5-d5f4d98e743e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.154852 Mar 03 02:56:49.884829 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1583/2919] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:49 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:50.031401 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c7183d68-6358-4009-887f-37b8124ad216 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:50.032041 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c7183d68-6358-4009-887f-37b8124ad216 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:50.038265 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c7183d68-6358-4009-887f-37b8124ad216 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:50.038719 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c7183d68-6358-4009-887f-37b8124ad216 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:50.039492 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c7183d68-6358-4009-887f-37b8124ad216 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:50.040081 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c7183d68-6358-4009-887f-37b8124ad216 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:50.103557 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c7183d68-6358-4009-887f-37b8124ad216 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:50.112493 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c7183d68-6358-4009-887f-37b8124ad216 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.085127 Mar 03 02:56:50.113053 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1337/2920] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:50 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:50.546103 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d7084a97-91b5-49f3-95d8-5b1421087831 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:50.546772 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d7084a97-91b5-49f3-95d8-5b1421087831 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:50.553015 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d7084a97-91b5-49f3-95d8-5b1421087831 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:50.553488 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d7084a97-91b5-49f3-95d8-5b1421087831 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:50.554256 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d7084a97-91b5-49f3-95d8-5b1421087831 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:50.554687 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d7084a97-91b5-49f3-95d8-5b1421087831 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:50.684023 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d7084a97-91b5-49f3-95d8-5b1421087831 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:50.691836 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d7084a97-91b5-49f3-95d8-5b1421087831 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.150382 Mar 03 02:56:50.692391 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1584/2921] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:50 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:50.693798 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1c19f130-0623-431e-a5d2-65dd7ee64dcb tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:50.694403 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1c19f130-0623-431e-a5d2-65dd7ee64dcb tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:50.700259 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1c19f130-0623-431e-a5d2-65dd7ee64dcb tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:50.700738 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1c19f130-0623-431e-a5d2-65dd7ee64dcb tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:50.701500 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1c19f130-0623-431e-a5d2-65dd7ee64dcb tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:50.701936 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1c19f130-0623-431e-a5d2-65dd7ee64dcb tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:50.845451 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1c19f130-0623-431e-a5d2-65dd7ee64dcb tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:50.853625 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1c19f130-0623-431e-a5d2-65dd7ee64dcb tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.163742 Mar 03 02:56:50.854186 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1338/2922] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:50 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:50.901498 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3f278f7f-8d54-40ae-be40-4a7804729116 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:50.902110 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3f278f7f-8d54-40ae-be40-4a7804729116 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:50.908864 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3f278f7f-8d54-40ae-be40-4a7804729116 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:50.909455 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3f278f7f-8d54-40ae-be40-4a7804729116 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:50.910433 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3f278f7f-8d54-40ae-be40-4a7804729116 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:50.910918 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3f278f7f-8d54-40ae-be40-4a7804729116 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:51.042613 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-3f278f7f-8d54-40ae-be40-4a7804729116 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:51.050737 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3f278f7f-8d54-40ae-be40-4a7804729116 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.152987 Mar 03 02:56:51.051364 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1585/2923] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:50 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:51.129006 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-425ac6e3-bf85-4da3-87cc-072f307292ee tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:51.129608 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-425ac6e3-bf85-4da3-87cc-072f307292ee tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:51.135793 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-425ac6e3-bf85-4da3-87cc-072f307292ee tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:51.136246 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-425ac6e3-bf85-4da3-87cc-072f307292ee tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:51.137012 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-425ac6e3-bf85-4da3-87cc-072f307292ee tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:51.137446 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-425ac6e3-bf85-4da3-87cc-072f307292ee tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:51.197087 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-425ac6e3-bf85-4da3-87cc-072f307292ee tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:51.205233 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-425ac6e3-bf85-4da3-87cc-072f307292ee tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080100 Mar 03 02:56:51.205797 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1339/2924] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:51 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:51.709100 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-edd21c9c-18aa-43d1-b28e-7094371bf9c5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:51.709704 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-edd21c9c-18aa-43d1-b28e-7094371bf9c5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:51.716708 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-edd21c9c-18aa-43d1-b28e-7094371bf9c5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:51.716863 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-edd21c9c-18aa-43d1-b28e-7094371bf9c5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:51.717589 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-edd21c9c-18aa-43d1-b28e-7094371bf9c5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:51.718016 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-edd21c9c-18aa-43d1-b28e-7094371bf9c5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:51.846918 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-edd21c9c-18aa-43d1-b28e-7094371bf9c5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:51.854911 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-edd21c9c-18aa-43d1-b28e-7094371bf9c5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.149687 Mar 03 02:56:51.855752 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1586/2925] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:51 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:51.871323 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3e099676-15d1-4161-bad7-d02397bf9df4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:51.871952 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3e099676-15d1-4161-bad7-d02397bf9df4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:51.878340 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3e099676-15d1-4161-bad7-d02397bf9df4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:51.878787 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3e099676-15d1-4161-bad7-d02397bf9df4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:51.879553 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3e099676-15d1-4161-bad7-d02397bf9df4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:51.880013 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3e099676-15d1-4161-bad7-d02397bf9df4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:52.015561 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3e099676-15d1-4161-bad7-d02397bf9df4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:52.023302 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3e099676-15d1-4161-bad7-d02397bf9df4 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.155770 Mar 03 02:56:52.023916 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1340/2926] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:51 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:52.067158 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-700c76c2-f165-4303-95a9-54688d13c570 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:52.067822 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-700c76c2-f165-4303-95a9-54688d13c570 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:52.073687 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-700c76c2-f165-4303-95a9-54688d13c570 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:52.074142 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-700c76c2-f165-4303-95a9-54688d13c570 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:52.074923 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-700c76c2-f165-4303-95a9-54688d13c570 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:52.075384 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-700c76c2-f165-4303-95a9-54688d13c570 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:52.202570 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-700c76c2-f165-4303-95a9-54688d13c570 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:52.210259 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-700c76c2-f165-4303-95a9-54688d13c570 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.146960 Mar 03 02:56:52.210823 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1587/2927] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:52 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:52.222114 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2f88e342-9314-45a4-b93f-809fc0e3d0fb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:52.222662 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2f88e342-9314-45a4-b93f-809fc0e3d0fb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:52.228904 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f88e342-9314-45a4-b93f-809fc0e3d0fb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:52.229357 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f88e342-9314-45a4-b93f-809fc0e3d0fb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:52.230137 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f88e342-9314-45a4-b93f-809fc0e3d0fb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:52.230830 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f88e342-9314-45a4-b93f-809fc0e3d0fb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:52.289688 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2f88e342-9314-45a4-b93f-809fc0e3d0fb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:52.298041 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2f88e342-9314-45a4-b93f-809fc0e3d0fb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079841 Mar 03 02:56:52.298603 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1341/2928] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:52 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:52.872924 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9b671ee7-6dec-492a-ac8f-442dd931b79b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:52.873517 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9b671ee7-6dec-492a-ac8f-442dd931b79b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:52.879987 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9b671ee7-6dec-492a-ac8f-442dd931b79b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:52.880443 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9b671ee7-6dec-492a-ac8f-442dd931b79b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:52.881256 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9b671ee7-6dec-492a-ac8f-442dd931b79b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:52.881693 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9b671ee7-6dec-492a-ac8f-442dd931b79b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:53.015523 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9b671ee7-6dec-492a-ac8f-442dd931b79b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:53.023871 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9b671ee7-6dec-492a-ac8f-442dd931b79b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.154902 Mar 03 02:56:53.024470 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1588/2929] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:52 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:53.040323 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1a5504d5-4152-4b11-a07b-4153b05b7dda tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:53.040932 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1a5504d5-4152-4b11-a07b-4153b05b7dda tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:53.047667 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1a5504d5-4152-4b11-a07b-4153b05b7dda tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:53.048096 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1a5504d5-4152-4b11-a07b-4153b05b7dda tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:53.048883 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1a5504d5-4152-4b11-a07b-4153b05b7dda tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:53.049327 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1a5504d5-4152-4b11-a07b-4153b05b7dda tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:53.177774 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1a5504d5-4152-4b11-a07b-4153b05b7dda tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:53.186186 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1a5504d5-4152-4b11-a07b-4153b05b7dda tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.149704 Mar 03 02:56:53.186754 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1342/2930] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:53 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:53.227789 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e6903727-7890-410f-b6de-84ad21f850e0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:53.228391 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e6903727-7890-410f-b6de-84ad21f850e0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:53.234821 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e6903727-7890-410f-b6de-84ad21f850e0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:53.235266 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e6903727-7890-410f-b6de-84ad21f850e0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:53.236060 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e6903727-7890-410f-b6de-84ad21f850e0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:53.236496 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e6903727-7890-410f-b6de-84ad21f850e0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:53.314939 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0e46bf6b-6467-4545-9530-668889c41c40 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:53.315540 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0e46bf6b-6467-4545-9530-668889c41c40 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:53.321990 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0e46bf6b-6467-4545-9530-668889c41c40 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:53.322470 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0e46bf6b-6467-4545-9530-668889c41c40 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:53.323218 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0e46bf6b-6467-4545-9530-668889c41c40 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:53.323690 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0e46bf6b-6467-4545-9530-668889c41c40 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:53.366929 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e6903727-7890-410f-b6de-84ad21f850e0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:53.375273 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e6903727-7890-410f-b6de-84ad21f850e0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.151257 Mar 03 02:56:53.375881 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1589/2931] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:53 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:53.387711 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0e46bf6b-6467-4545-9530-668889c41c40 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:53.395704 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0e46bf6b-6467-4545-9530-668889c41c40 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.084753 Mar 03 02:56:53.396269 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1343/2932] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:53 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:54.041353 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-bc2bd54e-0bcd-4e84-a52d-77ca0eabd2d8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:54.041965 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-bc2bd54e-0bcd-4e84-a52d-77ca0eabd2d8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:54.049326 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bc2bd54e-0bcd-4e84-a52d-77ca0eabd2d8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:54.049779 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bc2bd54e-0bcd-4e84-a52d-77ca0eabd2d8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:54.050565 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bc2bd54e-0bcd-4e84-a52d-77ca0eabd2d8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:54.051001 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bc2bd54e-0bcd-4e84-a52d-77ca0eabd2d8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:54.186579 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-bc2bd54e-0bcd-4e84-a52d-77ca0eabd2d8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:54.194191 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-bc2bd54e-0bcd-4e84-a52d-77ca0eabd2d8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.156879 Mar 03 02:56:54.194750 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1590/2933] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:54 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:54.202675 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7ffe0a88-1223-4cf2-ae6b-816297153b7b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:54.203282 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7ffe0a88-1223-4cf2-ae6b-816297153b7b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:54.208998 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7ffe0a88-1223-4cf2-ae6b-816297153b7b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:54.209452 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7ffe0a88-1223-4cf2-ae6b-816297153b7b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:54.210222 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7ffe0a88-1223-4cf2-ae6b-816297153b7b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:54.210658 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7ffe0a88-1223-4cf2-ae6b-816297153b7b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:54.339974 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-7ffe0a88-1223-4cf2-ae6b-816297153b7b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:54.347873 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7ffe0a88-1223-4cf2-ae6b-816297153b7b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.149574 Mar 03 02:56:54.348443 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1344/2934] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:54 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:54.392799 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8b494f4f-4766-4d64-9724-b85cab214748 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:54.393400 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8b494f4f-4766-4d64-9724-b85cab214748 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:54.399174 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b494f4f-4766-4d64-9724-b85cab214748 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:54.399643 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b494f4f-4766-4d64-9724-b85cab214748 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:54.400413 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b494f4f-4766-4d64-9724-b85cab214748 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:54.400844 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b494f4f-4766-4d64-9724-b85cab214748 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:54.412314 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d1718e4f-3154-4ec1-9e03-671cb74f4667 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:54.412925 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d1718e4f-3154-4ec1-9e03-671cb74f4667 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:54.418779 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d1718e4f-3154-4ec1-9e03-671cb74f4667 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:54.419270 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d1718e4f-3154-4ec1-9e03-671cb74f4667 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:54.420644 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d1718e4f-3154-4ec1-9e03-671cb74f4667 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:54.421087 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d1718e4f-3154-4ec1-9e03-671cb74f4667 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:54.480928 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d1718e4f-3154-4ec1-9e03-671cb74f4667 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:54.489104 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d1718e4f-3154-4ec1-9e03-671cb74f4667 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080365 Mar 03 02:56:54.489679 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1345/2935] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:54 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:54.531203 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8b494f4f-4766-4d64-9724-b85cab214748 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:54.538941 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8b494f4f-4766-4d64-9724-b85cab214748 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.150752 Mar 03 02:56:54.539510 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1591/2936] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:54 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:55.211204 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-384dc22e-fbe0-4564-88fd-c3e8588c4419 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:55.211832 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-384dc22e-fbe0-4564-88fd-c3e8588c4419 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:55.218151 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-384dc22e-fbe0-4564-88fd-c3e8588c4419 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:55.218596 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-384dc22e-fbe0-4564-88fd-c3e8588c4419 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:55.219370 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-384dc22e-fbe0-4564-88fd-c3e8588c4419 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:55.219844 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-384dc22e-fbe0-4564-88fd-c3e8588c4419 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:55.353587 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-384dc22e-fbe0-4564-88fd-c3e8588c4419 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:55.362085 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-384dc22e-fbe0-4564-88fd-c3e8588c4419 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.155621 Mar 03 02:56:55.362645 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1346/2937] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:55 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:55.365203 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-96a15bdf-1502-4219-8083-eebca849f8c5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:55.365803 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-96a15bdf-1502-4219-8083-eebca849f8c5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:55.372214 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-96a15bdf-1502-4219-8083-eebca849f8c5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:55.372701 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-96a15bdf-1502-4219-8083-eebca849f8c5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:55.373483 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-96a15bdf-1502-4219-8083-eebca849f8c5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:55.373922 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-96a15bdf-1502-4219-8083-eebca849f8c5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:55.504788 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-96a15bdf-1502-4219-8083-eebca849f8c5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:55.506124 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-43bf6c92-bb52-453b-906d-3919e7ee64fd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:55.506735 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-43bf6c92-bb52-453b-906d-3919e7ee64fd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:55.512535 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-43bf6c92-bb52-453b-906d-3919e7ee64fd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:55.512695 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-96a15bdf-1502-4219-8083-eebca849f8c5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.151146 Mar 03 02:56:55.513493 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-43bf6c92-bb52-453b-906d-3919e7ee64fd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:55.513628 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1592/2938] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:55 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:55.514364 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-43bf6c92-bb52-453b-906d-3919e7ee64fd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:55.514801 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-43bf6c92-bb52-453b-906d-3919e7ee64fd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:55.556276 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6615a492-84ee-43e8-b117-8f9213d5b2b6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:55.556892 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6615a492-84ee-43e8-b117-8f9213d5b2b6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:55.562658 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6615a492-84ee-43e8-b117-8f9213d5b2b6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:55.563110 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6615a492-84ee-43e8-b117-8f9213d5b2b6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:55.563916 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6615a492-84ee-43e8-b117-8f9213d5b2b6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:55.564352 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6615a492-84ee-43e8-b117-8f9213d5b2b6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:55.574535 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-43bf6c92-bb52-453b-906d-3919e7ee64fd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:55.583231 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-43bf6c92-bb52-453b-906d-3919e7ee64fd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080894 Mar 03 02:56:55.583836 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1347/2939] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:55 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:55.694341 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6615a492-84ee-43e8-b117-8f9213d5b2b6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:55.702767 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6615a492-84ee-43e8-b117-8f9213d5b2b6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.150282 Mar 03 02:56:55.703342 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1593/2940] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:55 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:56.379209 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-281b1acd-8f2b-417c-830a-10582ded562b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:56.379841 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-281b1acd-8f2b-417c-830a-10582ded562b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:56.386057 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-281b1acd-8f2b-417c-830a-10582ded562b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:56.386507 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-281b1acd-8f2b-417c-830a-10582ded562b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:56.387273 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-281b1acd-8f2b-417c-830a-10582ded562b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:56.387735 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-281b1acd-8f2b-417c-830a-10582ded562b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:56.515467 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-281b1acd-8f2b-417c-830a-10582ded562b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:56.523165 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-281b1acd-8f2b-417c-830a-10582ded562b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.147771 Mar 03 02:56:56.523774 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1348/2941] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:56 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:56.530527 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-83577f83-aed2-46f7-876a-adb9a41929e8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:56.531134 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-83577f83-aed2-46f7-876a-adb9a41929e8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:56.537278 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-83577f83-aed2-46f7-876a-adb9a41929e8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:56.537728 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-83577f83-aed2-46f7-876a-adb9a41929e8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:56.538503 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-83577f83-aed2-46f7-876a-adb9a41929e8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:56.538938 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-83577f83-aed2-46f7-876a-adb9a41929e8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:56.601987 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d6b64919-4364-4eec-ac44-ca2ea1ecd04b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:56.602636 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d6b64919-4364-4eec-ac44-ca2ea1ecd04b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:56.609792 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d6b64919-4364-4eec-ac44-ca2ea1ecd04b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:56.610248 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d6b64919-4364-4eec-ac44-ca2ea1ecd04b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:56.611031 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d6b64919-4364-4eec-ac44-ca2ea1ecd04b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:56.611471 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d6b64919-4364-4eec-ac44-ca2ea1ecd04b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:56.672294 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d6b64919-4364-4eec-ac44-ca2ea1ecd04b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:56.673130 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-83577f83-aed2-46f7-876a-adb9a41929e8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:56.680009 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d6b64919-4364-4eec-ac44-ca2ea1ecd04b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.082889 Mar 03 02:56:56.680618 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1349/2942] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:56 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:56.680879 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-83577f83-aed2-46f7-876a-adb9a41929e8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.154641 Mar 03 02:56:56.681452 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1594/2943] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:56 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:56.719348 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-846e4e68-3616-4edb-badb-bf920990b098 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:56.719990 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-846e4e68-3616-4edb-badb-bf920990b098 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:56.725782 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-846e4e68-3616-4edb-badb-bf920990b098 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:56.726233 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-846e4e68-3616-4edb-badb-bf920990b098 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:56.727008 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-846e4e68-3616-4edb-badb-bf920990b098 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:56.727475 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-846e4e68-3616-4edb-badb-bf920990b098 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:56.861640 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-846e4e68-3616-4edb-badb-bf920990b098 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:56.869340 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-846e4e68-3616-4edb-badb-bf920990b098 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.154647 Mar 03 02:56:56.869912 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1350/2944] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:56 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:57.542177 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6b59c606-2320-48b6-b6e4-c120795ccd18 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:57.542866 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6b59c606-2320-48b6-b6e4-c120795ccd18 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:57.549700 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6b59c606-2320-48b6-b6e4-c120795ccd18 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:57.550158 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6b59c606-2320-48b6-b6e4-c120795ccd18 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:57.550941 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6b59c606-2320-48b6-b6e4-c120795ccd18 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:57.551395 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6b59c606-2320-48b6-b6e4-c120795ccd18 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:57.697309 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-bbafc9d0-2c46-4de9-b62d-8a640debfad3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:57.698223 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-bbafc9d0-2c46-4de9-b62d-8a640debfad3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:57.704537 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bbafc9d0-2c46-4de9-b62d-8a640debfad3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:57.704994 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bbafc9d0-2c46-4de9-b62d-8a640debfad3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:57.705776 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bbafc9d0-2c46-4de9-b62d-8a640debfad3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:57.706210 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bbafc9d0-2c46-4de9-b62d-8a640debfad3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:57.766739 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-bbafc9d0-2c46-4de9-b62d-8a640debfad3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:57.774796 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-bbafc9d0-2c46-4de9-b62d-8a640debfad3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.081348 Mar 03 02:56:57.775367 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1351/2945] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:57 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:57.780345 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3545dcb3-8ee6-412b-bac4-de440c76825c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:57.780621 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3545dcb3-8ee6-412b-bac4-de440c76825c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:57.786432 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3545dcb3-8ee6-412b-bac4-de440c76825c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:57.786617 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3545dcb3-8ee6-412b-bac4-de440c76825c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:57.787267 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3545dcb3-8ee6-412b-bac4-de440c76825c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:57.787726 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3545dcb3-8ee6-412b-bac4-de440c76825c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:57.792019 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6b59c606-2320-48b6-b6e4-c120795ccd18 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:57.800245 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6b59c606-2320-48b6-b6e4-c120795ccd18 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.262017 Mar 03 02:56:57.800823 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1595/2946] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:57 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:57.886403 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6297df0a-ea9c-493c-837b-1e6a30a2facb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:57.887055 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6297df0a-ea9c-493c-837b-1e6a30a2facb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:57.893672 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6297df0a-ea9c-493c-837b-1e6a30a2facb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:57.894143 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6297df0a-ea9c-493c-837b-1e6a30a2facb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:57.894952 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6297df0a-ea9c-493c-837b-1e6a30a2facb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:57.895397 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6297df0a-ea9c-493c-837b-1e6a30a2facb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:57.925707 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3545dcb3-8ee6-412b-bac4-de440c76825c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:57.933339 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3545dcb3-8ee6-412b-bac4-de440c76825c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.156991 Mar 03 02:56:57.934112 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1352/2947] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:57 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:58.041529 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6297df0a-ea9c-493c-837b-1e6a30a2facb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:58.050173 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6297df0a-ea9c-493c-837b-1e6a30a2facb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.167799 Mar 03 02:56:58.050987 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1596/2948] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:57 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:58.791584 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-31cfcb60-1b30-44dc-a297-10036d5531ee tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:58.792218 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-31cfcb60-1b30-44dc-a297-10036d5531ee tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:58.798418 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-31cfcb60-1b30-44dc-a297-10036d5531ee tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:58.798865 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-31cfcb60-1b30-44dc-a297-10036d5531ee tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:58.799813 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-31cfcb60-1b30-44dc-a297-10036d5531ee tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:58.800253 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-31cfcb60-1b30-44dc-a297-10036d5531ee tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:58.817954 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-be9b5e72-c852-4a75-8f14-58210ab0f1d6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:58.818677 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-be9b5e72-c852-4a75-8f14-58210ab0f1d6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:58.824648 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-be9b5e72-c852-4a75-8f14-58210ab0f1d6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:58.825211 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-be9b5e72-c852-4a75-8f14-58210ab0f1d6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:58.826964 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-be9b5e72-c852-4a75-8f14-58210ab0f1d6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:58.827405 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-be9b5e72-c852-4a75-8f14-58210ab0f1d6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:58.860280 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-31cfcb60-1b30-44dc-a297-10036d5531ee tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:58.868003 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-31cfcb60-1b30-44dc-a297-10036d5531ee tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080240 Mar 03 02:56:58.868795 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1353/2949] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:58 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:58.951880 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ba2519c1-3868-4a44-b91c-7f6703fa17e3 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:58.952512 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ba2519c1-3868-4a44-b91c-7f6703fa17e3 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:58.958211 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ba2519c1-3868-4a44-b91c-7f6703fa17e3 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:58.958662 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ba2519c1-3868-4a44-b91c-7f6703fa17e3 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:58.959440 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ba2519c1-3868-4a44-b91c-7f6703fa17e3 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:58.959901 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ba2519c1-3868-4a44-b91c-7f6703fa17e3 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:58.962663 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-be9b5e72-c852-4a75-8f14-58210ab0f1d6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:58.970643 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-be9b5e72-c852-4a75-8f14-58210ab0f1d6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.157072 Mar 03 02:56:58.971371 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1597/2950] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:58 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:59.066768 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0f739457-ee1b-4996-b73c-1a6c0003b196 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:59.067371 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0f739457-ee1b-4996-b73c-1a6c0003b196 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:59.073052 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0f739457-ee1b-4996-b73c-1a6c0003b196 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:59.073492 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0f739457-ee1b-4996-b73c-1a6c0003b196 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:59.074265 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0f739457-ee1b-4996-b73c-1a6c0003b196 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:59.074698 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0f739457-ee1b-4996-b73c-1a6c0003b196 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:59.091691 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ba2519c1-3868-4a44-b91c-7f6703fa17e3 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:59.099456 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ba2519c1-3868-4a44-b91c-7f6703fa17e3 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.152184 Mar 03 02:56:59.100261 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1354/2951] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:58 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:59.205423 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0f739457-ee1b-4996-b73c-1a6c0003b196 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:59.213057 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0f739457-ee1b-4996-b73c-1a6c0003b196 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.150116 Mar 03 02:56:59.213626 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1598/2952] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:59 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:56:59.884588 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-abac63f7-9382-4d80-a096-cc185d8b5cb9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:59.885191 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-abac63f7-9382-4d80-a096-cc185d8b5cb9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:59.892223 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-abac63f7-9382-4d80-a096-cc185d8b5cb9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:59.892668 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-abac63f7-9382-4d80-a096-cc185d8b5cb9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:59.893441 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-abac63f7-9382-4d80-a096-cc185d8b5cb9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:59.894139 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-abac63f7-9382-4d80-a096-cc185d8b5cb9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:59.953637 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-abac63f7-9382-4d80-a096-cc185d8b5cb9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:56:59.961232 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-abac63f7-9382-4d80-a096-cc185d8b5cb9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080526 Mar 03 02:56:59.961787 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1355/2953] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:59 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:56:59.987820 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c7ae918f-a31b-405c-8150-a242dfc2fc2a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:56:59.988426 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c7ae918f-a31b-405c-8150-a242dfc2fc2a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:56:59.995097 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c7ae918f-a31b-405c-8150-a242dfc2fc2a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:59.995342 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c7ae918f-a31b-405c-8150-a242dfc2fc2a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:56:59.996198 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c7ae918f-a31b-405c-8150-a242dfc2fc2a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:56:59.996567 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c7ae918f-a31b-405c-8150-a242dfc2fc2a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:00.116552 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8ebb4be7-3981-4d61-8a81-97d4364c1648 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:00.117157 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8ebb4be7-3981-4d61-8a81-97d4364c1648 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:00.123376 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8ebb4be7-3981-4d61-8a81-97d4364c1648 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:00.123851 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8ebb4be7-3981-4d61-8a81-97d4364c1648 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:00.124612 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8ebb4be7-3981-4d61-8a81-97d4364c1648 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:00.125041 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8ebb4be7-3981-4d61-8a81-97d4364c1648 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:00.126293 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c7ae918f-a31b-405c-8150-a242dfc2fc2a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:00.134048 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c7ae918f-a31b-405c-8150-a242dfc2fc2a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.150001 Mar 03 02:57:00.134878 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1599/2954] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:56:59 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:00.230352 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f239b0d8-e497-40a6-8359-82993889a0f1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:00.230989 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f239b0d8-e497-40a6-8359-82993889a0f1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:00.237510 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f239b0d8-e497-40a6-8359-82993889a0f1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:00.237963 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f239b0d8-e497-40a6-8359-82993889a0f1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:00.238743 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f239b0d8-e497-40a6-8359-82993889a0f1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:00.239182 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f239b0d8-e497-40a6-8359-82993889a0f1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:00.259041 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8ebb4be7-3981-4d61-8a81-97d4364c1648 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:00.267204 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8ebb4be7-3981-4d61-8a81-97d4364c1648 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.154429 Mar 03 02:57:00.267813 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1356/2955] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:00 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:00.373104 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f239b0d8-e497-40a6-8359-82993889a0f1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:00.380845 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f239b0d8-e497-40a6-8359-82993889a0f1 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.154629 Mar 03 02:57:00.381412 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1600/2956] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:00 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:00.978167 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2091bd0d-5e4c-4a47-93b0-5a4f0f6478d9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:00.978807 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2091bd0d-5e4c-4a47-93b0-5a4f0f6478d9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:00.985499 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2091bd0d-5e4c-4a47-93b0-5a4f0f6478d9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:00.985955 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2091bd0d-5e4c-4a47-93b0-5a4f0f6478d9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:00.986736 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2091bd0d-5e4c-4a47-93b0-5a4f0f6478d9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:00.987178 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2091bd0d-5e4c-4a47-93b0-5a4f0f6478d9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:01.046107 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2091bd0d-5e4c-4a47-93b0-5a4f0f6478d9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:01.053956 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2091bd0d-5e4c-4a47-93b0-5a4f0f6478d9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079596 Mar 03 02:57:01.054553 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1357/2957] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:00 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:01.151138 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9366d1a1-7f84-4ef2-9dc9-a7c1adbec4d7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:01.151784 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9366d1a1-7f84-4ef2-9dc9-a7c1adbec4d7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:01.158020 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9366d1a1-7f84-4ef2-9dc9-a7c1adbec4d7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:01.158474 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9366d1a1-7f84-4ef2-9dc9-a7c1adbec4d7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:01.159251 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9366d1a1-7f84-4ef2-9dc9-a7c1adbec4d7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:01.159724 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9366d1a1-7f84-4ef2-9dc9-a7c1adbec4d7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:01.284914 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5c8e07c1-d693-46fd-a083-35a25c54ad18 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:01.285529 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5c8e07c1-d693-46fd-a083-35a25c54ad18 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:01.289804 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9366d1a1-7f84-4ef2-9dc9-a7c1adbec4d7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:01.291463 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5c8e07c1-d693-46fd-a083-35a25c54ad18 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:01.291955 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5c8e07c1-d693-46fd-a083-35a25c54ad18 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:01.292750 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5c8e07c1-d693-46fd-a083-35a25c54ad18 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:01.293192 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5c8e07c1-d693-46fd-a083-35a25c54ad18 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:01.297968 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9366d1a1-7f84-4ef2-9dc9-a7c1adbec4d7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.150640 Mar 03 02:57:01.298540 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1601/2958] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:01 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:01.398063 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-fd16763a-be21-4fc4-8f4e-36190c326e00 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:01.398813 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-fd16763a-be21-4fc4-8f4e-36190c326e00 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:01.405125 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fd16763a-be21-4fc4-8f4e-36190c326e00 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:01.405573 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fd16763a-be21-4fc4-8f4e-36190c326e00 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:01.406348 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fd16763a-be21-4fc4-8f4e-36190c326e00 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:01.406781 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fd16763a-be21-4fc4-8f4e-36190c326e00 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:01.429023 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5c8e07c1-d693-46fd-a083-35a25c54ad18 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:01.440404 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5c8e07c1-d693-46fd-a083-35a25c54ad18 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.159312 Mar 03 02:57:01.440989 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1358/2959] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:01 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:01.540714 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-fd16763a-be21-4fc4-8f4e-36190c326e00 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:01.548275 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-fd16763a-be21-4fc4-8f4e-36190c326e00 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.154049 Mar 03 02:57:01.548835 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1602/2960] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:01 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:02.071656 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6322d767-4b39-4706-ae25-b5abcc075bf3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:02.072265 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6322d767-4b39-4706-ae25-b5abcc075bf3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:02.078649 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6322d767-4b39-4706-ae25-b5abcc075bf3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:02.079097 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6322d767-4b39-4706-ae25-b5abcc075bf3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:02.079900 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6322d767-4b39-4706-ae25-b5abcc075bf3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:02.080337 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6322d767-4b39-4706-ae25-b5abcc075bf3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:02.139162 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-6322d767-4b39-4706-ae25-b5abcc075bf3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:02.146803 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6322d767-4b39-4706-ae25-b5abcc075bf3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079030 Mar 03 02:57:02.147385 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1359/2961] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:02 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:02.315443 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-aca921e8-758b-49d1-9a23-b596f16adc02 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:02.315995 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-aca921e8-758b-49d1-9a23-b596f16adc02 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:02.322173 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aca921e8-758b-49d1-9a23-b596f16adc02 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:02.322615 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aca921e8-758b-49d1-9a23-b596f16adc02 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:02.323380 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aca921e8-758b-49d1-9a23-b596f16adc02 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:02.323844 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aca921e8-758b-49d1-9a23-b596f16adc02 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:02.453837 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-aca921e8-758b-49d1-9a23-b596f16adc02 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:02.456665 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f74e604f-93d6-40dc-829d-3275553bc629 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:02.457337 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f74e604f-93d6-40dc-829d-3275553bc629 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:02.461590 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-aca921e8-758b-49d1-9a23-b596f16adc02 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.150045 Mar 03 02:57:02.462153 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1603/2962] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:02 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:02.463080 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f74e604f-93d6-40dc-829d-3275553bc629 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:02.463527 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f74e604f-93d6-40dc-829d-3275553bc629 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:02.464331 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f74e604f-93d6-40dc-829d-3275553bc629 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:02.464763 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f74e604f-93d6-40dc-829d-3275553bc629 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:02.565117 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0a7729f8-d6f3-48ee-9b8f-90ea4698bf07 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:02.565774 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0a7729f8-d6f3-48ee-9b8f-90ea4698bf07 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:02.571366 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0a7729f8-d6f3-48ee-9b8f-90ea4698bf07 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:02.571849 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0a7729f8-d6f3-48ee-9b8f-90ea4698bf07 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:02.572617 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0a7729f8-d6f3-48ee-9b8f-90ea4698bf07 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:02.573093 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0a7729f8-d6f3-48ee-9b8f-90ea4698bf07 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:02.597685 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f74e604f-93d6-40dc-829d-3275553bc629 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:02.605767 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f74e604f-93d6-40dc-829d-3275553bc629 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.152726 Mar 03 02:57:02.606434 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1360/2963] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:02 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:02.705747 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0a7729f8-d6f3-48ee-9b8f-90ea4698bf07 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:02.713410 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0a7729f8-d6f3-48ee-9b8f-90ea4698bf07 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.152089 Mar 03 02:57:02.713972 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1604/2964] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:02 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:03.163067 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e2713409-1581-4971-b322-c09f6fa77b12 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:03.163696 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e2713409-1581-4971-b322-c09f6fa77b12 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:03.170070 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e2713409-1581-4971-b322-c09f6fa77b12 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:03.170520 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e2713409-1581-4971-b322-c09f6fa77b12 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:03.171291 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e2713409-1581-4971-b322-c09f6fa77b12 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:03.171755 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e2713409-1581-4971-b322-c09f6fa77b12 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:03.231344 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e2713409-1581-4971-b322-c09f6fa77b12 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:03.239113 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e2713409-1581-4971-b322-c09f6fa77b12 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079885 Mar 03 02:57:03.239698 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1361/2965] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:03 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:03.478943 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ae7fb1d2-7fe4-456e-876c-60e404922bc3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:03.479582 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ae7fb1d2-7fe4-456e-876c-60e404922bc3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:03.486766 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ae7fb1d2-7fe4-456e-876c-60e404922bc3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:03.487215 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ae7fb1d2-7fe4-456e-876c-60e404922bc3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:03.488024 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ae7fb1d2-7fe4-456e-876c-60e404922bc3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:03.488463 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ae7fb1d2-7fe4-456e-876c-60e404922bc3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:03.623489 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c7260ebb-acce-4f76-afb2-3242b287f29d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:03.624140 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c7260ebb-acce-4f76-afb2-3242b287f29d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:03.627865 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ae7fb1d2-7fe4-456e-876c-60e404922bc3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:03.630181 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c7260ebb-acce-4f76-afb2-3242b287f29d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:03.630684 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c7260ebb-acce-4f76-afb2-3242b287f29d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:03.631478 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c7260ebb-acce-4f76-afb2-3242b287f29d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:03.631940 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c7260ebb-acce-4f76-afb2-3242b287f29d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:03.635859 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ae7fb1d2-7fe4-456e-876c-60e404922bc3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.160641 Mar 03 02:57:03.646090 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1605/2966] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:03 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:03.730964 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7589b304-81d2-429a-a114-6698149db2bc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:03.732520 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7589b304-81d2-429a-a114-6698149db2bc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:03.741659 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7589b304-81d2-429a-a114-6698149db2bc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:03.742566 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7589b304-81d2-429a-a114-6698149db2bc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:03.743740 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7589b304-81d2-429a-a114-6698149db2bc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:03.745857 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7589b304-81d2-429a-a114-6698149db2bc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:03.772907 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c7260ebb-acce-4f76-afb2-3242b287f29d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:03.781821 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c7260ebb-acce-4f76-afb2-3242b287f29d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.162808 Mar 03 02:57:03.782407 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1362/2967] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:03 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:03.888563 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-7589b304-81d2-429a-a114-6698149db2bc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:03.896407 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7589b304-81d2-429a-a114-6698149db2bc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.170058 Mar 03 02:57:03.896974 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1606/2968] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:03 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:04.256109 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-865951a2-3bf7-4ab5-b36b-3dbb9ab8f523 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:04.256636 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-865951a2-3bf7-4ab5-b36b-3dbb9ab8f523 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:04.263485 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-865951a2-3bf7-4ab5-b36b-3dbb9ab8f523 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:04.263963 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-865951a2-3bf7-4ab5-b36b-3dbb9ab8f523 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:04.264749 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-865951a2-3bf7-4ab5-b36b-3dbb9ab8f523 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:04.265191 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-865951a2-3bf7-4ab5-b36b-3dbb9ab8f523 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:04.323920 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-865951a2-3bf7-4ab5-b36b-3dbb9ab8f523 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:04.331847 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-865951a2-3bf7-4ab5-b36b-3dbb9ab8f523 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079685 Mar 03 02:57:04.332450 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1363/2969] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:04 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:04.654163 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9ee463d5-1edc-4056-812b-77046782d563 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:04.654778 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9ee463d5-1edc-4056-812b-77046782d563 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:04.661135 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9ee463d5-1edc-4056-812b-77046782d563 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:04.661580 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9ee463d5-1edc-4056-812b-77046782d563 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:04.662359 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9ee463d5-1edc-4056-812b-77046782d563 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:04.662798 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9ee463d5-1edc-4056-812b-77046782d563 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:04.797469 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9ee463d5-1edc-4056-812b-77046782d563 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:04.799111 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d5d7ec1c-59f1-45ec-bdea-faccd16acf5e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:04.799760 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d5d7ec1c-59f1-45ec-bdea-faccd16acf5e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:04.805526 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d5d7ec1c-59f1-45ec-bdea-faccd16acf5e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:04.805765 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9ee463d5-1edc-4056-812b-77046782d563 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.156037 Mar 03 02:57:04.805983 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d5d7ec1c-59f1-45ec-bdea-faccd16acf5e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:04.806332 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1607/2970] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:04 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:04.806772 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d5d7ec1c-59f1-45ec-bdea-faccd16acf5e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:04.807216 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d5d7ec1c-59f1-45ec-bdea-faccd16acf5e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:04.915801 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ae21c018-8454-41d0-ac37-a3ecb2944635 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:04.916647 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ae21c018-8454-41d0-ac37-a3ecb2944635 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:04.924377 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ae21c018-8454-41d0-ac37-a3ecb2944635 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:04.924907 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ae21c018-8454-41d0-ac37-a3ecb2944635 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:04.925777 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ae21c018-8454-41d0-ac37-a3ecb2944635 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:04.926281 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ae21c018-8454-41d0-ac37-a3ecb2944635 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:04.946599 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d5d7ec1c-59f1-45ec-bdea-faccd16acf5e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:04.954452 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d5d7ec1c-59f1-45ec-bdea-faccd16acf5e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.159998 Mar 03 02:57:04.955015 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1364/2971] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:04 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:05.058418 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ae21c018-8454-41d0-ac37-a3ecb2944635 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:05.066823 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ae21c018-8454-41d0-ac37-a3ecb2944635 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.156382 Mar 03 02:57:05.067384 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1608/2972] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:04 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:05.348475 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f8d8eedb-d35a-4d85-8d3c-6e0540b49359 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:05.349082 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f8d8eedb-d35a-4d85-8d3c-6e0540b49359 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:05.354841 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f8d8eedb-d35a-4d85-8d3c-6e0540b49359 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:05.355547 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f8d8eedb-d35a-4d85-8d3c-6e0540b49359 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:05.356336 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f8d8eedb-d35a-4d85-8d3c-6e0540b49359 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:05.357279 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f8d8eedb-d35a-4d85-8d3c-6e0540b49359 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:05.417596 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f8d8eedb-d35a-4d85-8d3c-6e0540b49359 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:05.425760 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f8d8eedb-d35a-4d85-8d3c-6e0540b49359 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.081587 Mar 03 02:57:05.426352 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1365/2973] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:05 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:05.822997 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-171c849d-8061-4896-b066-f4357b584ad2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:05.823633 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-171c849d-8061-4896-b066-f4357b584ad2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:05.830006 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-171c849d-8061-4896-b066-f4357b584ad2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:05.830453 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-171c849d-8061-4896-b066-f4357b584ad2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:05.831262 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-171c849d-8061-4896-b066-f4357b584ad2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:05.831730 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-171c849d-8061-4896-b066-f4357b584ad2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:05.964299 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-171c849d-8061-4896-b066-f4357b584ad2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:05.972374 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4815b6f1-92b1-424f-a04b-5124c23ac60d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:05.972694 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-171c849d-8061-4896-b066-f4357b584ad2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.153558 Mar 03 02:57:05.972986 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4815b6f1-92b1-424f-a04b-5124c23ac60d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:05.973338 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1609/2974] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:05 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:05.978832 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4815b6f1-92b1-424f-a04b-5124c23ac60d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:05.979287 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4815b6f1-92b1-424f-a04b-5124c23ac60d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:05.980378 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4815b6f1-92b1-424f-a04b-5124c23ac60d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:05.980821 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4815b6f1-92b1-424f-a04b-5124c23ac60d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:06.084127 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-479e341e-d114-4306-9f1e-8f8507eb6f6d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:06.084815 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-479e341e-d114-4306-9f1e-8f8507eb6f6d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:06.090468 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-479e341e-d114-4306-9f1e-8f8507eb6f6d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:06.091059 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-479e341e-d114-4306-9f1e-8f8507eb6f6d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:06.091884 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-479e341e-d114-4306-9f1e-8f8507eb6f6d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:06.092328 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-479e341e-d114-4306-9f1e-8f8507eb6f6d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:06.113981 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4815b6f1-92b1-424f-a04b-5124c23ac60d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:06.121796 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4815b6f1-92b1-424f-a04b-5124c23ac60d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.153245 Mar 03 02:57:06.123554 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1366/2975] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:05 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:06.224596 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-479e341e-d114-4306-9f1e-8f8507eb6f6d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:06.233419 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-479e341e-d114-4306-9f1e-8f8507eb6f6d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.153175 Mar 03 02:57:06.233997 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1610/2976] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:06 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:06.442787 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5948820f-d910-4f7f-b9bd-6e3baea72f1c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:06.443536 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5948820f-d910-4f7f-b9bd-6e3baea72f1c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:06.450191 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5948820f-d910-4f7f-b9bd-6e3baea72f1c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:06.450836 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5948820f-d910-4f7f-b9bd-6e3baea72f1c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:06.451686 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5948820f-d910-4f7f-b9bd-6e3baea72f1c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:06.452158 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5948820f-d910-4f7f-b9bd-6e3baea72f1c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:06.511772 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5948820f-d910-4f7f-b9bd-6e3baea72f1c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:06.519947 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5948820f-d910-4f7f-b9bd-6e3baea72f1c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080996 Mar 03 02:57:06.520521 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1367/2977] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:06 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:06.990171 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7a7be8c0-4e42-45fd-8e7f-370a4639234c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:06.990785 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7a7be8c0-4e42-45fd-8e7f-370a4639234c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:06.997763 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7a7be8c0-4e42-45fd-8e7f-370a4639234c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:06.998359 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7a7be8c0-4e42-45fd-8e7f-370a4639234c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:06.999154 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7a7be8c0-4e42-45fd-8e7f-370a4639234c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:06.999617 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7a7be8c0-4e42-45fd-8e7f-370a4639234c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:07.130450 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-7a7be8c0-4e42-45fd-8e7f-370a4639234c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:07.138181 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7a7be8c0-4e42-45fd-8e7f-370a4639234c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.151852 Mar 03 02:57:07.138741 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1611/2978] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:06 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:07.140324 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-99be0125-1f77-4dc0-8cbb-26972d355dcf tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:07.140937 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-99be0125-1f77-4dc0-8cbb-26972d355dcf tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:07.146793 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-99be0125-1f77-4dc0-8cbb-26972d355dcf tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:07.147249 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-99be0125-1f77-4dc0-8cbb-26972d355dcf tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:07.148072 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-99be0125-1f77-4dc0-8cbb-26972d355dcf tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:07.148517 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-99be0125-1f77-4dc0-8cbb-26972d355dcf tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:07.250209 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1718af93-1dd0-4d90-93a8-524cd04a61f4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:07.250880 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1718af93-1dd0-4d90-93a8-524cd04a61f4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:07.256646 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1718af93-1dd0-4d90-93a8-524cd04a61f4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:07.257167 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1718af93-1dd0-4d90-93a8-524cd04a61f4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:07.258013 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1718af93-1dd0-4d90-93a8-524cd04a61f4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:07.258531 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1718af93-1dd0-4d90-93a8-524cd04a61f4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:07.283292 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-99be0125-1f77-4dc0-8cbb-26972d355dcf tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:07.291231 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-99be0125-1f77-4dc0-8cbb-26972d355dcf tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.155446 Mar 03 02:57:07.291820 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1368/2979] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:07 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:07.390308 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1718af93-1dd0-4d90-93a8-524cd04a61f4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:07.397917 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1718af93-1dd0-4d90-93a8-524cd04a61f4 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.151638 Mar 03 02:57:07.398505 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1612/2980] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:07 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:07.537135 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1f3d0267-157b-404b-9e9f-59be4e3e7f63 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:07.537663 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1f3d0267-157b-404b-9e9f-59be4e3e7f63 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:07.543824 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1f3d0267-157b-404b-9e9f-59be4e3e7f63 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:07.544302 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1f3d0267-157b-404b-9e9f-59be4e3e7f63 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:07.545200 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1f3d0267-157b-404b-9e9f-59be4e3e7f63 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:07.545631 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1f3d0267-157b-404b-9e9f-59be4e3e7f63 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:07.603592 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1f3d0267-157b-404b-9e9f-59be4e3e7f63 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:07.611491 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1f3d0267-157b-404b-9e9f-59be4e3e7f63 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.078242 Mar 03 02:57:07.612077 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1369/2981] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:07 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:08.155435 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5ed7ba62-e4c1-4c21-bfb1-eafe8b13de7b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:08.156089 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5ed7ba62-e4c1-4c21-bfb1-eafe8b13de7b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:08.162281 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5ed7ba62-e4c1-4c21-bfb1-eafe8b13de7b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:08.162754 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5ed7ba62-e4c1-4c21-bfb1-eafe8b13de7b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:08.163519 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5ed7ba62-e4c1-4c21-bfb1-eafe8b13de7b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:08.163972 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5ed7ba62-e4c1-4c21-bfb1-eafe8b13de7b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:08.291189 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5ed7ba62-e4c1-4c21-bfb1-eafe8b13de7b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:08.299403 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5ed7ba62-e4c1-4c21-bfb1-eafe8b13de7b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.147951 Mar 03 02:57:08.300012 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1613/2982] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:08 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:08.309078 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5c7c692a-e5b0-4285-8193-d99546bd845b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:08.310439 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5c7c692a-e5b0-4285-8193-d99546bd845b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:08.316159 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5c7c692a-e5b0-4285-8193-d99546bd845b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:08.316608 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5c7c692a-e5b0-4285-8193-d99546bd845b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:08.317378 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5c7c692a-e5b0-4285-8193-d99546bd845b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:08.317812 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5c7c692a-e5b0-4285-8193-d99546bd845b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:08.415726 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-340d99a2-5755-42a1-8f09-945298b7e3b0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:08.416481 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-340d99a2-5755-42a1-8f09-945298b7e3b0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:08.423012 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-340d99a2-5755-42a1-8f09-945298b7e3b0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:08.423558 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-340d99a2-5755-42a1-8f09-945298b7e3b0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:08.424434 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-340d99a2-5755-42a1-8f09-945298b7e3b0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:08.424943 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-340d99a2-5755-42a1-8f09-945298b7e3b0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:08.448323 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5c7c692a-e5b0-4285-8193-d99546bd845b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:08.456112 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5c7c692a-e5b0-4285-8193-d99546bd845b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.150851 Mar 03 02:57:08.456684 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1370/2983] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:08 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:08.555711 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-340d99a2-5755-42a1-8f09-945298b7e3b0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:08.563905 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-340d99a2-5755-42a1-8f09-945298b7e3b0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.151925 Mar 03 02:57:08.564417 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1614/2984] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:08 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:08.628224 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4e0a451b-dfe0-4e20-8a65-3e621378134b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:08.628830 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4e0a451b-dfe0-4e20-8a65-3e621378134b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:08.635127 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4e0a451b-dfe0-4e20-8a65-3e621378134b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:08.635574 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4e0a451b-dfe0-4e20-8a65-3e621378134b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:08.636492 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4e0a451b-dfe0-4e20-8a65-3e621378134b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:08.636927 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4e0a451b-dfe0-4e20-8a65-3e621378134b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:08.698999 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4e0a451b-dfe0-4e20-8a65-3e621378134b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:08.707025 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4e0a451b-dfe0-4e20-8a65-3e621378134b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.082645 Mar 03 02:57:08.707586 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1371/2985] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:08 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:09.317495 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4517ab23-9ecf-4a65-90e7-0cd2e2e5c377 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:09.318075 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4517ab23-9ecf-4a65-90e7-0cd2e2e5c377 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:09.324265 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4517ab23-9ecf-4a65-90e7-0cd2e2e5c377 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:09.324716 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4517ab23-9ecf-4a65-90e7-0cd2e2e5c377 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:09.326271 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4517ab23-9ecf-4a65-90e7-0cd2e2e5c377 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:09.326715 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4517ab23-9ecf-4a65-90e7-0cd2e2e5c377 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:09.454069 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4517ab23-9ecf-4a65-90e7-0cd2e2e5c377 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:09.461773 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4517ab23-9ecf-4a65-90e7-0cd2e2e5c377 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.149084 Mar 03 02:57:09.462342 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1615/2986] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:09 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:09.472974 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-73d052ac-d464-43b6-aa52-d8547c61ad69 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:09.473578 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-73d052ac-d464-43b6-aa52-d8547c61ad69 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:09.479233 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-73d052ac-d464-43b6-aa52-d8547c61ad69 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:09.479708 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-73d052ac-d464-43b6-aa52-d8547c61ad69 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:09.480729 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-73d052ac-d464-43b6-aa52-d8547c61ad69 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:09.481163 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-73d052ac-d464-43b6-aa52-d8547c61ad69 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:09.580266 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0d1f485d-fab0-467d-90ed-1971224f3904 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:09.580878 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0d1f485d-fab0-467d-90ed-1971224f3904 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:09.587406 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0d1f485d-fab0-467d-90ed-1971224f3904 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:09.587896 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0d1f485d-fab0-467d-90ed-1971224f3904 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:09.588683 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0d1f485d-fab0-467d-90ed-1971224f3904 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:09.589126 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0d1f485d-fab0-467d-90ed-1971224f3904 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:09.615237 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-73d052ac-d464-43b6-aa52-d8547c61ad69 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:09.622926 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-73d052ac-d464-43b6-aa52-d8547c61ad69 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.153778 Mar 03 02:57:09.623495 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1372/2987] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:09 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:09.722970 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-dbcf450c-be75-4f3f-bf29-e72e129d4a66 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:09.724291 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-dbcf450c-be75-4f3f-bf29-e72e129d4a66 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:09.725105 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0d1f485d-fab0-467d-90ed-1971224f3904 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:09.730931 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dbcf450c-be75-4f3f-bf29-e72e129d4a66 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:09.731448 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dbcf450c-be75-4f3f-bf29-e72e129d4a66 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:09.732349 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dbcf450c-be75-4f3f-bf29-e72e129d4a66 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:09.732790 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dbcf450c-be75-4f3f-bf29-e72e129d4a66 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:09.733361 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0d1f485d-fab0-467d-90ed-1971224f3904 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.156963 Mar 03 02:57:09.733924 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1616/2988] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:09 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:09.792818 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-dbcf450c-be75-4f3f-bf29-e72e129d4a66 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:09.800415 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-dbcf450c-be75-4f3f-bf29-e72e129d4a66 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.081368 Mar 03 02:57:09.800981 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1373/2989] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:09 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:10.480338 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d610f6c8-922a-419e-a70f-6cd375d365d1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:10.481019 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d610f6c8-922a-419e-a70f-6cd375d365d1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:10.487847 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d610f6c8-922a-419e-a70f-6cd375d365d1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:10.488306 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d610f6c8-922a-419e-a70f-6cd375d365d1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:10.489119 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d610f6c8-922a-419e-a70f-6cd375d365d1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:10.489560 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d610f6c8-922a-419e-a70f-6cd375d365d1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:10.617449 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d610f6c8-922a-419e-a70f-6cd375d365d1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:10.625644 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d610f6c8-922a-419e-a70f-6cd375d365d1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.149434 Mar 03 02:57:10.626212 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1617/2990] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:10 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:10.639967 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f3553d8f-5071-4210-be65-732dec78a52d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:10.640580 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f3553d8f-5071-4210-be65-732dec78a52d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:10.646363 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f3553d8f-5071-4210-be65-732dec78a52d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:10.646820 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f3553d8f-5071-4210-be65-732dec78a52d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:10.647624 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f3553d8f-5071-4210-be65-732dec78a52d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:10.648070 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f3553d8f-5071-4210-be65-732dec78a52d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:10.750118 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6984cdb8-56f3-40d1-a84a-ab72bc0fe603 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:10.750657 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6984cdb8-56f3-40d1-a84a-ab72bc0fe603 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:10.756625 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6984cdb8-56f3-40d1-a84a-ab72bc0fe603 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:10.757086 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6984cdb8-56f3-40d1-a84a-ab72bc0fe603 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:10.757878 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6984cdb8-56f3-40d1-a84a-ab72bc0fe603 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:10.758319 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6984cdb8-56f3-40d1-a84a-ab72bc0fe603 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:10.782768 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f3553d8f-5071-4210-be65-732dec78a52d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:10.790967 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f3553d8f-5071-4210-be65-732dec78a52d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.154806 Mar 03 02:57:10.791555 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1374/2991] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:10 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:10.817186 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-fc247045-1f24-4b8e-9825-86326ec27dae tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:10.817913 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-fc247045-1f24-4b8e-9825-86326ec27dae tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:10.823771 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fc247045-1f24-4b8e-9825-86326ec27dae tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:10.824303 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fc247045-1f24-4b8e-9825-86326ec27dae tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:10.825093 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fc247045-1f24-4b8e-9825-86326ec27dae tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:10.826238 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fc247045-1f24-4b8e-9825-86326ec27dae tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:10.887122 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-fc247045-1f24-4b8e-9825-86326ec27dae tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:10.892152 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6984cdb8-56f3-40d1-a84a-ab72bc0fe603 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:10.895487 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-fc247045-1f24-4b8e-9825-86326ec27dae tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.082395 Mar 03 02:57:10.896098 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1375/2992] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:10 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:10.900071 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6984cdb8-56f3-40d1-a84a-ab72bc0fe603 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.153846 Mar 03 02:57:10.900623 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1618/2993] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:10 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:11.643012 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3a6749be-8695-4dcd-a60b-b8bb8ace6e25 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:11.643642 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3a6749be-8695-4dcd-a60b-b8bb8ace6e25 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:11.649446 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3a6749be-8695-4dcd-a60b-b8bb8ace6e25 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:11.649896 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3a6749be-8695-4dcd-a60b-b8bb8ace6e25 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:11.650666 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3a6749be-8695-4dcd-a60b-b8bb8ace6e25 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:11.651099 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3a6749be-8695-4dcd-a60b-b8bb8ace6e25 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:11.783832 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3a6749be-8695-4dcd-a60b-b8bb8ace6e25 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:11.791474 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3a6749be-8695-4dcd-a60b-b8bb8ace6e25 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.152335 Mar 03 02:57:11.792065 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1376/2994] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:11 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:11.808638 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9dbdf364-c849-4598-ab24-bf4540b7cf39 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:11.809249 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9dbdf364-c849-4598-ab24-bf4540b7cf39 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:11.815539 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9dbdf364-c849-4598-ab24-bf4540b7cf39 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:11.816018 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9dbdf364-c849-4598-ab24-bf4540b7cf39 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:11.816793 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9dbdf364-c849-4598-ab24-bf4540b7cf39 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:11.817236 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9dbdf364-c849-4598-ab24-bf4540b7cf39 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:11.914302 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1253d6d5-3fff-4cea-b141-4685427eb556 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:11.915366 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1253d6d5-3fff-4cea-b141-4685427eb556 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:11.922004 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1253d6d5-3fff-4cea-b141-4685427eb556 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:11.922561 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1253d6d5-3fff-4cea-b141-4685427eb556 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:11.923425 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1253d6d5-3fff-4cea-b141-4685427eb556 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:11.923955 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1253d6d5-3fff-4cea-b141-4685427eb556 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:11.952656 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9dbdf364-c849-4598-ab24-bf4540b7cf39 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:11.960574 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9dbdf364-c849-4598-ab24-bf4540b7cf39 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.155699 Mar 03 02:57:11.961144 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1619/2995] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:11 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:11.965782 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c24953f9-07ec-49f0-b853-f475b937215f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:11.966912 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c24953f9-07ec-49f0-b853-f475b937215f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:11.972616 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c24953f9-07ec-49f0-b853-f475b937215f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:11.973068 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c24953f9-07ec-49f0-b853-f475b937215f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:11.973853 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c24953f9-07ec-49f0-b853-f475b937215f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:11.974291 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c24953f9-07ec-49f0-b853-f475b937215f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:11.989136 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1253d6d5-3fff-4cea-b141-4685427eb556 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:11.996910 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1253d6d5-3fff-4cea-b141-4685427eb556 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.087821 Mar 03 02:57:11.997795 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1377/2996] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:11 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:12.105368 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c24953f9-07ec-49f0-b853-f475b937215f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:12.113430 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c24953f9-07ec-49f0-b853-f475b937215f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.151369 Mar 03 02:57:12.113992 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1620/2997] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:11 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:12.809277 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6251ab1b-8bf2-4aa5-b184-77988ef303f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:12.810511 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6251ab1b-8bf2-4aa5-b184-77988ef303f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:12.816969 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6251ab1b-8bf2-4aa5-b184-77988ef303f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:12.817420 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6251ab1b-8bf2-4aa5-b184-77988ef303f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:12.818190 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6251ab1b-8bf2-4aa5-b184-77988ef303f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:12.818628 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6251ab1b-8bf2-4aa5-b184-77988ef303f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:12.952444 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-6251ab1b-8bf2-4aa5-b184-77988ef303f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:12.960196 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6251ab1b-8bf2-4aa5-b184-77988ef303f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.154852 Mar 03 02:57:12.960768 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1378/2998] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:12 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:12.978027 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-950f5c2c-6316-4841-9404-7c50e100528a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:12.978633 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-950f5c2c-6316-4841-9404-7c50e100528a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:12.985877 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-950f5c2c-6316-4841-9404-7c50e100528a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:12.986331 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-950f5c2c-6316-4841-9404-7c50e100528a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:12.987107 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-950f5c2c-6316-4841-9404-7c50e100528a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:12.987544 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-950f5c2c-6316-4841-9404-7c50e100528a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:13.014095 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f2f40213-f8f0-4da2-9571-ba9040e89545 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:13.014705 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f2f40213-f8f0-4da2-9571-ba9040e89545 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:13.020647 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f2f40213-f8f0-4da2-9571-ba9040e89545 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:13.021098 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f2f40213-f8f0-4da2-9571-ba9040e89545 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:13.021880 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f2f40213-f8f0-4da2-9571-ba9040e89545 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:13.022323 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f2f40213-f8f0-4da2-9571-ba9040e89545 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:13.084029 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f2f40213-f8f0-4da2-9571-ba9040e89545 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:13.092355 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f2f40213-f8f0-4da2-9571-ba9040e89545 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.082655 Mar 03 02:57:13.092933 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1379/2999] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:13 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:13.124138 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-950f5c2c-6316-4841-9404-7c50e100528a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:13.129996 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-32047b12-8b17-429d-b21a-e57e153bb9b8 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:13.130598 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-32047b12-8b17-429d-b21a-e57e153bb9b8 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:13.131943 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-950f5c2c-6316-4841-9404-7c50e100528a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.157666 Mar 03 02:57:13.132511 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1621/3000] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:12 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:13.136594 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-32047b12-8b17-429d-b21a-e57e153bb9b8 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:13.137037 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-32047b12-8b17-429d-b21a-e57e153bb9b8 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:13.138338 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-32047b12-8b17-429d-b21a-e57e153bb9b8 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:13.138796 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-32047b12-8b17-429d-b21a-e57e153bb9b8 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:13.269961 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-32047b12-8b17-429d-b21a-e57e153bb9b8 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:13.277699 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-32047b12-8b17-429d-b21a-e57e153bb9b8 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.151492 Mar 03 02:57:13.278770 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1380/3001] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:13 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:13.978236 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-89912397-de54-4182-b270-db666346cef1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:13.978845 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-89912397-de54-4182-b270-db666346cef1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:13.985126 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-89912397-de54-4182-b270-db666346cef1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:13.985578 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-89912397-de54-4182-b270-db666346cef1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:13.986351 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-89912397-de54-4182-b270-db666346cef1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:13.986791 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-89912397-de54-4182-b270-db666346cef1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:14.109628 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-becb3feb-be32-4960-b939-d38281db1464 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:14.110237 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-becb3feb-be32-4960-b939-d38281db1464 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:14.117063 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-becb3feb-be32-4960-b939-d38281db1464 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:14.117519 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-becb3feb-be32-4960-b939-d38281db1464 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:14.117708 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-89912397-de54-4182-b270-db666346cef1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:14.118311 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-becb3feb-be32-4960-b939-d38281db1464 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:14.118751 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-becb3feb-be32-4960-b939-d38281db1464 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:14.126305 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-89912397-de54-4182-b270-db666346cef1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.151920 Mar 03 02:57:14.126894 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1622/3002] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:13 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:14.147958 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0d265148-9f59-4e10-bba2-b06370f4aef2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:14.148559 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0d265148-9f59-4e10-bba2-b06370f4aef2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:14.154320 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0d265148-9f59-4e10-bba2-b06370f4aef2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:14.154765 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0d265148-9f59-4e10-bba2-b06370f4aef2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:14.155533 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0d265148-9f59-4e10-bba2-b06370f4aef2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:14.156017 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0d265148-9f59-4e10-bba2-b06370f4aef2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:14.178600 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-becb3feb-be32-4960-b939-d38281db1464 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:14.187267 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-becb3feb-be32-4960-b939-d38281db1464 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.082394 Mar 03 02:57:14.187973 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1381/3003] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:14 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:14.285760 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0d265148-9f59-4e10-bba2-b06370f4aef2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:14.293563 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0d265148-9f59-4e10-bba2-b06370f4aef2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.149141 Mar 03 02:57:14.294635 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8e07ee09-9e1c-4542-ad14-d338bb5ee335 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:14.294839 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1623/3004] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:14 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:14.295536 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8e07ee09-9e1c-4542-ad14-d338bb5ee335 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:14.301789 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8e07ee09-9e1c-4542-ad14-d338bb5ee335 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:14.302247 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8e07ee09-9e1c-4542-ad14-d338bb5ee335 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:14.303075 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8e07ee09-9e1c-4542-ad14-d338bb5ee335 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:14.303552 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8e07ee09-9e1c-4542-ad14-d338bb5ee335 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:14.431381 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8e07ee09-9e1c-4542-ad14-d338bb5ee335 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:14.439690 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8e07ee09-9e1c-4542-ad14-d338bb5ee335 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.149371 Mar 03 02:57:14.440254 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1382/3005] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:14 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:15.144409 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a53413af-1be3-40e0-afcb-fea1aa044037 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:15.145013 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a53413af-1be3-40e0-afcb-fea1aa044037 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:15.151173 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a53413af-1be3-40e0-afcb-fea1aa044037 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:15.151646 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a53413af-1be3-40e0-afcb-fea1aa044037 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:15.152420 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a53413af-1be3-40e0-afcb-fea1aa044037 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:15.152847 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a53413af-1be3-40e0-afcb-fea1aa044037 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:15.208271 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-40099ca6-b88a-498f-8700-a291d32e445b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:15.211141 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-40099ca6-b88a-498f-8700-a291d32e445b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:15.218802 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-40099ca6-b88a-498f-8700-a291d32e445b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:15.219259 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-40099ca6-b88a-498f-8700-a291d32e445b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:15.220083 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-40099ca6-b88a-498f-8700-a291d32e445b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:15.220524 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-40099ca6-b88a-498f-8700-a291d32e445b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:15.282430 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-40099ca6-b88a-498f-8700-a291d32e445b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:15.290376 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-40099ca6-b88a-498f-8700-a291d32e445b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.090343 Mar 03 02:57:15.290956 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1383/3006] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:15 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:15.292590 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a53413af-1be3-40e0-afcb-fea1aa044037 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:15.300228 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a53413af-1be3-40e0-afcb-fea1aa044037 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.159682 Mar 03 02:57:15.300785 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1624/3007] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:15 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:15.312038 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1a3a2ec6-8d97-41f2-a519-4eba92195876 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:15.312586 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1a3a2ec6-8d97-41f2-a519-4eba92195876 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:15.318345 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1a3a2ec6-8d97-41f2-a519-4eba92195876 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:15.318800 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1a3a2ec6-8d97-41f2-a519-4eba92195876 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:15.319579 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1a3a2ec6-8d97-41f2-a519-4eba92195876 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:15.320041 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1a3a2ec6-8d97-41f2-a519-4eba92195876 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:15.451515 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1a3a2ec6-8d97-41f2-a519-4eba92195876 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:15.457035 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4a26eceb-9301-47a1-8c91-c5f7afa5a17a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:15.457646 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4a26eceb-9301-47a1-8c91-c5f7afa5a17a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:15.459272 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1a3a2ec6-8d97-41f2-a519-4eba92195876 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.151884 Mar 03 02:57:15.459871 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1384/3008] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:15 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:15.463502 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4a26eceb-9301-47a1-8c91-c5f7afa5a17a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:15.463985 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4a26eceb-9301-47a1-8c91-c5f7afa5a17a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:15.464763 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4a26eceb-9301-47a1-8c91-c5f7afa5a17a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:15.465196 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4a26eceb-9301-47a1-8c91-c5f7afa5a17a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:15.595540 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4a26eceb-9301-47a1-8c91-c5f7afa5a17a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:15.603186 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4a26eceb-9301-47a1-8c91-c5f7afa5a17a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.149942 Mar 03 02:57:15.603775 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1625/3009] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:15 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:16.307753 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b1736d1f-5606-403b-826e-ff12792c32cc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:16.308280 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b1736d1f-5606-403b-826e-ff12792c32cc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:16.315678 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b1736d1f-5606-403b-826e-ff12792c32cc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:16.316138 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b1736d1f-5606-403b-826e-ff12792c32cc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:16.316924 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b1736d1f-5606-403b-826e-ff12792c32cc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:16.317364 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b1736d1f-5606-403b-826e-ff12792c32cc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:16.317553 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6b507294-b40e-4ff4-8bb9-0d99808e9dd0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:16.318160 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6b507294-b40e-4ff4-8bb9-0d99808e9dd0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:16.324251 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6b507294-b40e-4ff4-8bb9-0d99808e9dd0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:16.324700 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6b507294-b40e-4ff4-8bb9-0d99808e9dd0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:16.325616 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6b507294-b40e-4ff4-8bb9-0d99808e9dd0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:16.326092 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6b507294-b40e-4ff4-8bb9-0d99808e9dd0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:16.377791 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b1736d1f-5606-403b-826e-ff12792c32cc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:16.385938 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b1736d1f-5606-403b-826e-ff12792c32cc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.082118 Mar 03 02:57:16.386701 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1385/3010] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:16 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:16.460034 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6b507294-b40e-4ff4-8bb9-0d99808e9dd0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:16.468420 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6b507294-b40e-4ff4-8bb9-0d99808e9dd0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.154691 Mar 03 02:57:16.469053 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1626/3011] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:16 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:16.476454 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8e52ea5c-42ba-4b16-9179-9bf940ac3d74 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:16.477061 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8e52ea5c-42ba-4b16-9179-9bf940ac3d74 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:16.483034 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8e52ea5c-42ba-4b16-9179-9bf940ac3d74 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:16.483484 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8e52ea5c-42ba-4b16-9179-9bf940ac3d74 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:16.484305 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8e52ea5c-42ba-4b16-9179-9bf940ac3d74 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:16.484756 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8e52ea5c-42ba-4b16-9179-9bf940ac3d74 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:16.615357 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8e52ea5c-42ba-4b16-9179-9bf940ac3d74 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:16.620811 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-aa0c2377-fc6c-471a-9585-7c54e6785ba2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:16.621507 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-aa0c2377-fc6c-471a-9585-7c54e6785ba2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:16.623291 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8e52ea5c-42ba-4b16-9179-9bf940ac3d74 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.150767 Mar 03 02:57:16.623884 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1386/3012] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:16 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:16.627914 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aa0c2377-fc6c-471a-9585-7c54e6785ba2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:16.628369 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aa0c2377-fc6c-471a-9585-7c54e6785ba2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:16.629151 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aa0c2377-fc6c-471a-9585-7c54e6785ba2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:16.629585 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aa0c2377-fc6c-471a-9585-7c54e6785ba2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:16.757383 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-aa0c2377-fc6c-471a-9585-7c54e6785ba2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:16.767190 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-aa0c2377-fc6c-471a-9585-7c54e6785ba2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.150224 Mar 03 02:57:16.767783 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1627/3013] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:16 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:17.402289 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4b86a029-3868-467d-9bc2-ba3bb7215733 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:17.402924 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4b86a029-3868-467d-9bc2-ba3bb7215733 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:17.409334 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4b86a029-3868-467d-9bc2-ba3bb7215733 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:17.409778 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4b86a029-3868-467d-9bc2-ba3bb7215733 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:17.410544 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4b86a029-3868-467d-9bc2-ba3bb7215733 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:17.411032 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4b86a029-3868-467d-9bc2-ba3bb7215733 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:17.473875 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4b86a029-3868-467d-9bc2-ba3bb7215733 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:17.482539 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4b86a029-3868-467d-9bc2-ba3bb7215733 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.084081 Mar 03 02:57:17.483107 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1387/3014] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:17 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:17.486264 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-af638c41-2eee-4ef0-90fa-162ba4b71733 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:17.486880 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-af638c41-2eee-4ef0-90fa-162ba4b71733 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:17.493111 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-af638c41-2eee-4ef0-90fa-162ba4b71733 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:17.493567 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-af638c41-2eee-4ef0-90fa-162ba4b71733 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:17.494350 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-af638c41-2eee-4ef0-90fa-162ba4b71733 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:17.494790 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-af638c41-2eee-4ef0-90fa-162ba4b71733 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:17.627048 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-af638c41-2eee-4ef0-90fa-162ba4b71733 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:17.634680 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-af638c41-2eee-4ef0-90fa-162ba4b71733 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.152248 Mar 03 02:57:17.635527 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1628/3015] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:17 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:17.640507 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-01b5138d-2635-462d-bc64-fbda5c6004c7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:17.641117 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-01b5138d-2635-462d-bc64-fbda5c6004c7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:17.646931 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-01b5138d-2635-462d-bc64-fbda5c6004c7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:17.647381 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-01b5138d-2635-462d-bc64-fbda5c6004c7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:17.648204 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-01b5138d-2635-462d-bc64-fbda5c6004c7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:17.648644 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-01b5138d-2635-462d-bc64-fbda5c6004c7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:17.776901 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-01b5138d-2635-462d-bc64-fbda5c6004c7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:17.784475 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1ae6c14f-7fff-453b-96da-a694c6555e79 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:17.785077 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1ae6c14f-7fff-453b-96da-a694c6555e79 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:17.785671 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-01b5138d-2635-462d-bc64-fbda5c6004c7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.149138 Mar 03 02:57:17.786247 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1388/3016] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:17 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:17.790775 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1ae6c14f-7fff-453b-96da-a694c6555e79 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:17.791223 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1ae6c14f-7fff-453b-96da-a694c6555e79 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:17.792017 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1ae6c14f-7fff-453b-96da-a694c6555e79 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:17.792449 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1ae6c14f-7fff-453b-96da-a694c6555e79 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:17.922684 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1ae6c14f-7fff-453b-96da-a694c6555e79 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:17.930270 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1ae6c14f-7fff-453b-96da-a694c6555e79 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.149620 Mar 03 02:57:17.930828 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1629/3017] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:17 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:18.498910 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-245b2348-015b-4fdb-a345-a18f8d2d59f9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:18.499520 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-245b2348-015b-4fdb-a345-a18f8d2d59f9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:18.505812 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-245b2348-015b-4fdb-a345-a18f8d2d59f9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:18.506264 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-245b2348-015b-4fdb-a345-a18f8d2d59f9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:18.507032 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-245b2348-015b-4fdb-a345-a18f8d2d59f9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:18.507471 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-245b2348-015b-4fdb-a345-a18f8d2d59f9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:18.565582 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-245b2348-015b-4fdb-a345-a18f8d2d59f9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:18.573075 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-245b2348-015b-4fdb-a345-a18f8d2d59f9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.078173 Mar 03 02:57:18.573639 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1389/3018] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:18 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:18.651928 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-28730a34-10fb-4502-8be9-5992372f9ea2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:18.652534 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-28730a34-10fb-4502-8be9-5992372f9ea2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:18.659462 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-28730a34-10fb-4502-8be9-5992372f9ea2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:18.659941 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-28730a34-10fb-4502-8be9-5992372f9ea2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:18.660721 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-28730a34-10fb-4502-8be9-5992372f9ea2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:18.661158 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-28730a34-10fb-4502-8be9-5992372f9ea2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:18.787715 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-28730a34-10fb-4502-8be9-5992372f9ea2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:18.795475 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-28730a34-10fb-4502-8be9-5992372f9ea2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.147321 Mar 03 02:57:18.796076 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1630/3019] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:18 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:18.804243 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-daf230cb-6d28-469a-8cd3-30b87d35cf5c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:18.804848 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-daf230cb-6d28-469a-8cd3-30b87d35cf5c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:18.810690 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-daf230cb-6d28-469a-8cd3-30b87d35cf5c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:18.811136 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-daf230cb-6d28-469a-8cd3-30b87d35cf5c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:18.811940 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-daf230cb-6d28-469a-8cd3-30b87d35cf5c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:18.812380 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-daf230cb-6d28-469a-8cd3-30b87d35cf5c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:18.946122 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-daf230cb-6d28-469a-8cd3-30b87d35cf5c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:18.947119 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-bb941569-64e3-4b02-ad4e-e662b61d643b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:18.947786 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-bb941569-64e3-4b02-ad4e-e662b61d643b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:18.954503 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bb941569-64e3-4b02-ad4e-e662b61d643b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:18.954924 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-daf230cb-6d28-469a-8cd3-30b87d35cf5c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.154450 Mar 03 02:57:18.955059 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bb941569-64e3-4b02-ad4e-e662b61d643b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:18.955502 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1390/3020] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:18 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:18.955729 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bb941569-64e3-4b02-ad4e-e662b61d643b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:18.956161 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bb941569-64e3-4b02-ad4e-e662b61d643b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:19.088374 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-bb941569-64e3-4b02-ad4e-e662b61d643b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:19.096052 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-bb941569-64e3-4b02-ad4e-e662b61d643b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.152668 Mar 03 02:57:19.096613 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1631/3021] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:18 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:19.590144 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-15468c38-dea0-44a6-b662-d1bc4bcd21bc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:19.590827 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-15468c38-dea0-44a6-b662-d1bc4bcd21bc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:19.597171 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-15468c38-dea0-44a6-b662-d1bc4bcd21bc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:19.597616 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-15468c38-dea0-44a6-b662-d1bc4bcd21bc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:19.598389 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-15468c38-dea0-44a6-b662-d1bc4bcd21bc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:19.598819 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-15468c38-dea0-44a6-b662-d1bc4bcd21bc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:19.659038 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-15468c38-dea0-44a6-b662-d1bc4bcd21bc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:19.666697 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-15468c38-dea0-44a6-b662-d1bc4bcd21bc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080423 Mar 03 02:57:19.667258 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1391/3022] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:19 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:19.812538 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d951ad52-41ab-4a66-afb4-307781b3e842 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:19.813146 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d951ad52-41ab-4a66-afb4-307781b3e842 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:19.819425 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d951ad52-41ab-4a66-afb4-307781b3e842 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:19.819911 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d951ad52-41ab-4a66-afb4-307781b3e842 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:19.820673 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d951ad52-41ab-4a66-afb4-307781b3e842 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:19.821102 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d951ad52-41ab-4a66-afb4-307781b3e842 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:19.951907 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d951ad52-41ab-4a66-afb4-307781b3e842 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:19.959569 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d951ad52-41ab-4a66-afb4-307781b3e842 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.150878 Mar 03 02:57:19.960156 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1632/3023] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:19 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:19.972593 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-55c49828-3d2e-4306-a029-fb8162f650b8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:19.973198 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-55c49828-3d2e-4306-a029-fb8162f650b8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:19.978912 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-55c49828-3d2e-4306-a029-fb8162f650b8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:19.979358 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-55c49828-3d2e-4306-a029-fb8162f650b8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:19.980408 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-55c49828-3d2e-4306-a029-fb8162f650b8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:19.980847 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-55c49828-3d2e-4306-a029-fb8162f650b8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:20.113333 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-230228ab-9be1-4055-8879-cbc973fddfc9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:20.113515 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-55c49828-3d2e-4306-a029-fb8162f650b8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:20.113938 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-230228ab-9be1-4055-8879-cbc973fddfc9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:20.119672 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-230228ab-9be1-4055-8879-cbc973fddfc9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:20.120122 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-230228ab-9be1-4055-8879-cbc973fddfc9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:20.120899 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-230228ab-9be1-4055-8879-cbc973fddfc9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:20.121182 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-55c49828-3d2e-4306-a029-fb8162f650b8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.152383 Mar 03 02:57:20.121360 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-230228ab-9be1-4055-8879-cbc973fddfc9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:20.121759 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1392/3024] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:19 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:20.254862 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-230228ab-9be1-4055-8879-cbc973fddfc9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:20.263162 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-230228ab-9be1-4055-8879-cbc973fddfc9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.153027 Mar 03 02:57:20.263788 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1633/3025] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:20 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:20.682943 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-30c38769-4082-4767-87f3-247438ccc52a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:20.683549 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-30c38769-4082-4767-87f3-247438ccc52a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:20.690342 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-30c38769-4082-4767-87f3-247438ccc52a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:20.690789 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-30c38769-4082-4767-87f3-247438ccc52a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:20.691560 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-30c38769-4082-4767-87f3-247438ccc52a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:20.692014 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-30c38769-4082-4767-87f3-247438ccc52a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:20.750622 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-30c38769-4082-4767-87f3-247438ccc52a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:20.758143 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-30c38769-4082-4767-87f3-247438ccc52a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079091 Mar 03 02:57:20.758706 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1393/3026] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:20 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:20.977248 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-462b563b-4192-49ec-802b-788860498dd8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:20.977775 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-462b563b-4192-49ec-802b-788860498dd8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:20.984960 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-462b563b-4192-49ec-802b-788860498dd8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:20.985409 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-462b563b-4192-49ec-802b-788860498dd8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:20.986181 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-462b563b-4192-49ec-802b-788860498dd8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:20.986620 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-462b563b-4192-49ec-802b-788860498dd8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:21.113945 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-462b563b-4192-49ec-802b-788860498dd8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:21.121598 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-462b563b-4192-49ec-802b-788860498dd8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.148344 Mar 03 02:57:21.122896 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1634/3027] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:20 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:21.138134 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f6dece85-ca9c-4b82-8873-d83226aa4727 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:21.138746 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f6dece85-ca9c-4b82-8873-d83226aa4727 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:21.144577 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f6dece85-ca9c-4b82-8873-d83226aa4727 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:21.145033 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f6dece85-ca9c-4b82-8873-d83226aa4727 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:21.145815 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f6dece85-ca9c-4b82-8873-d83226aa4727 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:21.146262 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f6dece85-ca9c-4b82-8873-d83226aa4727 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:21.280799 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-17682d27-ee3b-488c-a66d-f8b24c7596bc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:21.280972 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f6dece85-ca9c-4b82-8873-d83226aa4727 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:21.281405 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-17682d27-ee3b-488c-a66d-f8b24c7596bc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:21.287213 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-17682d27-ee3b-488c-a66d-f8b24c7596bc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:21.287699 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-17682d27-ee3b-488c-a66d-f8b24c7596bc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:21.288471 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-17682d27-ee3b-488c-a66d-f8b24c7596bc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:21.288699 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f6dece85-ca9c-4b82-8873-d83226aa4727 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.154485 Mar 03 02:57:21.288907 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-17682d27-ee3b-488c-a66d-f8b24c7596bc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:21.289267 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1394/3028] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:21 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:21.416952 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-17682d27-ee3b-488c-a66d-f8b24c7596bc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:21.425302 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-17682d27-ee3b-488c-a66d-f8b24c7596bc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.149029 Mar 03 02:57:21.425867 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1635/3029] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:21 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:21.775448 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a240292d-6532-4057-a379-2257c52c6b94 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:21.776084 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a240292d-6532-4057-a379-2257c52c6b94 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:21.783296 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a240292d-6532-4057-a379-2257c52c6b94 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:21.783787 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a240292d-6532-4057-a379-2257c52c6b94 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:21.784564 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a240292d-6532-4057-a379-2257c52c6b94 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:21.785000 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a240292d-6532-4057-a379-2257c52c6b94 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:21.844562 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a240292d-6532-4057-a379-2257c52c6b94 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:21.852233 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a240292d-6532-4057-a379-2257c52c6b94 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080617 Mar 03 02:57:21.852800 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1395/3030] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:21 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:22.139893 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-47dd8f31-02bf-4bfd-9277-520301c9723e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:22.140502 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-47dd8f31-02bf-4bfd-9277-520301c9723e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:22.146725 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-47dd8f31-02bf-4bfd-9277-520301c9723e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:22.147170 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-47dd8f31-02bf-4bfd-9277-520301c9723e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:22.147970 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-47dd8f31-02bf-4bfd-9277-520301c9723e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:22.148408 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-47dd8f31-02bf-4bfd-9277-520301c9723e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:22.279240 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-47dd8f31-02bf-4bfd-9277-520301c9723e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:22.286898 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-47dd8f31-02bf-4bfd-9277-520301c9723e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.151442 Mar 03 02:57:22.287458 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1636/3031] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:22 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:22.306164 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-83f08a7e-53f5-41fc-a00b-8d71b111724f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:22.306730 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-83f08a7e-53f5-41fc-a00b-8d71b111724f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:22.313089 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-83f08a7e-53f5-41fc-a00b-8d71b111724f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:22.313554 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-83f08a7e-53f5-41fc-a00b-8d71b111724f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:22.314341 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-83f08a7e-53f5-41fc-a00b-8d71b111724f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:22.314786 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-83f08a7e-53f5-41fc-a00b-8d71b111724f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:22.442200 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1d6aba55-6398-47af-a675-05aa24358545 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:22.442810 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1d6aba55-6398-47af-a675-05aa24358545 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:22.447068 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-83f08a7e-53f5-41fc-a00b-8d71b111724f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:22.448586 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1d6aba55-6398-47af-a675-05aa24358545 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:22.449029 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1d6aba55-6398-47af-a675-05aa24358545 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:22.449802 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1d6aba55-6398-47af-a675-05aa24358545 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:22.450241 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1d6aba55-6398-47af-a675-05aa24358545 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:22.455187 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-83f08a7e-53f5-41fc-a00b-8d71b111724f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.152851 Mar 03 02:57:22.455785 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1396/3032] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:22 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:22.578770 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1d6aba55-6398-47af-a675-05aa24358545 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:22.586421 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1d6aba55-6398-47af-a675-05aa24358545 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.148168 Mar 03 02:57:22.586992 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1637/3033] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:22 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:22.869793 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f132e91e-a7b5-46a6-a100-8fea9ac75da9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:22.870448 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f132e91e-a7b5-46a6-a100-8fea9ac75da9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:22.877125 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f132e91e-a7b5-46a6-a100-8fea9ac75da9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:22.877576 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f132e91e-a7b5-46a6-a100-8fea9ac75da9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:22.878352 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f132e91e-a7b5-46a6-a100-8fea9ac75da9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:22.878787 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f132e91e-a7b5-46a6-a100-8fea9ac75da9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:22.938317 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f132e91e-a7b5-46a6-a100-8fea9ac75da9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:22.946054 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f132e91e-a7b5-46a6-a100-8fea9ac75da9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080342 Mar 03 02:57:22.946614 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1397/3034] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:22 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:23.304733 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-908119e3-d658-4c83-bc91-63ec5de57b63 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:23.305274 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-908119e3-d658-4c83-bc91-63ec5de57b63 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:23.311452 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-908119e3-d658-4c83-bc91-63ec5de57b63 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:23.311937 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-908119e3-d658-4c83-bc91-63ec5de57b63 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:23.312729 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-908119e3-d658-4c83-bc91-63ec5de57b63 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:23.313201 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-908119e3-d658-4c83-bc91-63ec5de57b63 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:23.445775 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-908119e3-d658-4c83-bc91-63ec5de57b63 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:23.454112 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-908119e3-d658-4c83-bc91-63ec5de57b63 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.153365 Mar 03 02:57:23.454676 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1638/3035] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:23 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:23.472114 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-cb38c23b-87f4-495e-87b9-255a18dce5b1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:23.472729 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-cb38c23b-87f4-495e-87b9-255a18dce5b1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:23.478520 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cb38c23b-87f4-495e-87b9-255a18dce5b1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:23.478981 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cb38c23b-87f4-495e-87b9-255a18dce5b1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:23.479791 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cb38c23b-87f4-495e-87b9-255a18dce5b1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:23.480489 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cb38c23b-87f4-495e-87b9-255a18dce5b1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:23.603737 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-00328543-6526-4e27-bd3a-e48e6c74b77b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:23.604340 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-00328543-6526-4e27-bd3a-e48e6c74b77b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:23.610304 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-00328543-6526-4e27-bd3a-e48e6c74b77b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:23.610754 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-00328543-6526-4e27-bd3a-e48e6c74b77b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:23.611535 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-00328543-6526-4e27-bd3a-e48e6c74b77b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:23.611992 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-00328543-6526-4e27-bd3a-e48e6c74b77b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:23.612210 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-cb38c23b-87f4-495e-87b9-255a18dce5b1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:23.619987 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-cb38c23b-87f4-495e-87b9-255a18dce5b1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.151754 Mar 03 02:57:23.620563 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1398/3036] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:23 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:23.742584 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-00328543-6526-4e27-bd3a-e48e6c74b77b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:23.750813 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-00328543-6526-4e27-bd3a-e48e6c74b77b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.150908 Mar 03 02:57:23.751382 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1639/3037] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:23 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:23.962279 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2bf23aaf-e46c-42b6-b600-e1f64f225473 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:23.962884 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2bf23aaf-e46c-42b6-b600-e1f64f225473 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:23.969298 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2bf23aaf-e46c-42b6-b600-e1f64f225473 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:23.969745 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2bf23aaf-e46c-42b6-b600-e1f64f225473 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:23.970515 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2bf23aaf-e46c-42b6-b600-e1f64f225473 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:23.970947 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2bf23aaf-e46c-42b6-b600-e1f64f225473 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:24.031456 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2bf23aaf-e46c-42b6-b600-e1f64f225473 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:24.039123 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2bf23aaf-e46c-42b6-b600-e1f64f225473 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080741 Mar 03 02:57:24.039701 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1399/3038] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:23 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:24.174498 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 02:57:24.174708 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: Thu Mar 3 02:57:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 03 02:57:24.470935 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d8149ffb-2f42-4e39-8a3e-33ad0fb29cea tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:24.471542 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d8149ffb-2f42-4e39-8a3e-33ad0fb29cea tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:24.477718 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d8149ffb-2f42-4e39-8a3e-33ad0fb29cea tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:24.478159 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d8149ffb-2f42-4e39-8a3e-33ad0fb29cea tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:24.478924 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d8149ffb-2f42-4e39-8a3e-33ad0fb29cea tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:24.479355 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d8149ffb-2f42-4e39-8a3e-33ad0fb29cea tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:24.614367 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d8149ffb-2f42-4e39-8a3e-33ad0fb29cea tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:24.622717 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d8149ffb-2f42-4e39-8a3e-33ad0fb29cea tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.155631 Mar 03 02:57:24.623286 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1640/3039] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:24 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:24.638781 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6e6df17a-5c85-4c03-9b9b-231eb210bb56 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:24.639391 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6e6df17a-5c85-4c03-9b9b-231eb210bb56 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:24.645181 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6e6df17a-5c85-4c03-9b9b-231eb210bb56 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:24.645639 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6e6df17a-5c85-4c03-9b9b-231eb210bb56 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:24.646418 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6e6df17a-5c85-4c03-9b9b-231eb210bb56 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:24.646855 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6e6df17a-5c85-4c03-9b9b-231eb210bb56 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:24.767903 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-06d6d7a6-5e1f-41ce-ae1b-28d02f75c226 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:24.768632 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-06d6d7a6-5e1f-41ce-ae1b-28d02f75c226 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:24.774342 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-06d6d7a6-5e1f-41ce-ae1b-28d02f75c226 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:24.774789 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-06d6d7a6-5e1f-41ce-ae1b-28d02f75c226 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:24.775562 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-06d6d7a6-5e1f-41ce-ae1b-28d02f75c226 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:24.776016 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-06d6d7a6-5e1f-41ce-ae1b-28d02f75c226 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:24.781476 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-6e6df17a-5c85-4c03-9b9b-231eb210bb56 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:24.789166 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6e6df17a-5c85-4c03-9b9b-231eb210bb56 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.154856 Mar 03 02:57:24.789745 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1400/3040] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:24 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:24.905333 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-06d6d7a6-5e1f-41ce-ae1b-28d02f75c226 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:24.913114 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-06d6d7a6-5e1f-41ce-ae1b-28d02f75c226 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.149156 Mar 03 02:57:24.913683 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1641/3041] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:24 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:25.056248 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-97e4914b-067f-43b3-9e7b-da2c0d889db0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:25.056862 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-97e4914b-067f-43b3-9e7b-da2c0d889db0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:25.063237 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-97e4914b-067f-43b3-9e7b-da2c0d889db0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:25.063731 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-97e4914b-067f-43b3-9e7b-da2c0d889db0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:25.064514 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-97e4914b-067f-43b3-9e7b-da2c0d889db0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:25.064953 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-97e4914b-067f-43b3-9e7b-da2c0d889db0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:25.123613 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-97e4914b-067f-43b3-9e7b-da2c0d889db0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:25.134769 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-97e4914b-067f-43b3-9e7b-da2c0d889db0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.082220 Mar 03 02:57:25.135447 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1401/3042] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:25 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:25.639460 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-55d9aedc-9aeb-496c-a7f9-046ffa930b02 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:25.640104 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-55d9aedc-9aeb-496c-a7f9-046ffa930b02 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:25.646283 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-55d9aedc-9aeb-496c-a7f9-046ffa930b02 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:25.646745 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-55d9aedc-9aeb-496c-a7f9-046ffa930b02 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:25.647514 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-55d9aedc-9aeb-496c-a7f9-046ffa930b02 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:25.647976 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-55d9aedc-9aeb-496c-a7f9-046ffa930b02 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:25.776443 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-55d9aedc-9aeb-496c-a7f9-046ffa930b02 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:25.784297 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-55d9aedc-9aeb-496c-a7f9-046ffa930b02 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.149316 Mar 03 02:57:25.784863 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1642/3043] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:25 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:25.806039 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-130a0474-a1c4-4dcd-a249-ecc0f1b0852a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:25.806678 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-130a0474-a1c4-4dcd-a249-ecc0f1b0852a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:25.813619 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-130a0474-a1c4-4dcd-a249-ecc0f1b0852a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:25.814070 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-130a0474-a1c4-4dcd-a249-ecc0f1b0852a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:25.814852 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-130a0474-a1c4-4dcd-a249-ecc0f1b0852a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:25.815289 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-130a0474-a1c4-4dcd-a249-ecc0f1b0852a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:25.930218 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ab1122a1-67ae-4d51-a5cc-1973a9542e93 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:25.931043 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ab1122a1-67ae-4d51-a5cc-1973a9542e93 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:25.937455 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ab1122a1-67ae-4d51-a5cc-1973a9542e93 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:25.937987 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ab1122a1-67ae-4d51-a5cc-1973a9542e93 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:25.938845 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ab1122a1-67ae-4d51-a5cc-1973a9542e93 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:25.939359 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ab1122a1-67ae-4d51-a5cc-1973a9542e93 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:25.945227 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-130a0474-a1c4-4dcd-a249-ecc0f1b0852a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:25.953609 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-130a0474-a1c4-4dcd-a249-ecc0f1b0852a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.151359 Mar 03 02:57:25.954177 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1402/3044] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:25 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:26.072743 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ab1122a1-67ae-4d51-a5cc-1973a9542e93 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:26.080417 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ab1122a1-67ae-4d51-a5cc-1973a9542e93 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.154137 Mar 03 02:57:26.080992 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1643/3045] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:25 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:26.151337 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0bafa14a-a7dc-4a69-832d-6b96f378c0c3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:26.151911 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0bafa14a-a7dc-4a69-832d-6b96f378c0c3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:26.158085 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0bafa14a-a7dc-4a69-832d-6b96f378c0c3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:26.158530 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0bafa14a-a7dc-4a69-832d-6b96f378c0c3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:26.159294 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0bafa14a-a7dc-4a69-832d-6b96f378c0c3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:26.159762 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0bafa14a-a7dc-4a69-832d-6b96f378c0c3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:26.225083 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0bafa14a-a7dc-4a69-832d-6b96f378c0c3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:26.233815 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0bafa14a-a7dc-4a69-832d-6b96f378c0c3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.086382 Mar 03 02:57:26.234394 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1403/3046] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:26 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:26.801604 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9c055aab-9cb1-43d8-a012-20a2edcc2eae tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:26.802222 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9c055aab-9cb1-43d8-a012-20a2edcc2eae tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:26.808595 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9c055aab-9cb1-43d8-a012-20a2edcc2eae tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:26.809055 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9c055aab-9cb1-43d8-a012-20a2edcc2eae tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:26.810416 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9c055aab-9cb1-43d8-a012-20a2edcc2eae tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:26.810873 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9c055aab-9cb1-43d8-a012-20a2edcc2eae tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:26.945443 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9c055aab-9cb1-43d8-a012-20a2edcc2eae tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:26.953651 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9c055aab-9cb1-43d8-a012-20a2edcc2eae tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.156058 Mar 03 02:57:26.954222 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1644/3047] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:26 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:26.970421 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b8d0271a-02c2-4871-9583-6270eaa41cd8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:26.971088 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b8d0271a-02c2-4871-9583-6270eaa41cd8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:26.976843 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b8d0271a-02c2-4871-9583-6270eaa41cd8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:26.977308 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b8d0271a-02c2-4871-9583-6270eaa41cd8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:26.978084 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b8d0271a-02c2-4871-9583-6270eaa41cd8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:26.978521 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b8d0271a-02c2-4871-9583-6270eaa41cd8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:27.098014 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-800b3e4f-2108-442e-83e2-59377d6b59ce tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:27.098959 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-800b3e4f-2108-442e-83e2-59377d6b59ce tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:27.104357 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-800b3e4f-2108-442e-83e2-59377d6b59ce tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:27.104816 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-800b3e4f-2108-442e-83e2-59377d6b59ce tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:27.105863 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-800b3e4f-2108-442e-83e2-59377d6b59ce tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:27.106309 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-800b3e4f-2108-442e-83e2-59377d6b59ce tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:27.109256 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b8d0271a-02c2-4871-9583-6270eaa41cd8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:27.117111 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b8d0271a-02c2-4871-9583-6270eaa41cd8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.150746 Mar 03 02:57:27.117690 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1404/3048] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:26 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:27.251312 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-84c18eea-c5f8-46c2-aa59-a3913135c76c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:27.252034 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-84c18eea-c5f8-46c2-aa59-a3913135c76c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:27.258392 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-84c18eea-c5f8-46c2-aa59-a3913135c76c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:27.258848 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-84c18eea-c5f8-46c2-aa59-a3913135c76c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:27.259664 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-84c18eea-c5f8-46c2-aa59-a3913135c76c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:27.260100 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-84c18eea-c5f8-46c2-aa59-a3913135c76c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:27.322130 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-84c18eea-c5f8-46c2-aa59-a3913135c76c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:27.330374 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-84c18eea-c5f8-46c2-aa59-a3913135c76c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.083691 Mar 03 02:57:27.330968 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1405/3049] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:27 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:27.473692 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-800b3e4f-2108-442e-83e2-59377d6b59ce tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:27.482350 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-800b3e4f-2108-442e-83e2-59377d6b59ce tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.387609 Mar 03 02:57:27.483435 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1645/3050] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:27 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:27.970267 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3d0e0cb6-009d-4a3d-bf3a-0d92e65b086e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:27.970865 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3d0e0cb6-009d-4a3d-bf3a-0d92e65b086e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:27.976741 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3d0e0cb6-009d-4a3d-bf3a-0d92e65b086e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:27.977188 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3d0e0cb6-009d-4a3d-bf3a-0d92e65b086e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:27.977980 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3d0e0cb6-009d-4a3d-bf3a-0d92e65b086e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:27.978416 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3d0e0cb6-009d-4a3d-bf3a-0d92e65b086e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:28.112426 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3d0e0cb6-009d-4a3d-bf3a-0d92e65b086e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:28.120296 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3d0e0cb6-009d-4a3d-bf3a-0d92e65b086e tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.153933 Mar 03 02:57:28.120895 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1406/3051] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:27 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:28.134013 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-dda3b6b9-ea2a-4025-bc61-72c778fdc7b0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:28.134624 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-dda3b6b9-ea2a-4025-bc61-72c778fdc7b0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:28.141504 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dda3b6b9-ea2a-4025-bc61-72c778fdc7b0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:28.141964 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dda3b6b9-ea2a-4025-bc61-72c778fdc7b0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:28.142738 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dda3b6b9-ea2a-4025-bc61-72c778fdc7b0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:28.143177 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dda3b6b9-ea2a-4025-bc61-72c778fdc7b0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:28.272173 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-dda3b6b9-ea2a-4025-bc61-72c778fdc7b0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:28.279957 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-dda3b6b9-ea2a-4025-bc61-72c778fdc7b0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.149708 Mar 03 02:57:28.280525 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1646/3052] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:28 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:28.346142 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2caf3e12-acbb-4826-9b78-0d8c9dae03cc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:28.346756 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2caf3e12-acbb-4826-9b78-0d8c9dae03cc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:28.352964 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2caf3e12-acbb-4826-9b78-0d8c9dae03cc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:28.353419 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2caf3e12-acbb-4826-9b78-0d8c9dae03cc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:28.354223 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2caf3e12-acbb-4826-9b78-0d8c9dae03cc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:28.354650 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2caf3e12-acbb-4826-9b78-0d8c9dae03cc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:28.414302 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2caf3e12-acbb-4826-9b78-0d8c9dae03cc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:28.422480 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2caf3e12-acbb-4826-9b78-0d8c9dae03cc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080259 Mar 03 02:57:28.423048 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1407/3053] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:28 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:28.500796 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c715c079-5686-4608-a9dd-863ad7866159 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:28.501332 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c715c079-5686-4608-a9dd-863ad7866159 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:28.506980 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c715c079-5686-4608-a9dd-863ad7866159 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:28.507425 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c715c079-5686-4608-a9dd-863ad7866159 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:28.508231 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c715c079-5686-4608-a9dd-863ad7866159 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:28.508663 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c715c079-5686-4608-a9dd-863ad7866159 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:28.641673 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c715c079-5686-4608-a9dd-863ad7866159 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:28.649282 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c715c079-5686-4608-a9dd-863ad7866159 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.153207 Mar 03 02:57:28.649842 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1647/3054] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:28 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:29.138433 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d9424b53-11ce-4432-8d68-7b27b1f60f42 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:29.139197 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d9424b53-11ce-4432-8d68-7b27b1f60f42 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:29.145257 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d9424b53-11ce-4432-8d68-7b27b1f60f42 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:29.145804 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d9424b53-11ce-4432-8d68-7b27b1f60f42 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:29.146588 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d9424b53-11ce-4432-8d68-7b27b1f60f42 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:29.147031 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d9424b53-11ce-4432-8d68-7b27b1f60f42 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:29.278123 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d9424b53-11ce-4432-8d68-7b27b1f60f42 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:29.287314 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d9424b53-11ce-4432-8d68-7b27b1f60f42 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.153274 Mar 03 02:57:29.287951 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1408/3055] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:29 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:29.297257 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4fdc2b01-9d2c-49f2-957e-d36da245556c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:29.297863 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4fdc2b01-9d2c-49f2-957e-d36da245556c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:29.304101 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4fdc2b01-9d2c-49f2-957e-d36da245556c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:29.304491 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4fdc2b01-9d2c-49f2-957e-d36da245556c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:29.305258 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4fdc2b01-9d2c-49f2-957e-d36da245556c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:29.305689 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4fdc2b01-9d2c-49f2-957e-d36da245556c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:29.433523 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4fdc2b01-9d2c-49f2-957e-d36da245556c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:29.438559 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-380ae521-8937-45d1-a360-e9b9114a3da2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:29.439167 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-380ae521-8937-45d1-a360-e9b9114a3da2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:29.442164 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4fdc2b01-9d2c-49f2-957e-d36da245556c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.149572 Mar 03 02:57:29.442742 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1648/3056] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:29 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:29.445675 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-380ae521-8937-45d1-a360-e9b9114a3da2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:29.446167 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-380ae521-8937-45d1-a360-e9b9114a3da2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:29.446957 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-380ae521-8937-45d1-a360-e9b9114a3da2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:29.447399 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-380ae521-8937-45d1-a360-e9b9114a3da2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:29.512041 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-380ae521-8937-45d1-a360-e9b9114a3da2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:29.522615 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-380ae521-8937-45d1-a360-e9b9114a3da2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.088281 Mar 03 02:57:29.523370 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1409/3057] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:29 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:29.665647 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-18754044-9cd0-4f0f-aef8-7b6eef25f9d0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:29.666282 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-18754044-9cd0-4f0f-aef8-7b6eef25f9d0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:29.672081 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-18754044-9cd0-4f0f-aef8-7b6eef25f9d0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:29.672531 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-18754044-9cd0-4f0f-aef8-7b6eef25f9d0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:29.673301 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-18754044-9cd0-4f0f-aef8-7b6eef25f9d0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:29.673736 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-18754044-9cd0-4f0f-aef8-7b6eef25f9d0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:29.800685 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-18754044-9cd0-4f0f-aef8-7b6eef25f9d0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:29.808301 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-18754044-9cd0-4f0f-aef8-7b6eef25f9d0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.146482 Mar 03 02:57:29.808857 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1649/3058] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:29 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:30.304722 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-60daaef2-7806-4e3f-b80d-3f5a241b593c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:30.305430 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-60daaef2-7806-4e3f-b80d-3f5a241b593c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:30.312135 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-60daaef2-7806-4e3f-b80d-3f5a241b593c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:30.312579 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-60daaef2-7806-4e3f-b80d-3f5a241b593c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:30.313352 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-60daaef2-7806-4e3f-b80d-3f5a241b593c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:30.313783 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-60daaef2-7806-4e3f-b80d-3f5a241b593c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:30.450452 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-60daaef2-7806-4e3f-b80d-3f5a241b593c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:30.458460 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-60daaef2-7806-4e3f-b80d-3f5a241b593c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.157656 Mar 03 02:57:30.459056 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1410/3059] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:30 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:30.460084 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-98488453-736f-4edc-8ca7-dea35ea41271 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:30.460690 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-98488453-736f-4edc-8ca7-dea35ea41271 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:30.468518 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-98488453-736f-4edc-8ca7-dea35ea41271 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:30.468518 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-98488453-736f-4edc-8ca7-dea35ea41271 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:30.469222 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-98488453-736f-4edc-8ca7-dea35ea41271 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:30.469654 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-98488453-736f-4edc-8ca7-dea35ea41271 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:30.539661 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4ce6b6af-d73c-464e-8d8a-48c01cecf339 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:30.540399 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4ce6b6af-d73c-464e-8d8a-48c01cecf339 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:30.546492 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4ce6b6af-d73c-464e-8d8a-48c01cecf339 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:30.546938 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4ce6b6af-d73c-464e-8d8a-48c01cecf339 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:30.547770 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4ce6b6af-d73c-464e-8d8a-48c01cecf339 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:30.548200 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4ce6b6af-d73c-464e-8d8a-48c01cecf339 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:30.610443 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4ce6b6af-d73c-464e-8d8a-48c01cecf339 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:30.618253 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4ce6b6af-d73c-464e-8d8a-48c01cecf339 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.082399 Mar 03 02:57:30.618797 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-98488453-736f-4edc-8ca7-dea35ea41271 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:30.618972 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1411/3060] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:30 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:30.626678 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-98488453-736f-4edc-8ca7-dea35ea41271 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.170434 Mar 03 02:57:30.627233 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1650/3061] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:30 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:30.826091 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c8c078c8-1210-49eb-8d6c-be7aa9314e8e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:30.826696 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c8c078c8-1210-49eb-8d6c-be7aa9314e8e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:30.832559 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c8c078c8-1210-49eb-8d6c-be7aa9314e8e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:30.833000 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c8c078c8-1210-49eb-8d6c-be7aa9314e8e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:30.833769 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c8c078c8-1210-49eb-8d6c-be7aa9314e8e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:30.834195 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c8c078c8-1210-49eb-8d6c-be7aa9314e8e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:30.969111 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c8c078c8-1210-49eb-8d6c-be7aa9314e8e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:30.976720 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c8c078c8-1210-49eb-8d6c-be7aa9314e8e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.154979 Mar 03 02:57:30.977279 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1412/3062] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:30 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:31.476680 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e4b2f447-a701-4107-bfd5-eb3ef5b51c61 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:31.477288 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e4b2f447-a701-4107-bfd5-eb3ef5b51c61 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:31.483786 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e4b2f447-a701-4107-bfd5-eb3ef5b51c61 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:31.484230 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e4b2f447-a701-4107-bfd5-eb3ef5b51c61 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:31.484994 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e4b2f447-a701-4107-bfd5-eb3ef5b51c61 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:31.485426 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e4b2f447-a701-4107-bfd5-eb3ef5b51c61 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:31.612220 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e4b2f447-a701-4107-bfd5-eb3ef5b51c61 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:31.619866 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e4b2f447-a701-4107-bfd5-eb3ef5b51c61 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.146990 Mar 03 02:57:31.620433 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1651/3063] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:31 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:31.634037 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-cfa2eb34-4aeb-4f47-858e-d5475450b7ec tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:31.634644 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-cfa2eb34-4aeb-4f47-858e-d5475450b7ec tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:31.641332 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cfa2eb34-4aeb-4f47-858e-d5475450b7ec tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:31.641772 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cfa2eb34-4aeb-4f47-858e-d5475450b7ec tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:31.642545 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cfa2eb34-4aeb-4f47-858e-d5475450b7ec tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:31.642979 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cfa2eb34-4aeb-4f47-858e-d5475450b7ec tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:31.644413 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c4f7c475-0d7e-437b-961f-954c70708337 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:31.645167 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c4f7c475-0d7e-437b-961f-954c70708337 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:31.652034 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c4f7c475-0d7e-437b-961f-954c70708337 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:31.652488 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c4f7c475-0d7e-437b-961f-954c70708337 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:31.653260 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c4f7c475-0d7e-437b-961f-954c70708337 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:31.654449 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c4f7c475-0d7e-437b-961f-954c70708337 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:31.704263 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-cfa2eb34-4aeb-4f47-858e-d5475450b7ec tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:31.711966 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-cfa2eb34-4aeb-4f47-858e-d5475450b7ec tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.081665 Mar 03 02:57:31.712541 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1413/3064] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:31 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:31.789802 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c4f7c475-0d7e-437b-961f-954c70708337 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:31.798113 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c4f7c475-0d7e-437b-961f-954c70708337 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.158127 Mar 03 02:57:31.798692 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1652/3065] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:31 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:31.993513 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-51e88d4d-d084-4d98-b91e-3b3bd9c62876 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:31.994124 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-51e88d4d-d084-4d98-b91e-3b3bd9c62876 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:32.000027 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-51e88d4d-d084-4d98-b91e-3b3bd9c62876 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:32.000479 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-51e88d4d-d084-4d98-b91e-3b3bd9c62876 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:32.001262 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-51e88d4d-d084-4d98-b91e-3b3bd9c62876 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:32.001698 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-51e88d4d-d084-4d98-b91e-3b3bd9c62876 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:32.133217 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-51e88d4d-d084-4d98-b91e-3b3bd9c62876 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:32.141505 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-51e88d4d-d084-4d98-b91e-3b3bd9c62876 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.151860 Mar 03 02:57:32.142070 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1414/3066] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:31 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:32.685189 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 02:57:32.685784 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: Thu Mar 3 02:57:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 03 02:57:32.728889 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4b8e0cd9-03df-46b1-9fe3-d890fba64f5d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:32.729498 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4b8e0cd9-03df-46b1-9fe3-d890fba64f5d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:32.736032 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4b8e0cd9-03df-46b1-9fe3-d890fba64f5d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:32.736479 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4b8e0cd9-03df-46b1-9fe3-d890fba64f5d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:32.737254 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4b8e0cd9-03df-46b1-9fe3-d890fba64f5d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:32.737687 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4b8e0cd9-03df-46b1-9fe3-d890fba64f5d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:32.768920 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ad2aa9c2-0971-44b7-a676-42cc44b4abc0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:32.769539 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ad2aa9c2-0971-44b7-a676-42cc44b4abc0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:32.775562 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ad2aa9c2-0971-44b7-a676-42cc44b4abc0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:32.776044 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ad2aa9c2-0971-44b7-a676-42cc44b4abc0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:32.776852 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ad2aa9c2-0971-44b7-a676-42cc44b4abc0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:32.777319 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ad2aa9c2-0971-44b7-a676-42cc44b4abc0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:32.798726 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4b8e0cd9-03df-46b1-9fe3-d890fba64f5d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:32.806522 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4b8e0cd9-03df-46b1-9fe3-d890fba64f5d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.081408 Mar 03 02:57:32.807082 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1415/3067] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:32 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:32.814963 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-cf395f56-4967-4a2a-a946-22ad1c50ee58 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:32.815672 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-cf395f56-4967-4a2a-a946-22ad1c50ee58 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:32.821483 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cf395f56-4967-4a2a-a946-22ad1c50ee58 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:32.822016 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cf395f56-4967-4a2a-a946-22ad1c50ee58 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:32.822871 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cf395f56-4967-4a2a-a946-22ad1c50ee58 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:32.823373 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cf395f56-4967-4a2a-a946-22ad1c50ee58 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:32.911112 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ad2aa9c2-0971-44b7-a676-42cc44b4abc0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:32.920047 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ad2aa9c2-0971-44b7-a676-42cc44b4abc0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.286196 Mar 03 02:57:32.928075 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1653/3068] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:32 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:32.962258 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-cf395f56-4967-4a2a-a946-22ad1c50ee58 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:32.969947 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-cf395f56-4967-4a2a-a946-22ad1c50ee58 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.158589 Mar 03 02:57:32.970820 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1416/3069] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:32 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:33.159121 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b4a47679-7037-4d6c-8de1-7becf9850b00 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:33.159679 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b4a47679-7037-4d6c-8de1-7becf9850b00 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:33.165538 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b4a47679-7037-4d6c-8de1-7becf9850b00 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:33.165991 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b4a47679-7037-4d6c-8de1-7becf9850b00 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:33.166760 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b4a47679-7037-4d6c-8de1-7becf9850b00 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:33.167194 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b4a47679-7037-4d6c-8de1-7becf9850b00 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:33.296754 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b4a47679-7037-4d6c-8de1-7becf9850b00 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:33.304464 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b4a47679-7037-4d6c-8de1-7becf9850b00 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.149323 Mar 03 02:57:33.305024 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1654/3070] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:33 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:33.823103 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9074008c-74cf-4a9c-b175-af9c456c69d0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:33.823784 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9074008c-74cf-4a9c-b175-af9c456c69d0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:33.830208 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9074008c-74cf-4a9c-b175-af9c456c69d0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:33.830670 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9074008c-74cf-4a9c-b175-af9c456c69d0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:33.831452 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9074008c-74cf-4a9c-b175-af9c456c69d0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:33.831924 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9074008c-74cf-4a9c-b175-af9c456c69d0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:33.893426 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9074008c-74cf-4a9c-b175-af9c456c69d0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:33.901103 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9074008c-74cf-4a9c-b175-af9c456c69d0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.081937 Mar 03 02:57:33.901662 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1417/3071] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:33 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:33.937796 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-89ddad26-c185-4a56-a791-a71ec415b429 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:33.938406 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-89ddad26-c185-4a56-a791-a71ec415b429 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:33.944664 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-89ddad26-c185-4a56-a791-a71ec415b429 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:33.945110 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-89ddad26-c185-4a56-a791-a71ec415b429 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:33.945876 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-89ddad26-c185-4a56-a791-a71ec415b429 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:33.946305 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-89ddad26-c185-4a56-a791-a71ec415b429 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:34.083279 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-89ddad26-c185-4a56-a791-a71ec415b429 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:34.091741 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-89ddad26-c185-4a56-a791-a71ec415b429 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.157289 Mar 03 02:57:34.092318 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1655/3072] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:33 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:34.099454 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5e9ec981-5ad6-4dd3-9fb9-6c7783d3ac7d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:34.100100 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5e9ec981-5ad6-4dd3-9fb9-6c7783d3ac7d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:34.106222 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5e9ec981-5ad6-4dd3-9fb9-6c7783d3ac7d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:34.107238 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5e9ec981-5ad6-4dd3-9fb9-6c7783d3ac7d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:34.108037 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5e9ec981-5ad6-4dd3-9fb9-6c7783d3ac7d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:34.108471 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5e9ec981-5ad6-4dd3-9fb9-6c7783d3ac7d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:34.299410 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5e9ec981-5ad6-4dd3-9fb9-6c7783d3ac7d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:34.307048 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5e9ec981-5ad6-4dd3-9fb9-6c7783d3ac7d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.322807 Mar 03 02:57:34.307618 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1418/3073] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:33 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:34.322019 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8f777a9e-31ea-4fb6-b496-8afa36093c0d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:34.322633 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8f777a9e-31ea-4fb6-b496-8afa36093c0d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:34.328927 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8f777a9e-31ea-4fb6-b496-8afa36093c0d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:34.329381 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8f777a9e-31ea-4fb6-b496-8afa36093c0d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:34.330162 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8f777a9e-31ea-4fb6-b496-8afa36093c0d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:34.330606 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8f777a9e-31ea-4fb6-b496-8afa36093c0d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:34.457598 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8f777a9e-31ea-4fb6-b496-8afa36093c0d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:34.465310 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8f777a9e-31ea-4fb6-b496-8afa36093c0d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.147083 Mar 03 02:57:34.465877 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1656/3074] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:34 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:34.918645 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-59a5e01b-1b28-4f39-a213-4bb2b05ee3cd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:34.920117 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-59a5e01b-1b28-4f39-a213-4bb2b05ee3cd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:34.927029 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-59a5e01b-1b28-4f39-a213-4bb2b05ee3cd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:34.927489 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-59a5e01b-1b28-4f39-a213-4bb2b05ee3cd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:34.928311 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-59a5e01b-1b28-4f39-a213-4bb2b05ee3cd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:34.928755 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-59a5e01b-1b28-4f39-a213-4bb2b05ee3cd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:34.989006 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-59a5e01b-1b28-4f39-a213-4bb2b05ee3cd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:34.996684 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-59a5e01b-1b28-4f39-a213-4bb2b05ee3cd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.082170 Mar 03 02:57:34.997303 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1419/3075] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:34 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:35.109070 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-dd15a3ee-b044-4f39-a247-9407aea18fa0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:35.109703 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-dd15a3ee-b044-4f39-a247-9407aea18fa0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:35.115509 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dd15a3ee-b044-4f39-a247-9407aea18fa0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:35.116002 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dd15a3ee-b044-4f39-a247-9407aea18fa0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:35.116786 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dd15a3ee-b044-4f39-a247-9407aea18fa0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:35.117231 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dd15a3ee-b044-4f39-a247-9407aea18fa0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:35.300801 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-dd15a3ee-b044-4f39-a247-9407aea18fa0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:35.308465 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-dd15a3ee-b044-4f39-a247-9407aea18fa0 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.203701 Mar 03 02:57:35.309031 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1657/3076] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:35 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:35.324339 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3b9ea4d5-89a1-4352-b139-e57710b52d80 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:35.324943 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3b9ea4d5-89a1-4352-b139-e57710b52d80 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:35.331066 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3b9ea4d5-89a1-4352-b139-e57710b52d80 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:35.331513 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3b9ea4d5-89a1-4352-b139-e57710b52d80 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:35.332309 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3b9ea4d5-89a1-4352-b139-e57710b52d80 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:35.332783 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3b9ea4d5-89a1-4352-b139-e57710b52d80 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:35.460902 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3b9ea4d5-89a1-4352-b139-e57710b52d80 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:35.468622 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3b9ea4d5-89a1-4352-b139-e57710b52d80 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.148337 Mar 03 02:57:35.469189 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1420/3077] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:35 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:35.482287 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-bc96c86d-0c08-42bd-b756-850d083b72a3 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:35.482890 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-bc96c86d-0c08-42bd-b756-850d083b72a3 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:35.488855 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bc96c86d-0c08-42bd-b756-850d083b72a3 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:35.489298 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bc96c86d-0c08-42bd-b756-850d083b72a3 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:35.490062 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bc96c86d-0c08-42bd-b756-850d083b72a3 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:35.490491 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bc96c86d-0c08-42bd-b756-850d083b72a3 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:35.619545 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-bc96c86d-0c08-42bd-b756-850d083b72a3 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:35.627772 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-bc96c86d-0c08-42bd-b756-850d083b72a3 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.149603 Mar 03 02:57:35.628343 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1658/3078] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:35 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:36.014221 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-57fa2890-b548-4674-869e-ff550fae327c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:36.014867 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-57fa2890-b548-4674-869e-ff550fae327c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:36.020819 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-57fa2890-b548-4674-869e-ff550fae327c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:36.021274 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-57fa2890-b548-4674-869e-ff550fae327c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:36.022045 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-57fa2890-b548-4674-869e-ff550fae327c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:36.022483 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-57fa2890-b548-4674-869e-ff550fae327c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:36.080928 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-57fa2890-b548-4674-869e-ff550fae327c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:36.088634 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-57fa2890-b548-4674-869e-ff550fae327c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.078516 Mar 03 02:57:36.089194 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1421/3079] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:36 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:36.325656 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a1d99e86-4bf6-4f16-9a57-3a6f98c3c3c9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:36.326375 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a1d99e86-4bf6-4f16-9a57-3a6f98c3c3c9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:36.332819 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a1d99e86-4bf6-4f16-9a57-3a6f98c3c3c9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:36.333269 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a1d99e86-4bf6-4f16-9a57-3a6f98c3c3c9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:36.334033 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a1d99e86-4bf6-4f16-9a57-3a6f98c3c3c9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:36.334463 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a1d99e86-4bf6-4f16-9a57-3a6f98c3c3c9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:36.467411 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a1d99e86-4bf6-4f16-9a57-3a6f98c3c3c9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:36.475369 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a1d99e86-4bf6-4f16-9a57-3a6f98c3c3c9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.153777 Mar 03 02:57:36.475975 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1659/3080] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:36 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:36.491853 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e9b79b28-5755-457d-99ef-3d7df5e69af8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:36.492774 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e9b79b28-5755-457d-99ef-3d7df5e69af8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:36.498940 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e9b79b28-5755-457d-99ef-3d7df5e69af8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:36.499401 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e9b79b28-5755-457d-99ef-3d7df5e69af8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:36.500222 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e9b79b28-5755-457d-99ef-3d7df5e69af8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:36.500664 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e9b79b28-5755-457d-99ef-3d7df5e69af8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:36.632845 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e9b79b28-5755-457d-99ef-3d7df5e69af8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:36.641246 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e9b79b28-5755-457d-99ef-3d7df5e69af8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.156907 Mar 03 02:57:36.641984 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1422/3081] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:36 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:36.644778 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-612c03ef-ad77-484a-a4ec-78433d50f7fd tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:36.645384 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-612c03ef-ad77-484a-a4ec-78433d50f7fd tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:36.651066 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-612c03ef-ad77-484a-a4ec-78433d50f7fd tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:36.651504 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-612c03ef-ad77-484a-a4ec-78433d50f7fd tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:36.652311 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-612c03ef-ad77-484a-a4ec-78433d50f7fd tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:36.652747 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-612c03ef-ad77-484a-a4ec-78433d50f7fd tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:36.780814 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-612c03ef-ad77-484a-a4ec-78433d50f7fd tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:36.788386 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-612c03ef-ad77-484a-a4ec-78433d50f7fd tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.147425 Mar 03 02:57:36.788947 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1660/3082] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:36 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:37.105545 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b5eb5fde-c901-4c23-b159-09fcbb7dd028 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:37.106177 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b5eb5fde-c901-4c23-b159-09fcbb7dd028 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:37.112795 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b5eb5fde-c901-4c23-b159-09fcbb7dd028 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:37.113244 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b5eb5fde-c901-4c23-b159-09fcbb7dd028 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:37.114012 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b5eb5fde-c901-4c23-b159-09fcbb7dd028 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:37.114443 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b5eb5fde-c901-4c23-b159-09fcbb7dd028 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:37.173367 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b5eb5fde-c901-4c23-b159-09fcbb7dd028 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:37.181305 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b5eb5fde-c901-4c23-b159-09fcbb7dd028 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079843 Mar 03 02:57:37.181865 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1423/3083] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:37 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:37.500639 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3cd41c6f-b16f-409d-9673-a2eb4f7a9899 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:37.501244 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3cd41c6f-b16f-409d-9673-a2eb4f7a9899 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:37.507432 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3cd41c6f-b16f-409d-9673-a2eb4f7a9899 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:37.507912 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3cd41c6f-b16f-409d-9673-a2eb4f7a9899 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:37.508692 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3cd41c6f-b16f-409d-9673-a2eb4f7a9899 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:37.509126 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3cd41c6f-b16f-409d-9673-a2eb4f7a9899 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:37.636930 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-3cd41c6f-b16f-409d-9673-a2eb4f7a9899 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:37.645369 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3cd41c6f-b16f-409d-9673-a2eb4f7a9899 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.149062 Mar 03 02:57:37.645937 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1661/3084] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:37 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:37.658803 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-58f11d38-1e17-4c9b-98b2-408bb48bc71c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:37.659417 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-58f11d38-1e17-4c9b-98b2-408bb48bc71c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:37.666208 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-58f11d38-1e17-4c9b-98b2-408bb48bc71c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:37.666662 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-58f11d38-1e17-4c9b-98b2-408bb48bc71c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:37.667444 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-58f11d38-1e17-4c9b-98b2-408bb48bc71c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:37.667912 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-58f11d38-1e17-4c9b-98b2-408bb48bc71c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:37.798708 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-58f11d38-1e17-4c9b-98b2-408bb48bc71c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:37.806185 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-52fd2135-cb5c-4621-8109-8c61e8192322 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:37.806984 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-52fd2135-cb5c-4621-8109-8c61e8192322 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:37.807156 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-58f11d38-1e17-4c9b-98b2-408bb48bc71c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.152161 Mar 03 02:57:37.811826 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1424/3085] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:37 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:37.814911 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-52fd2135-cb5c-4621-8109-8c61e8192322 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:37.815360 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-52fd2135-cb5c-4621-8109-8c61e8192322 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:37.816167 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-52fd2135-cb5c-4621-8109-8c61e8192322 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:37.816598 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-52fd2135-cb5c-4621-8109-8c61e8192322 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:37.949937 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-52fd2135-cb5c-4621-8109-8c61e8192322 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:37.958797 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-52fd2135-cb5c-4621-8109-8c61e8192322 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.157836 Mar 03 02:57:37.959372 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1662/3086] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:37 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:38.197837 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-cc8e4d1b-3974-468b-bac2-cbe21b3d1553 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:38.198441 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-cc8e4d1b-3974-468b-bac2-cbe21b3d1553 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:38.204652 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cc8e4d1b-3974-468b-bac2-cbe21b3d1553 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:38.205103 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cc8e4d1b-3974-468b-bac2-cbe21b3d1553 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:38.205872 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cc8e4d1b-3974-468b-bac2-cbe21b3d1553 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:38.206319 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cc8e4d1b-3974-468b-bac2-cbe21b3d1553 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:38.267948 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-cc8e4d1b-3974-468b-bac2-cbe21b3d1553 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:38.275676 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-cc8e4d1b-3974-468b-bac2-cbe21b3d1553 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.081646 Mar 03 02:57:38.276241 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1425/3087] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:38 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:38.662847 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7175aaea-85a0-4964-9934-ca07e9ce6a2b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:38.663513 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7175aaea-85a0-4964-9934-ca07e9ce6a2b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:38.670504 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7175aaea-85a0-4964-9934-ca07e9ce6a2b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:38.670961 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7175aaea-85a0-4964-9934-ca07e9ce6a2b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:38.671789 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7175aaea-85a0-4964-9934-ca07e9ce6a2b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:38.672232 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7175aaea-85a0-4964-9934-ca07e9ce6a2b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:38.801303 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-7175aaea-85a0-4964-9934-ca07e9ce6a2b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:38.808899 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7175aaea-85a0-4964-9934-ca07e9ce6a2b tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.149931 Mar 03 02:57:38.809467 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1663/3088] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:38 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:38.824263 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-96540cdb-ac5d-4ef8-abd6-a1558768d9ce tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:38.824905 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-96540cdb-ac5d-4ef8-abd6-a1558768d9ce tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:38.831722 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-96540cdb-ac5d-4ef8-abd6-a1558768d9ce tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:38.832177 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-96540cdb-ac5d-4ef8-abd6-a1558768d9ce tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:38.832958 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-96540cdb-ac5d-4ef8-abd6-a1558768d9ce tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:38.833396 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-96540cdb-ac5d-4ef8-abd6-a1558768d9ce tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:38.967741 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-96540cdb-ac5d-4ef8-abd6-a1558768d9ce tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:38.975580 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8811a24f-6bd9-4818-8c65-46fb402add7a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:38.975812 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-96540cdb-ac5d-4ef8-abd6-a1558768d9ce tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.155234 Mar 03 02:57:38.976211 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8811a24f-6bd9-4818-8c65-46fb402add7a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:38.976323 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1426/3089] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:38 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:38.982385 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8811a24f-6bd9-4818-8c65-46fb402add7a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:38.982832 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8811a24f-6bd9-4818-8c65-46fb402add7a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:38.983624 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8811a24f-6bd9-4818-8c65-46fb402add7a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:38.984097 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8811a24f-6bd9-4818-8c65-46fb402add7a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:39.116521 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8811a24f-6bd9-4818-8c65-46fb402add7a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:39.124917 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8811a24f-6bd9-4818-8c65-46fb402add7a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.153222 Mar 03 02:57:39.125488 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1664/3090] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:38 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:39.293030 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-84742884-cdb7-4d1f-b1ee-2d769f55f3e9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:39.293616 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-84742884-cdb7-4d1f-b1ee-2d769f55f3e9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:39.300026 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-84742884-cdb7-4d1f-b1ee-2d769f55f3e9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:39.300477 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-84742884-cdb7-4d1f-b1ee-2d769f55f3e9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:39.301241 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-84742884-cdb7-4d1f-b1ee-2d769f55f3e9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:39.301674 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-84742884-cdb7-4d1f-b1ee-2d769f55f3e9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:39.360009 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-84742884-cdb7-4d1f-b1ee-2d769f55f3e9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:39.367783 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-84742884-cdb7-4d1f-b1ee-2d769f55f3e9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079170 Mar 03 02:57:39.368446 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1427/3091] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:39 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:39.826642 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c7263846-9c20-4b9b-8cbc-11de11fa9d88 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:39.827244 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c7263846-9c20-4b9b-8cbc-11de11fa9d88 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:39.833619 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c7263846-9c20-4b9b-8cbc-11de11fa9d88 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:39.834065 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c7263846-9c20-4b9b-8cbc-11de11fa9d88 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:39.834834 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c7263846-9c20-4b9b-8cbc-11de11fa9d88 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:39.835264 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c7263846-9c20-4b9b-8cbc-11de11fa9d88 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:39.962821 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c7263846-9c20-4b9b-8cbc-11de11fa9d88 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:39.971292 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c7263846-9c20-4b9b-8cbc-11de11fa9d88 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.149248 Mar 03 02:57:39.971925 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1665/3092] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:39 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:39.993107 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ba46d6fb-44ca-4eeb-96b2-d28ead43ebd8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:39.993718 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ba46d6fb-44ca-4eeb-96b2-d28ead43ebd8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:40.000257 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ba46d6fb-44ca-4eeb-96b2-d28ead43ebd8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:40.000700 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ba46d6fb-44ca-4eeb-96b2-d28ead43ebd8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:40.001474 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ba46d6fb-44ca-4eeb-96b2-d28ead43ebd8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:40.001907 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ba46d6fb-44ca-4eeb-96b2-d28ead43ebd8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:40.135861 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ba46d6fb-44ca-4eeb-96b2-d28ead43ebd8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:40.141744 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7344dbab-b8df-40de-8e5d-4d911090bf71 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:40.142350 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7344dbab-b8df-40de-8e5d-4d911090bf71 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:40.143744 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ba46d6fb-44ca-4eeb-96b2-d28ead43ebd8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.154363 Mar 03 02:57:40.144310 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1428/3093] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:39 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:40.148311 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7344dbab-b8df-40de-8e5d-4d911090bf71 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:40.148769 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7344dbab-b8df-40de-8e5d-4d911090bf71 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:40.149549 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7344dbab-b8df-40de-8e5d-4d911090bf71 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:40.149991 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7344dbab-b8df-40de-8e5d-4d911090bf71 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:40.280358 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-7344dbab-b8df-40de-8e5d-4d911090bf71 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:40.288047 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7344dbab-b8df-40de-8e5d-4d911090bf71 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.150177 Mar 03 02:57:40.288608 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1666/3094] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:40 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:40.384523 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-41e3f9a7-2bdf-4b23-bd6c-41f2371138e4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:40.385060 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-41e3f9a7-2bdf-4b23-bd6c-41f2371138e4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:40.391574 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-41e3f9a7-2bdf-4b23-bd6c-41f2371138e4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:40.392048 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-41e3f9a7-2bdf-4b23-bd6c-41f2371138e4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:40.392823 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-41e3f9a7-2bdf-4b23-bd6c-41f2371138e4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:40.393252 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-41e3f9a7-2bdf-4b23-bd6c-41f2371138e4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:40.451120 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-41e3f9a7-2bdf-4b23-bd6c-41f2371138e4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:40.459021 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-41e3f9a7-2bdf-4b23-bd6c-41f2371138e4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.078297 Mar 03 02:57:40.459597 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1429/3095] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:40 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:40.988742 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d8468874-52a7-46a3-ba64-35341afd5c25 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:40.989378 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d8468874-52a7-46a3-ba64-35341afd5c25 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:40.995533 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d8468874-52a7-46a3-ba64-35341afd5c25 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:40.996030 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d8468874-52a7-46a3-ba64-35341afd5c25 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:40.996803 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d8468874-52a7-46a3-ba64-35341afd5c25 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:40.997244 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d8468874-52a7-46a3-ba64-35341afd5c25 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:41.131020 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d8468874-52a7-46a3-ba64-35341afd5c25 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:41.139576 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d8468874-52a7-46a3-ba64-35341afd5c25 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.154665 Mar 03 02:57:41.140170 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1667/3096] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:40 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:41.160617 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-865d3d09-584f-4501-b9ce-cd971949ceb7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:41.161224 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-865d3d09-584f-4501-b9ce-cd971949ceb7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:41.167531 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-865d3d09-584f-4501-b9ce-cd971949ceb7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:41.168009 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-865d3d09-584f-4501-b9ce-cd971949ceb7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:41.168780 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-865d3d09-584f-4501-b9ce-cd971949ceb7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:41.169414 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-865d3d09-584f-4501-b9ce-cd971949ceb7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:41.303343 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-865d3d09-584f-4501-b9ce-cd971949ceb7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:41.305011 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b4d85389-993b-40db-bada-943d5b6b5f66 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:41.305691 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b4d85389-993b-40db-bada-943d5b6b5f66 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:41.311174 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-865d3d09-584f-4501-b9ce-cd971949ceb7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.154381 Mar 03 02:57:41.311382 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b4d85389-993b-40db-bada-943d5b6b5f66 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:41.311772 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1430/3097] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:41 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:41.311941 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b4d85389-993b-40db-bada-943d5b6b5f66 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:41.312783 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b4d85389-993b-40db-bada-943d5b6b5f66 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:41.313228 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b4d85389-993b-40db-bada-943d5b6b5f66 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:41.442813 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b4d85389-993b-40db-bada-943d5b6b5f66 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:41.451058 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b4d85389-993b-40db-bada-943d5b6b5f66 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.149446 Mar 03 02:57:41.451642 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1668/3098] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:41 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:41.475881 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-bb675568-cdf1-4eb9-89aa-6db39ae02218 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:41.476496 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-bb675568-cdf1-4eb9-89aa-6db39ae02218 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:41.482862 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bb675568-cdf1-4eb9-89aa-6db39ae02218 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:41.483315 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bb675568-cdf1-4eb9-89aa-6db39ae02218 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:41.484124 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bb675568-cdf1-4eb9-89aa-6db39ae02218 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:41.484562 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bb675568-cdf1-4eb9-89aa-6db39ae02218 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:41.547064 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-bb675568-cdf1-4eb9-89aa-6db39ae02218 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:41.554668 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-bb675568-cdf1-4eb9-89aa-6db39ae02218 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.082712 Mar 03 02:57:41.555241 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1431/3099] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:41 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:42.157289 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7330cfb2-56c5-43ab-ad35-5c0264332bc3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:42.157913 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7330cfb2-56c5-43ab-ad35-5c0264332bc3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:42.164118 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7330cfb2-56c5-43ab-ad35-5c0264332bc3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:42.164560 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7330cfb2-56c5-43ab-ad35-5c0264332bc3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:42.165324 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7330cfb2-56c5-43ab-ad35-5c0264332bc3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:42.165758 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7330cfb2-56c5-43ab-ad35-5c0264332bc3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:42.297989 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-7330cfb2-56c5-43ab-ad35-5c0264332bc3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:42.305513 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7330cfb2-56c5-43ab-ad35-5c0264332bc3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.152642 Mar 03 02:57:42.306071 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1669/3100] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:42 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:42.328726 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-aee3f463-c23a-4560-a938-d585c41e40ef tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:42.329344 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-aee3f463-c23a-4560-a938-d585c41e40ef tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:42.335703 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aee3f463-c23a-4560-a938-d585c41e40ef tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:42.336157 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aee3f463-c23a-4560-a938-d585c41e40ef tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:42.336935 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aee3f463-c23a-4560-a938-d585c41e40ef tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:42.337376 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aee3f463-c23a-4560-a938-d585c41e40ef tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:42.466614 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-aee3f463-c23a-4560-a938-d585c41e40ef tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:42.468408 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5d8868aa-f2a9-405b-99ff-e025e04486b3 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:42.469013 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5d8868aa-f2a9-405b-99ff-e025e04486b3 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:42.474599 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-aee3f463-c23a-4560-a938-d585c41e40ef tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.150378 Mar 03 02:57:42.474875 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5d8868aa-f2a9-405b-99ff-e025e04486b3 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:42.475169 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1432/3101] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:42 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:42.475406 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5d8868aa-f2a9-405b-99ff-e025e04486b3 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:42.476153 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5d8868aa-f2a9-405b-99ff-e025e04486b3 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:42.476659 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5d8868aa-f2a9-405b-99ff-e025e04486b3 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:42.571886 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d07e1ae8-f4f3-4776-bd47-61aaadd02364 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:42.572595 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d07e1ae8-f4f3-4776-bd47-61aaadd02364 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:42.579053 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d07e1ae8-f4f3-4776-bd47-61aaadd02364 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:42.579510 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d07e1ae8-f4f3-4776-bd47-61aaadd02364 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:42.580330 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d07e1ae8-f4f3-4776-bd47-61aaadd02364 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:42.580775 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d07e1ae8-f4f3-4776-bd47-61aaadd02364 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:42.605677 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5d8868aa-f2a9-405b-99ff-e025e04486b3 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:42.613491 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5d8868aa-f2a9-405b-99ff-e025e04486b3 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.149355 Mar 03 02:57:42.614067 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1670/3102] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:42 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:42.640159 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d07e1ae8-f4f3-4776-bd47-61aaadd02364 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:42.648026 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d07e1ae8-f4f3-4776-bd47-61aaadd02364 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080002 Mar 03 02:57:42.648591 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1433/3103] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:42 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:43.323169 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e28d267f-4d1d-4ef7-8cfc-9ca7e63e9287 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:43.323808 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e28d267f-4d1d-4ef7-8cfc-9ca7e63e9287 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:43.330055 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e28d267f-4d1d-4ef7-8cfc-9ca7e63e9287 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:43.330502 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e28d267f-4d1d-4ef7-8cfc-9ca7e63e9287 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:43.331266 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e28d267f-4d1d-4ef7-8cfc-9ca7e63e9287 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:43.331734 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e28d267f-4d1d-4ef7-8cfc-9ca7e63e9287 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:43.462908 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e28d267f-4d1d-4ef7-8cfc-9ca7e63e9287 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:43.470780 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e28d267f-4d1d-4ef7-8cfc-9ca7e63e9287 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.151461 Mar 03 02:57:43.471342 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1671/3104] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:43 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:43.492491 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a3050ff9-0ba8-4ca1-abc9-6d34cf3449aa tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:43.493124 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a3050ff9-0ba8-4ca1-abc9-6d34cf3449aa tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:43.500794 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a3050ff9-0ba8-4ca1-abc9-6d34cf3449aa tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:43.501307 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a3050ff9-0ba8-4ca1-abc9-6d34cf3449aa tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:43.502154 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a3050ff9-0ba8-4ca1-abc9-6d34cf3449aa tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:43.502639 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a3050ff9-0ba8-4ca1-abc9-6d34cf3449aa tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:43.630481 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-be985237-c848-44ae-b58f-2140c11baa55 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:43.631113 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-be985237-c848-44ae-b58f-2140c11baa55 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:43.634125 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a3050ff9-0ba8-4ca1-abc9-6d34cf3449aa tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:43.636899 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-be985237-c848-44ae-b58f-2140c11baa55 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:43.637348 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-be985237-c848-44ae-b58f-2140c11baa55 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:43.638940 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-be985237-c848-44ae-b58f-2140c11baa55 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:43.639089 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-be985237-c848-44ae-b58f-2140c11baa55 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:43.643319 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a3050ff9-0ba8-4ca1-abc9-6d34cf3449aa tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.154604 Mar 03 02:57:43.644008 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1434/3105] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:43 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:43.664814 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-739ce0c4-9071-404e-be69-c855e7c9b924 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:43.665417 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-739ce0c4-9071-404e-be69-c855e7c9b924 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:43.671159 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-739ce0c4-9071-404e-be69-c855e7c9b924 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:43.671630 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-739ce0c4-9071-404e-be69-c855e7c9b924 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:43.672418 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-739ce0c4-9071-404e-be69-c855e7c9b924 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:43.672858 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-739ce0c4-9071-404e-be69-c855e7c9b924 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:43.731567 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-739ce0c4-9071-404e-be69-c855e7c9b924 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:43.740348 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-739ce0c4-9071-404e-be69-c855e7c9b924 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079220 Mar 03 02:57:43.740933 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1435/3106] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:43 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:43.772567 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-be985237-c848-44ae-b58f-2140c11baa55 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:43.780364 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-be985237-c848-44ae-b58f-2140c11baa55 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.153909 Mar 03 02:57:43.780939 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1672/3107] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:43 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:44.487487 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c76ef90e-f9fd-4809-9168-3c36df9801e7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:44.488127 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c76ef90e-f9fd-4809-9168-3c36df9801e7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:44.494076 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c76ef90e-f9fd-4809-9168-3c36df9801e7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:44.494529 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c76ef90e-f9fd-4809-9168-3c36df9801e7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:44.495312 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c76ef90e-f9fd-4809-9168-3c36df9801e7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:44.495792 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c76ef90e-f9fd-4809-9168-3c36df9801e7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:44.628088 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c76ef90e-f9fd-4809-9168-3c36df9801e7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:44.635798 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c76ef90e-f9fd-4809-9168-3c36df9801e7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.152140 Mar 03 02:57:44.636363 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1436/3108] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:44 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:44.660430 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-cb670687-b4a8-4761-8de8-13bf95f71d81 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:44.661084 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-cb670687-b4a8-4761-8de8-13bf95f71d81 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:44.667660 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cb670687-b4a8-4761-8de8-13bf95f71d81 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:44.668112 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cb670687-b4a8-4761-8de8-13bf95f71d81 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:44.669458 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cb670687-b4a8-4761-8de8-13bf95f71d81 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:44.670050 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cb670687-b4a8-4761-8de8-13bf95f71d81 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:44.757235 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2ee2098a-0fc7-4bd9-99e1-6639f41f25de tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:44.757846 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2ee2098a-0fc7-4bd9-99e1-6639f41f25de tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:44.764616 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2ee2098a-0fc7-4bd9-99e1-6639f41f25de tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:44.765067 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2ee2098a-0fc7-4bd9-99e1-6639f41f25de tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:44.765849 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2ee2098a-0fc7-4bd9-99e1-6639f41f25de tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:44.766282 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2ee2098a-0fc7-4bd9-99e1-6639f41f25de tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:44.801311 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-cb670687-b4a8-4761-8de8-13bf95f71d81 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:44.809095 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-cb670687-b4a8-4761-8de8-13bf95f71d81 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.152434 Mar 03 02:57:44.810066 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1673/3109] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:44 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:44.814448 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9277a15a-fcec-4f76-91f5-2d274b48d931 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:44.815047 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9277a15a-fcec-4f76-91f5-2d274b48d931 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:44.820702 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9277a15a-fcec-4f76-91f5-2d274b48d931 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:44.821145 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9277a15a-fcec-4f76-91f5-2d274b48d931 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:44.821909 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9277a15a-fcec-4f76-91f5-2d274b48d931 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:44.822337 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9277a15a-fcec-4f76-91f5-2d274b48d931 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:44.829860 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2ee2098a-0fc7-4bd9-99e1-6639f41f25de tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:44.837554 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2ee2098a-0fc7-4bd9-99e1-6639f41f25de tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.084097 Mar 03 02:57:44.838128 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1437/3110] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:44 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:44.956112 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9277a15a-fcec-4f76-91f5-2d274b48d931 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:44.963779 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9277a15a-fcec-4f76-91f5-2d274b48d931 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.152755 Mar 03 02:57:44.964349 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1674/3111] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:44 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:45.653937 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6351ee56-8ea0-470b-a6e2-7c6ccae1a8d4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:45.654549 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6351ee56-8ea0-470b-a6e2-7c6ccae1a8d4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:45.660839 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6351ee56-8ea0-470b-a6e2-7c6ccae1a8d4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:45.661289 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6351ee56-8ea0-470b-a6e2-7c6ccae1a8d4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:45.662069 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6351ee56-8ea0-470b-a6e2-7c6ccae1a8d4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:45.662513 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6351ee56-8ea0-470b-a6e2-7c6ccae1a8d4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:45.789998 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-6351ee56-8ea0-470b-a6e2-7c6ccae1a8d4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:45.797649 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6351ee56-8ea0-470b-a6e2-7c6ccae1a8d4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.148350 Mar 03 02:57:45.798219 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1438/3112] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:45 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:45.826721 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-76a8eb33-ffea-4051-acd0-dd22c3cdf40f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:45.827321 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-76a8eb33-ffea-4051-acd0-dd22c3cdf40f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:45.833506 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-76a8eb33-ffea-4051-acd0-dd22c3cdf40f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:45.833949 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-76a8eb33-ffea-4051-acd0-dd22c3cdf40f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:45.834716 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-76a8eb33-ffea-4051-acd0-dd22c3cdf40f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:45.835145 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-76a8eb33-ffea-4051-acd0-dd22c3cdf40f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:45.854060 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-771a21a7-e352-4f79-a72f-de7ef99a1621 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:45.854669 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-771a21a7-e352-4f79-a72f-de7ef99a1621 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:45.861094 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-771a21a7-e352-4f79-a72f-de7ef99a1621 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:45.861553 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-771a21a7-e352-4f79-a72f-de7ef99a1621 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:45.862337 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-771a21a7-e352-4f79-a72f-de7ef99a1621 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:45.862780 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-771a21a7-e352-4f79-a72f-de7ef99a1621 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:45.923189 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-771a21a7-e352-4f79-a72f-de7ef99a1621 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:45.931094 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-771a21a7-e352-4f79-a72f-de7ef99a1621 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080852 Mar 03 02:57:45.931690 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1439/3113] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:45 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:45.969951 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-76a8eb33-ffea-4051-acd0-dd22c3cdf40f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:45.977741 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-76a8eb33-ffea-4051-acd0-dd22c3cdf40f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.155479 Mar 03 02:57:45.978308 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1675/3114] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:45 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:45.982557 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-aa64f6fa-234b-46ae-aa5a-3170b7586383 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:45.983204 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-aa64f6fa-234b-46ae-aa5a-3170b7586383 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:45.988935 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aa64f6fa-234b-46ae-aa5a-3170b7586383 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:45.989380 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aa64f6fa-234b-46ae-aa5a-3170b7586383 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:45.990146 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aa64f6fa-234b-46ae-aa5a-3170b7586383 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:45.990576 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aa64f6fa-234b-46ae-aa5a-3170b7586383 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:46.122883 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-aa64f6fa-234b-46ae-aa5a-3170b7586383 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:46.130470 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-aa64f6fa-234b-46ae-aa5a-3170b7586383 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.152644 Mar 03 02:57:46.131030 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1440/3115] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:45 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:46.814835 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-766c9265-570e-449e-b22d-df51a1c876dd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:46.815450 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-766c9265-570e-449e-b22d-df51a1c876dd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:46.821341 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-766c9265-570e-449e-b22d-df51a1c876dd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:46.821796 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-766c9265-570e-449e-b22d-df51a1c876dd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:46.822575 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-766c9265-570e-449e-b22d-df51a1c876dd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:46.823021 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-766c9265-570e-449e-b22d-df51a1c876dd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:46.947715 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-227320f2-9c24-4af0-81eb-321cdf6d56dc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:46.948308 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-227320f2-9c24-4af0-81eb-321cdf6d56dc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:46.954969 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-766c9265-570e-449e-b22d-df51a1c876dd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:46.955396 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-227320f2-9c24-4af0-81eb-321cdf6d56dc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:46.955589 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-227320f2-9c24-4af0-81eb-321cdf6d56dc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:46.956408 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-227320f2-9c24-4af0-81eb-321cdf6d56dc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:46.956843 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-227320f2-9c24-4af0-81eb-321cdf6d56dc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:46.963455 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-766c9265-570e-449e-b22d-df51a1c876dd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.152495 Mar 03 02:57:46.964134 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1676/3116] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:46 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:46.995729 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a707061a-a388-4ac8-816a-50be1aa4c2ca tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:46.996345 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a707061a-a388-4ac8-816a-50be1aa4c2ca tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:47.004466 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a707061a-a388-4ac8-816a-50be1aa4c2ca tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:47.004922 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a707061a-a388-4ac8-816a-50be1aa4c2ca tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:47.005719 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a707061a-a388-4ac8-816a-50be1aa4c2ca tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:47.006159 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a707061a-a388-4ac8-816a-50be1aa4c2ca tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:47.018185 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-227320f2-9c24-4af0-81eb-321cdf6d56dc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:47.026033 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-227320f2-9c24-4af0-81eb-321cdf6d56dc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.082251 Mar 03 02:57:47.026604 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1441/3117] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:46 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:47.138923 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a707061a-a388-4ac8-816a-50be1aa4c2ca tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:47.146690 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4ad2f6f0-fbcb-4a22-95a0-4cb77611a888 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:47.146882 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a707061a-a388-4ac8-816a-50be1aa4c2ca tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.154823 Mar 03 02:57:47.147266 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1677/3118] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:46 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:47.147393 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4ad2f6f0-fbcb-4a22-95a0-4cb77611a888 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:47.153008 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4ad2f6f0-fbcb-4a22-95a0-4cb77611a888 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:47.153528 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4ad2f6f0-fbcb-4a22-95a0-4cb77611a888 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:47.154360 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4ad2f6f0-fbcb-4a22-95a0-4cb77611a888 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:47.154792 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4ad2f6f0-fbcb-4a22-95a0-4cb77611a888 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:47.286591 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4ad2f6f0-fbcb-4a22-95a0-4cb77611a888 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:47.294936 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4ad2f6f0-fbcb-4a22-95a0-4cb77611a888 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.151937 Mar 03 02:57:47.295501 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1442/3119] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:47 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:47.981051 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-fa077b64-c164-4b7c-8fae-cd66e3c01a1c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:47.981726 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-fa077b64-c164-4b7c-8fae-cd66e3c01a1c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:47.987970 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fa077b64-c164-4b7c-8fae-cd66e3c01a1c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:47.988417 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fa077b64-c164-4b7c-8fae-cd66e3c01a1c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:47.989181 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fa077b64-c164-4b7c-8fae-cd66e3c01a1c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:47.989612 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fa077b64-c164-4b7c-8fae-cd66e3c01a1c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:48.042193 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-435fd5b1-6a02-40f8-8bc1-679c9c9066fc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:48.042793 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-435fd5b1-6a02-40f8-8bc1-679c9c9066fc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:48.049146 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-435fd5b1-6a02-40f8-8bc1-679c9c9066fc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:48.049596 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-435fd5b1-6a02-40f8-8bc1-679c9c9066fc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:48.050383 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-435fd5b1-6a02-40f8-8bc1-679c9c9066fc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:48.050833 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-435fd5b1-6a02-40f8-8bc1-679c9c9066fc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:48.110148 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-435fd5b1-6a02-40f8-8bc1-679c9c9066fc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:48.117976 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-435fd5b1-6a02-40f8-8bc1-679c9c9066fc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079632 Mar 03 02:57:48.118558 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1443/3120] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:48 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:48.120738 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-fa077b64-c164-4b7c-8fae-cd66e3c01a1c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:48.128453 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-fa077b64-c164-4b7c-8fae-cd66e3c01a1c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.151511 Mar 03 02:57:48.129008 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1678/3121] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:47 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:48.163964 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-daa18c5a-967e-4175-84e5-51fa83793a1a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:48.164562 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-daa18c5a-967e-4175-84e5-51fa83793a1a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:48.170307 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-daa18c5a-967e-4175-84e5-51fa83793a1a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:48.170752 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-daa18c5a-967e-4175-84e5-51fa83793a1a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:48.171519 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-daa18c5a-967e-4175-84e5-51fa83793a1a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:48.171976 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-daa18c5a-967e-4175-84e5-51fa83793a1a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:48.303503 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-daa18c5a-967e-4175-84e5-51fa83793a1a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:48.311878 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-daa18c5a-967e-4175-84e5-51fa83793a1a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.151549 Mar 03 02:57:48.312048 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b6acd23c-cd0f-42c5-b036-a6585023f913 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:48.312473 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1444/3122] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:48 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:48.312689 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b6acd23c-cd0f-42c5-b036-a6585023f913 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:48.318383 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b6acd23c-cd0f-42c5-b036-a6585023f913 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:48.318828 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b6acd23c-cd0f-42c5-b036-a6585023f913 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:48.319596 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b6acd23c-cd0f-42c5-b036-a6585023f913 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:48.320052 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b6acd23c-cd0f-42c5-b036-a6585023f913 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:48.456129 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b6acd23c-cd0f-42c5-b036-a6585023f913 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:48.463709 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b6acd23c-cd0f-42c5-b036-a6585023f913 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.156309 Mar 03 02:57:48.464272 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1679/3123] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:48 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:49.134478 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c9b5eb56-05df-4247-840e-10c2e70adf5e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:49.135082 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c9b5eb56-05df-4247-840e-10c2e70adf5e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:49.141799 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c9b5eb56-05df-4247-840e-10c2e70adf5e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:49.142243 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c9b5eb56-05df-4247-840e-10c2e70adf5e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:49.143021 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c9b5eb56-05df-4247-840e-10c2e70adf5e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:49.143462 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c9b5eb56-05df-4247-840e-10c2e70adf5e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:49.145947 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8fd5eebf-3164-45c4-892e-e83be46c2924 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:49.146553 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8fd5eebf-3164-45c4-892e-e83be46c2924 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:49.152641 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8fd5eebf-3164-45c4-892e-e83be46c2924 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:49.153617 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8fd5eebf-3164-45c4-892e-e83be46c2924 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:49.154756 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8fd5eebf-3164-45c4-892e-e83be46c2924 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:49.155198 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8fd5eebf-3164-45c4-892e-e83be46c2924 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:49.204169 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c9b5eb56-05df-4247-840e-10c2e70adf5e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:49.211887 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c9b5eb56-05df-4247-840e-10c2e70adf5e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.081402 Mar 03 02:57:49.212465 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1445/3124] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:49 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:49.289131 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8fd5eebf-3164-45c4-892e-e83be46c2924 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:49.297618 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8fd5eebf-3164-45c4-892e-e83be46c2924 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.155557 Mar 03 02:57:49.298192 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1680/3125] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:49 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:49.329368 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5de48d45-fb53-400d-8985-2afa86325e4b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:49.329972 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5de48d45-fb53-400d-8985-2afa86325e4b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:49.335792 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5de48d45-fb53-400d-8985-2afa86325e4b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:49.336241 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5de48d45-fb53-400d-8985-2afa86325e4b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:49.337011 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5de48d45-fb53-400d-8985-2afa86325e4b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:49.337446 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5de48d45-fb53-400d-8985-2afa86325e4b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:49.468885 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5de48d45-fb53-400d-8985-2afa86325e4b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:49.476637 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5de48d45-fb53-400d-8985-2afa86325e4b tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.151788 Mar 03 02:57:49.477236 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1446/3126] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:49 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:49.480977 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-582d1095-e2fa-4737-8bb2-280da11d98cc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:49.481654 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-582d1095-e2fa-4737-8bb2-280da11d98cc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:49.487306 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-582d1095-e2fa-4737-8bb2-280da11d98cc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:49.487818 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-582d1095-e2fa-4737-8bb2-280da11d98cc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:49.488582 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-582d1095-e2fa-4737-8bb2-280da11d98cc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:49.489018 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-582d1095-e2fa-4737-8bb2-280da11d98cc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:49.621216 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-582d1095-e2fa-4737-8bb2-280da11d98cc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:49.629471 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-582d1095-e2fa-4737-8bb2-280da11d98cc tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.152732 Mar 03 02:57:49.630064 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1681/3127] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:49 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:50.228887 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7354e24c-66ea-4d01-acf3-3509a1638da9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:50.229499 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7354e24c-66ea-4d01-acf3-3509a1638da9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:50.236029 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7354e24c-66ea-4d01-acf3-3509a1638da9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:50.236483 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7354e24c-66ea-4d01-acf3-3509a1638da9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:50.237260 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7354e24c-66ea-4d01-acf3-3509a1638da9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:50.237697 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7354e24c-66ea-4d01-acf3-3509a1638da9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:50.296021 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-7354e24c-66ea-4d01-acf3-3509a1638da9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:50.303693 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7354e24c-66ea-4d01-acf3-3509a1638da9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.078606 Mar 03 02:57:50.304256 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1447/3128] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:50 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:50.314167 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c4ed170e-dcb9-49d6-80d1-8c5cbad82829 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:50.314772 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c4ed170e-dcb9-49d6-80d1-8c5cbad82829 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:50.320953 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c4ed170e-dcb9-49d6-80d1-8c5cbad82829 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:50.321398 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c4ed170e-dcb9-49d6-80d1-8c5cbad82829 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:50.322162 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c4ed170e-dcb9-49d6-80d1-8c5cbad82829 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:50.322591 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c4ed170e-dcb9-49d6-80d1-8c5cbad82829 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:50.452772 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c4ed170e-dcb9-49d6-80d1-8c5cbad82829 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:50.460414 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c4ed170e-dcb9-49d6-80d1-8c5cbad82829 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.150111 Mar 03 02:57:50.460982 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1682/3129] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:50 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:50.493871 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7d323c96-61c8-4369-ab01-44aa4822e88e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:50.494481 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7d323c96-61c8-4369-ab01-44aa4822e88e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:50.500679 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7d323c96-61c8-4369-ab01-44aa4822e88e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:50.501130 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7d323c96-61c8-4369-ab01-44aa4822e88e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:50.501902 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7d323c96-61c8-4369-ab01-44aa4822e88e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:50.502338 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7d323c96-61c8-4369-ab01-44aa4822e88e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:50.629546 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-7d323c96-61c8-4369-ab01-44aa4822e88e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:50.637228 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7d323c96-61c8-4369-ab01-44aa4822e88e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.147145 Mar 03 02:57:50.638374 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1448/3130] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:50 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:50.646191 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-50d3d830-26a8-456d-a67f-449bdd23e3ab tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:50.646787 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-50d3d830-26a8-456d-a67f-449bdd23e3ab tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:50.652442 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-50d3d830-26a8-456d-a67f-449bdd23e3ab tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:50.652885 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-50d3d830-26a8-456d-a67f-449bdd23e3ab tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:50.653792 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-50d3d830-26a8-456d-a67f-449bdd23e3ab tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:50.654225 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-50d3d830-26a8-456d-a67f-449bdd23e3ab tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:50.789169 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-50d3d830-26a8-456d-a67f-449bdd23e3ab tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:50.797604 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-50d3d830-26a8-456d-a67f-449bdd23e3ab tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.155238 Mar 03 02:57:50.798179 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1683/3131] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:50 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:51.320317 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3c9eb19f-0900-4946-abd2-475338284914 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:51.320848 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3c9eb19f-0900-4946-abd2-475338284914 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:51.327840 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3c9eb19f-0900-4946-abd2-475338284914 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:51.328300 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3c9eb19f-0900-4946-abd2-475338284914 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:51.329113 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3c9eb19f-0900-4946-abd2-475338284914 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:51.329555 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3c9eb19f-0900-4946-abd2-475338284914 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:51.389864 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3c9eb19f-0900-4946-abd2-475338284914 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:51.397724 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3c9eb19f-0900-4946-abd2-475338284914 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.081402 Mar 03 02:57:51.398290 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1449/3132] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:51 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:51.477277 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-938eaa68-17b0-444c-a115-27ab55849428 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:51.477885 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-938eaa68-17b0-444c-a115-27ab55849428 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:51.484363 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-938eaa68-17b0-444c-a115-27ab55849428 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:51.484814 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-938eaa68-17b0-444c-a115-27ab55849428 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:51.485588 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-938eaa68-17b0-444c-a115-27ab55849428 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:51.486025 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-938eaa68-17b0-444c-a115-27ab55849428 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:51.615546 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-938eaa68-17b0-444c-a115-27ab55849428 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:51.623804 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-938eaa68-17b0-444c-a115-27ab55849428 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.150294 Mar 03 02:57:51.624374 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1684/3133] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:51 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:51.656144 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5aab52df-2e65-445f-9db8-3b3c3909524c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:51.656759 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5aab52df-2e65-445f-9db8-3b3c3909524c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:51.662582 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5aab52df-2e65-445f-9db8-3b3c3909524c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:51.663036 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5aab52df-2e65-445f-9db8-3b3c3909524c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:51.663845 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5aab52df-2e65-445f-9db8-3b3c3909524c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:51.664293 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5aab52df-2e65-445f-9db8-3b3c3909524c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:51.794919 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5aab52df-2e65-445f-9db8-3b3c3909524c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:51.802525 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5aab52df-2e65-445f-9db8-3b3c3909524c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.151433 Mar 03 02:57:51.803092 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1450/3134] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:51 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:51.814022 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-605e26d6-eed3-4211-be06-40e70423c9e9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:51.814618 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-605e26d6-eed3-4211-be06-40e70423c9e9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:51.820274 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-605e26d6-eed3-4211-be06-40e70423c9e9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:51.820717 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-605e26d6-eed3-4211-be06-40e70423c9e9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:51.821480 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-605e26d6-eed3-4211-be06-40e70423c9e9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:51.821911 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-605e26d6-eed3-4211-be06-40e70423c9e9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:51.952588 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-605e26d6-eed3-4211-be06-40e70423c9e9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:51.960294 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-605e26d6-eed3-4211-be06-40e70423c9e9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.150064 Mar 03 02:57:51.961184 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1685/3135] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:51 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:52.414267 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-bc5644c6-8a02-451e-9d0d-37d8c0134746 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:52.414881 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-bc5644c6-8a02-451e-9d0d-37d8c0134746 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:52.421161 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bc5644c6-8a02-451e-9d0d-37d8c0134746 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:52.421608 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bc5644c6-8a02-451e-9d0d-37d8c0134746 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:52.422374 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bc5644c6-8a02-451e-9d0d-37d8c0134746 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:52.422806 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bc5644c6-8a02-451e-9d0d-37d8c0134746 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:52.481634 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-bc5644c6-8a02-451e-9d0d-37d8c0134746 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:52.489305 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-bc5644c6-8a02-451e-9d0d-37d8c0134746 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.078975 Mar 03 02:57:52.489864 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1451/3136] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:52 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:52.641207 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-dc5b2cc2-4447-4307-a6b1-8d0629ea0f7c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:52.641813 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-dc5b2cc2-4447-4307-a6b1-8d0629ea0f7c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:52.648194 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dc5b2cc2-4447-4307-a6b1-8d0629ea0f7c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:52.648638 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dc5b2cc2-4447-4307-a6b1-8d0629ea0f7c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:52.649404 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dc5b2cc2-4447-4307-a6b1-8d0629ea0f7c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:52.649835 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dc5b2cc2-4447-4307-a6b1-8d0629ea0f7c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:52.786030 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-dc5b2cc2-4447-4307-a6b1-8d0629ea0f7c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:52.793751 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-dc5b2cc2-4447-4307-a6b1-8d0629ea0f7c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.156851 Mar 03 02:57:52.794319 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1686/3137] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:52 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:52.819533 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6378c658-e48f-4430-ba2d-3ef15c63b6f8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:52.820176 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6378c658-e48f-4430-ba2d-3ef15c63b6f8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:52.826512 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6378c658-e48f-4430-ba2d-3ef15c63b6f8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:52.826955 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6378c658-e48f-4430-ba2d-3ef15c63b6f8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:52.827756 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6378c658-e48f-4430-ba2d-3ef15c63b6f8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:52.828269 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6378c658-e48f-4430-ba2d-3ef15c63b6f8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:52.960491 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-6378c658-e48f-4430-ba2d-3ef15c63b6f8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:52.968746 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6378c658-e48f-4430-ba2d-3ef15c63b6f8 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.153042 Mar 03 02:57:52.969303 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1452/3138] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:52 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:52.977941 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c4720666-b9d6-40ca-aedb-9a4cedd75212 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:52.978552 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c4720666-b9d6-40ca-aedb-9a4cedd75212 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:52.985027 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c4720666-b9d6-40ca-aedb-9a4cedd75212 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:52.985474 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c4720666-b9d6-40ca-aedb-9a4cedd75212 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:52.986312 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c4720666-b9d6-40ca-aedb-9a4cedd75212 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:52.986697 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c4720666-b9d6-40ca-aedb-9a4cedd75212 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:53.124961 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c4720666-b9d6-40ca-aedb-9a4cedd75212 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:53.132694 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c4720666-b9d6-40ca-aedb-9a4cedd75212 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.158699 Mar 03 02:57:53.133258 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1687/3139] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:52 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:53.506183 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5b777278-f546-4765-ae38-7711e5468ec0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:53.506780 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5b777278-f546-4765-ae38-7711e5468ec0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:53.513173 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5b777278-f546-4765-ae38-7711e5468ec0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:53.513632 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5b777278-f546-4765-ae38-7711e5468ec0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:53.514418 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5b777278-f546-4765-ae38-7711e5468ec0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:53.514859 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5b777278-f546-4765-ae38-7711e5468ec0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:53.576518 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5b777278-f546-4765-ae38-7711e5468ec0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:53.584176 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5b777278-f546-4765-ae38-7711e5468ec0 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.081869 Mar 03 02:57:53.584745 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1453/3140] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:53 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:53.810993 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-50f0a8d0-b149-48f5-9b05-f0d1685fa388 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:53.811553 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-50f0a8d0-b149-48f5-9b05-f0d1685fa388 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:53.817738 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-50f0a8d0-b149-48f5-9b05-f0d1685fa388 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:53.818188 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-50f0a8d0-b149-48f5-9b05-f0d1685fa388 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:53.818951 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-50f0a8d0-b149-48f5-9b05-f0d1685fa388 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:53.819390 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-50f0a8d0-b149-48f5-9b05-f0d1685fa388 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:53.955760 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-50f0a8d0-b149-48f5-9b05-f0d1685fa388 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:53.963891 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-50f0a8d0-b149-48f5-9b05-f0d1685fa388 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.156803 Mar 03 02:57:53.964458 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1688/3141] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:53 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:53.986413 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d0019698-06f9-428a-b505-93bf4b3a9118 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:53.987024 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d0019698-06f9-428a-b505-93bf4b3a9118 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:53.992788 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d0019698-06f9-428a-b505-93bf4b3a9118 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:53.993240 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d0019698-06f9-428a-b505-93bf4b3a9118 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:53.994015 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d0019698-06f9-428a-b505-93bf4b3a9118 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:53.994455 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d0019698-06f9-428a-b505-93bf4b3a9118 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:54.126982 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d0019698-06f9-428a-b505-93bf4b3a9118 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:54.134645 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d0019698-06f9-428a-b505-93bf4b3a9118 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.152109 Mar 03 02:57:54.135205 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1454/3142] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:53 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:54.149226 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5803a36c-0a5b-4b06-b2b3-af49eaf89d50 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:54.149829 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5803a36c-0a5b-4b06-b2b3-af49eaf89d50 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:54.156818 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5803a36c-0a5b-4b06-b2b3-af49eaf89d50 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:54.157271 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5803a36c-0a5b-4b06-b2b3-af49eaf89d50 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:54.158045 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5803a36c-0a5b-4b06-b2b3-af49eaf89d50 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:54.158481 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5803a36c-0a5b-4b06-b2b3-af49eaf89d50 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:54.214919 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 02:57:54.215189 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: Thu Mar 3 02:57:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 03 02:57:54.287967 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5803a36c-0a5b-4b06-b2b3-af49eaf89d50 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:54.295549 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5803a36c-0a5b-4b06-b2b3-af49eaf89d50 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.150157 Mar 03 02:57:54.296134 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1689/3143] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:54 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:54.601083 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3d822648-b103-4157-9cc8-98986acd147a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:54.601696 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3d822648-b103-4157-9cc8-98986acd147a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:54.609034 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3d822648-b103-4157-9cc8-98986acd147a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:54.609483 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3d822648-b103-4157-9cc8-98986acd147a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:54.610284 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3d822648-b103-4157-9cc8-98986acd147a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:54.610718 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3d822648-b103-4157-9cc8-98986acd147a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:54.669491 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3d822648-b103-4157-9cc8-98986acd147a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:54.677184 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3d822648-b103-4157-9cc8-98986acd147a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080014 Mar 03 02:57:54.677740 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1455/3144] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:54 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:54.982299 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-370439e5-697f-487c-8958-54a76b271eb1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:54.982852 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-370439e5-697f-487c-8958-54a76b271eb1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:54.988966 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-370439e5-697f-487c-8958-54a76b271eb1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:54.989414 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-370439e5-697f-487c-8958-54a76b271eb1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:54.990180 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-370439e5-697f-487c-8958-54a76b271eb1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:54.990613 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-370439e5-697f-487c-8958-54a76b271eb1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:55.120214 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-370439e5-697f-487c-8958-54a76b271eb1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:55.128548 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-370439e5-697f-487c-8958-54a76b271eb1 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.150652 Mar 03 02:57:55.129107 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1690/3145] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:54 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:55.152214 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4eb7b636-df6e-407e-8c50-ceb07d42568a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:55.152893 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4eb7b636-df6e-407e-8c50-ceb07d42568a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:55.158781 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4eb7b636-df6e-407e-8c50-ceb07d42568a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:55.159224 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4eb7b636-df6e-407e-8c50-ceb07d42568a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:55.160111 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4eb7b636-df6e-407e-8c50-ceb07d42568a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:55.160555 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4eb7b636-df6e-407e-8c50-ceb07d42568a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:55.293181 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4eb7b636-df6e-407e-8c50-ceb07d42568a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:55.301645 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4eb7b636-df6e-407e-8c50-ceb07d42568a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.153278 Mar 03 02:57:55.302197 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1456/3146] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:55 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:55.312829 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3ad47d66-0740-46c3-a127-18556ca706ea tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:55.313432 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3ad47d66-0740-46c3-a127-18556ca706ea tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:55.319125 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3ad47d66-0740-46c3-a127-18556ca706ea tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:55.319571 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3ad47d66-0740-46c3-a127-18556ca706ea tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:55.320370 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3ad47d66-0740-46c3-a127-18556ca706ea tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:55.320799 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3ad47d66-0740-46c3-a127-18556ca706ea tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:55.456230 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-3ad47d66-0740-46c3-a127-18556ca706ea tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:55.463848 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3ad47d66-0740-46c3-a127-18556ca706ea tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.155418 Mar 03 02:57:55.464411 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1691/3147] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:55 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:55.694074 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4277b3e2-e14a-4134-9fae-86d8a73e3bfe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:55.694679 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4277b3e2-e14a-4134-9fae-86d8a73e3bfe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:55.701277 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4277b3e2-e14a-4134-9fae-86d8a73e3bfe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:55.701725 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4277b3e2-e14a-4134-9fae-86d8a73e3bfe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:55.702492 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4277b3e2-e14a-4134-9fae-86d8a73e3bfe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:55.702927 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4277b3e2-e14a-4134-9fae-86d8a73e3bfe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:55.763926 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4277b3e2-e14a-4134-9fae-86d8a73e3bfe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:55.772194 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4277b3e2-e14a-4134-9fae-86d8a73e3bfe tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.081966 Mar 03 02:57:55.772761 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1457/3148] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:55 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:56.146134 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7f769746-e262-4cc3-b2de-0300803391f9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:56.146744 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7f769746-e262-4cc3-b2de-0300803391f9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:56.153576 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7f769746-e262-4cc3-b2de-0300803391f9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:56.154042 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7f769746-e262-4cc3-b2de-0300803391f9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:56.154813 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7f769746-e262-4cc3-b2de-0300803391f9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:56.155254 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7f769746-e262-4cc3-b2de-0300803391f9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:56.285046 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-7f769746-e262-4cc3-b2de-0300803391f9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:56.292681 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7f769746-e262-4cc3-b2de-0300803391f9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.150440 Mar 03 02:57:56.293245 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1692/3149] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:56 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:56.319359 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3d4ef3c6-6d50-4054-b4d9-9f81a78a66f6 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:56.320024 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3d4ef3c6-6d50-4054-b4d9-9f81a78a66f6 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:56.326472 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3d4ef3c6-6d50-4054-b4d9-9f81a78a66f6 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:56.326923 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3d4ef3c6-6d50-4054-b4d9-9f81a78a66f6 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:56.327717 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3d4ef3c6-6d50-4054-b4d9-9f81a78a66f6 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:56.328150 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3d4ef3c6-6d50-4054-b4d9-9f81a78a66f6 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:56.458601 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3d4ef3c6-6d50-4054-b4d9-9f81a78a66f6 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:56.466387 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3d4ef3c6-6d50-4054-b4d9-9f81a78a66f6 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.150826 Mar 03 02:57:56.466956 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1458/3150] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:56 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:56.479570 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c0807111-ce91-4aeb-9229-4cb914cb4be2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:56.480470 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c0807111-ce91-4aeb-9229-4cb914cb4be2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:56.486215 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c0807111-ce91-4aeb-9229-4cb914cb4be2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:56.486702 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c0807111-ce91-4aeb-9229-4cb914cb4be2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:56.487508 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c0807111-ce91-4aeb-9229-4cb914cb4be2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:56.487957 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c0807111-ce91-4aeb-9229-4cb914cb4be2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:56.620577 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c0807111-ce91-4aeb-9229-4cb914cb4be2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:56.628324 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c0807111-ce91-4aeb-9229-4cb914cb4be2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.152569 Mar 03 02:57:56.628888 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1693/3151] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:56 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:56.788946 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-77d967e9-a351-468c-ad15-557b2055cd4c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:56.789555 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-77d967e9-a351-468c-ad15-557b2055cd4c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:56.795857 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-77d967e9-a351-468c-ad15-557b2055cd4c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:56.796303 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-77d967e9-a351-468c-ad15-557b2055cd4c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:56.797075 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-77d967e9-a351-468c-ad15-557b2055cd4c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:56.797506 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-77d967e9-a351-468c-ad15-557b2055cd4c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:56.859299 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-77d967e9-a351-468c-ad15-557b2055cd4c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:56.866960 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-77d967e9-a351-468c-ad15-557b2055cd4c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.081834 Mar 03 02:57:56.867518 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1459/3152] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:56 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:57.310756 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5035ce4b-64f4-4c32-b97b-48fca8f6211a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:57.311323 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5035ce4b-64f4-4c32-b97b-48fca8f6211a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:57.317546 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5035ce4b-64f4-4c32-b97b-48fca8f6211a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:57.317994 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5035ce4b-64f4-4c32-b97b-48fca8f6211a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:57.318764 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5035ce4b-64f4-4c32-b97b-48fca8f6211a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:57.319199 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5035ce4b-64f4-4c32-b97b-48fca8f6211a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:57.448452 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5035ce4b-64f4-4c32-b97b-48fca8f6211a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:57.456667 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5035ce4b-64f4-4c32-b97b-48fca8f6211a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.150801 Mar 03 02:57:57.457235 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1694/3153] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:57 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:57.484259 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a61d9f51-0898-4e96-9c32-944717fbe2e9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:57.484866 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a61d9f51-0898-4e96-9c32-944717fbe2e9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:57.490575 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a61d9f51-0898-4e96-9c32-944717fbe2e9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:57.491030 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a61d9f51-0898-4e96-9c32-944717fbe2e9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:57.491847 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a61d9f51-0898-4e96-9c32-944717fbe2e9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:57.492287 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a61d9f51-0898-4e96-9c32-944717fbe2e9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:57.620891 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a61d9f51-0898-4e96-9c32-944717fbe2e9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:57.629684 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a61d9f51-0898-4e96-9c32-944717fbe2e9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.150319 Mar 03 02:57:57.630245 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1460/3154] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:57 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:57.644469 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7316aeba-288b-46ad-8cff-af2b6efc6642 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:57.645077 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7316aeba-288b-46ad-8cff-af2b6efc6642 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:57.650847 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7316aeba-288b-46ad-8cff-af2b6efc6642 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:57.651301 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7316aeba-288b-46ad-8cff-af2b6efc6642 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:57.652131 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7316aeba-288b-46ad-8cff-af2b6efc6642 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:57.652570 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7316aeba-288b-46ad-8cff-af2b6efc6642 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:57.784810 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-7316aeba-288b-46ad-8cff-af2b6efc6642 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:57.792403 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7316aeba-288b-46ad-8cff-af2b6efc6642 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.151771 Mar 03 02:57:57.792967 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1695/3155] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:57 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:57.884023 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-39d8761f-0ff4-47c6-b56c-2f46af3ffcc7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:57.884641 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-39d8761f-0ff4-47c6-b56c-2f46af3ffcc7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:57.890949 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-39d8761f-0ff4-47c6-b56c-2f46af3ffcc7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:57.891410 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-39d8761f-0ff4-47c6-b56c-2f46af3ffcc7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:57.892223 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-39d8761f-0ff4-47c6-b56c-2f46af3ffcc7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:57.892664 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-39d8761f-0ff4-47c6-b56c-2f46af3ffcc7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:57.952266 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-39d8761f-0ff4-47c6-b56c-2f46af3ffcc7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:57.959976 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-39d8761f-0ff4-47c6-b56c-2f46af3ffcc7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079924 Mar 03 02:57:57.960544 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1461/3156] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:57 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:58.473740 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ee295698-0a66-4f47-b0ce-9e305118c5e4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:58.474344 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ee295698-0a66-4f47-b0ce-9e305118c5e4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:58.480772 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ee295698-0a66-4f47-b0ce-9e305118c5e4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:58.481390 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ee295698-0a66-4f47-b0ce-9e305118c5e4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:58.482160 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ee295698-0a66-4f47-b0ce-9e305118c5e4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:58.482592 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ee295698-0a66-4f47-b0ce-9e305118c5e4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:58.612742 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ee295698-0a66-4f47-b0ce-9e305118c5e4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:58.620415 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ee295698-0a66-4f47-b0ce-9e305118c5e4 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.150518 Mar 03 02:57:58.620985 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1696/3157] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:58 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:58.647158 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f47715aa-cda5-439e-a6f6-f279974157f1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:58.647797 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f47715aa-cda5-439e-a6f6-f279974157f1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:58.654167 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f47715aa-cda5-439e-a6f6-f279974157f1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:58.654622 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f47715aa-cda5-439e-a6f6-f279974157f1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:58.655391 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f47715aa-cda5-439e-a6f6-f279974157f1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:58.655854 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f47715aa-cda5-439e-a6f6-f279974157f1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:58.785230 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f47715aa-cda5-439e-a6f6-f279974157f1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:58.792954 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f47715aa-cda5-439e-a6f6-f279974157f1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.149701 Mar 03 02:57:58.793661 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1462/3158] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:58 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:58.810173 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-18a610b7-5b1d-4268-bfc8-8e1b461e82d6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:58.810775 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-18a610b7-5b1d-4268-bfc8-8e1b461e82d6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:58.816578 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-18a610b7-5b1d-4268-bfc8-8e1b461e82d6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:58.817035 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-18a610b7-5b1d-4268-bfc8-8e1b461e82d6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:58.817816 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-18a610b7-5b1d-4268-bfc8-8e1b461e82d6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:58.818245 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-18a610b7-5b1d-4268-bfc8-8e1b461e82d6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:58.948398 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-18a610b7-5b1d-4268-bfc8-8e1b461e82d6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:58.957321 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-18a610b7-5b1d-4268-bfc8-8e1b461e82d6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.151514 Mar 03 02:57:58.957885 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1697/3159] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:58 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:58.978487 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-89793bec-f0b7-4a98-948e-14f86a1e0ad8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:58.979122 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-89793bec-f0b7-4a98-948e-14f86a1e0ad8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:58.985270 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-89793bec-f0b7-4a98-948e-14f86a1e0ad8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:58.985665 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-89793bec-f0b7-4a98-948e-14f86a1e0ad8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:58.986440 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-89793bec-f0b7-4a98-948e-14f86a1e0ad8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:58.986876 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-89793bec-f0b7-4a98-948e-14f86a1e0ad8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:59.046478 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-89793bec-f0b7-4a98-948e-14f86a1e0ad8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:59.054379 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-89793bec-f0b7-4a98-948e-14f86a1e0ad8 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.081633 Mar 03 02:57:59.054953 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1463/3160] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:58 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:59.637602 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7e1072b2-c662-4ce7-b285-b906011220d2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:59.638270 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7e1072b2-c662-4ce7-b285-b906011220d2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:59.644060 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7e1072b2-c662-4ce7-b285-b906011220d2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:59.644505 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7e1072b2-c662-4ce7-b285-b906011220d2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:59.645276 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7e1072b2-c662-4ce7-b285-b906011220d2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:59.645711 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7e1072b2-c662-4ce7-b285-b906011220d2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:59.810657 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-12f4c729-3cb1-4059-8bc7-3cead0cc750c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:59.811260 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-12f4c729-3cb1-4059-8bc7-3cead0cc750c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:59.817292 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-12f4c729-3cb1-4059-8bc7-3cead0cc750c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:59.817748 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-12f4c729-3cb1-4059-8bc7-3cead0cc750c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:59.818573 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-12f4c729-3cb1-4059-8bc7-3cead0cc750c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:59.819020 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-12f4c729-3cb1-4059-8bc7-3cead0cc750c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:59.859874 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-7e1072b2-c662-4ce7-b285-b906011220d2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:59.867768 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7e1072b2-c662-4ce7-b285-b906011220d2 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.234108 Mar 03 02:57:59.868544 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1698/3161] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:59 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:57:59.951715 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-12f4c729-3cb1-4059-8bc7-3cead0cc750c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:57:59.959789 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-12f4c729-3cb1-4059-8bc7-3cead0cc750c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.153401 Mar 03 02:57:59.960364 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1464/3162] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:59 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:57:59.974169 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8e03b744-9efd-418c-b996-b0819b399118 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:57:59.974782 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8e03b744-9efd-418c-b996-b0819b399118 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:57:59.980862 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8e03b744-9efd-418c-b996-b0819b399118 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:59.981319 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8e03b744-9efd-418c-b996-b0819b399118 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:57:59.982098 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8e03b744-9efd-418c-b996-b0819b399118 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:57:59.982533 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8e03b744-9efd-418c-b996-b0819b399118 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:00.071686 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3c6a04a7-4f9a-4cf1-ae5d-4c5aef80898a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:00.072380 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3c6a04a7-4f9a-4cf1-ae5d-4c5aef80898a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:00.079572 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3c6a04a7-4f9a-4cf1-ae5d-4c5aef80898a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:00.080129 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3c6a04a7-4f9a-4cf1-ae5d-4c5aef80898a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:00.080999 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3c6a04a7-4f9a-4cf1-ae5d-4c5aef80898a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:00.081507 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3c6a04a7-4f9a-4cf1-ae5d-4c5aef80898a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:00.120885 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8e03b744-9efd-418c-b996-b0819b399118 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:00.129105 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8e03b744-9efd-418c-b996-b0819b399118 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.158724 Mar 03 02:58:00.129694 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1699/3163] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:57:59 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:58:00.143115 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3c6a04a7-4f9a-4cf1-ae5d-4c5aef80898a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:00.150792 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3c6a04a7-4f9a-4cf1-ae5d-4c5aef80898a tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.083177 Mar 03 02:58:00.151351 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1465/3164] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:00 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:58:00.884979 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-934133da-5ff6-4687-8453-228e88072da8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:00.885588 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-934133da-5ff6-4687-8453-228e88072da8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:00.892076 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-934133da-5ff6-4687-8453-228e88072da8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:00.892530 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-934133da-5ff6-4687-8453-228e88072da8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:00.893306 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-934133da-5ff6-4687-8453-228e88072da8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:00.893751 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-934133da-5ff6-4687-8453-228e88072da8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:00.977242 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ceae857c-c043-4e69-8dc6-25e448057bde tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:00.977867 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ceae857c-c043-4e69-8dc6-25e448057bde tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:00.984666 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ceae857c-c043-4e69-8dc6-25e448057bde tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:00.985122 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ceae857c-c043-4e69-8dc6-25e448057bde tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:00.985901 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ceae857c-c043-4e69-8dc6-25e448057bde tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:00.986331 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ceae857c-c043-4e69-8dc6-25e448057bde tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:01.028514 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-934133da-5ff6-4687-8453-228e88072da8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:01.036226 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-934133da-5ff6-4687-8453-228e88072da8 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.155143 Mar 03 02:58:01.036791 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1700/3165] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:00 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:01.146404 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c88757e9-1cad-4f0e-a8cf-d3dafb344f02 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:01.147002 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c88757e9-1cad-4f0e-a8cf-d3dafb344f02 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:01.153708 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c88757e9-1cad-4f0e-a8cf-d3dafb344f02 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:01.154192 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c88757e9-1cad-4f0e-a8cf-d3dafb344f02 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:01.154929 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c88757e9-1cad-4f0e-a8cf-d3dafb344f02 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:01.155358 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c88757e9-1cad-4f0e-a8cf-d3dafb344f02 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:01.296127 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c88757e9-1cad-4f0e-a8cf-d3dafb344f02 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:01.303947 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c88757e9-1cad-4f0e-a8cf-d3dafb344f02 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.161361 Mar 03 02:58:01.304512 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1701/3166] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:01 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:58:01.317820 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9b0207c5-f9eb-4dd8-b3e1-4a29d13642fc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:01.318416 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9b0207c5-f9eb-4dd8-b3e1-4a29d13642fc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:01.324284 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9b0207c5-f9eb-4dd8-b3e1-4a29d13642fc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:01.325230 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9b0207c5-f9eb-4dd8-b3e1-4a29d13642fc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:01.326111 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9b0207c5-f9eb-4dd8-b3e1-4a29d13642fc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:01.326548 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9b0207c5-f9eb-4dd8-b3e1-4a29d13642fc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:01.346726 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ceae857c-c043-4e69-8dc6-25e448057bde tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:01.357537 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ceae857c-c043-4e69-8dc6-25e448057bde tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.384074 Mar 03 02:58:01.358302 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1466/3167] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:00 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:58:01.385785 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9b0207c5-f9eb-4dd8-b3e1-4a29d13642fc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:01.394232 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9b0207c5-f9eb-4dd8-b3e1-4a29d13642fc tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080011 Mar 03 02:58:01.394795 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1702/3168] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:01 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:02.054035 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3364d820-6814-4935-b80a-0411469ee7ca tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:02.054658 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3364d820-6814-4935-b80a-0411469ee7ca tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:02.061496 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3364d820-6814-4935-b80a-0411469ee7ca tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:02.061950 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3364d820-6814-4935-b80a-0411469ee7ca tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:02.062728 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3364d820-6814-4935-b80a-0411469ee7ca tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:02.063170 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3364d820-6814-4935-b80a-0411469ee7ca tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:02.191043 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3364d820-6814-4935-b80a-0411469ee7ca tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:02.198706 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3364d820-6814-4935-b80a-0411469ee7ca tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.148710 Mar 03 02:58:02.199269 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1467/3169] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:02 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:02.320840 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f8bb10e5-756b-4039-9c8d-36feb1bb9fb7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:02.321382 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f8bb10e5-756b-4039-9c8d-36feb1bb9fb7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:02.327891 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f8bb10e5-756b-4039-9c8d-36feb1bb9fb7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:02.328350 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f8bb10e5-756b-4039-9c8d-36feb1bb9fb7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:02.329135 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f8bb10e5-756b-4039-9c8d-36feb1bb9fb7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:02.329576 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f8bb10e5-756b-4039-9c8d-36feb1bb9fb7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:02.375045 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f58e0faf-544b-480f-9fd7-3d1b2c95c673 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:02.375663 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f58e0faf-544b-480f-9fd7-3d1b2c95c673 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:02.381382 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f58e0faf-544b-480f-9fd7-3d1b2c95c673 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:02.381839 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f58e0faf-544b-480f-9fd7-3d1b2c95c673 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:02.382622 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f58e0faf-544b-480f-9fd7-3d1b2c95c673 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:02.383060 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f58e0faf-544b-480f-9fd7-3d1b2c95c673 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:02.464380 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f8bb10e5-756b-4039-9c8d-36feb1bb9fb7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:02.473060 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f8bb10e5-756b-4039-9c8d-36feb1bb9fb7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.156057 Mar 03 02:58:02.473639 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1703/3170] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:02 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:02.478199 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ebe60d36-e437-445d-8b35-47ed02d132ab tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:02.478801 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ebe60d36-e437-445d-8b35-47ed02d132ab tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:02.485557 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ebe60d36-e437-445d-8b35-47ed02d132ab tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:02.486015 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ebe60d36-e437-445d-8b35-47ed02d132ab tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:02.486803 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ebe60d36-e437-445d-8b35-47ed02d132ab tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:02.487248 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ebe60d36-e437-445d-8b35-47ed02d132ab tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:02.520709 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f58e0faf-544b-480f-9fd7-3d1b2c95c673 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:02.529138 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f58e0faf-544b-480f-9fd7-3d1b2c95c673 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.158758 Mar 03 02:58:02.529722 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1468/3171] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:02 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:58:02.545587 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ebe60d36-e437-445d-8b35-47ed02d132ab tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:02.553280 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ebe60d36-e437-445d-8b35-47ed02d132ab tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.078715 Mar 03 02:58:02.553840 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1704/3172] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:02 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:03.215889 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-98f0388f-165b-43d1-a7f4-d339c057134a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:03.216503 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-98f0388f-165b-43d1-a7f4-d339c057134a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:03.222754 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-98f0388f-165b-43d1-a7f4-d339c057134a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:03.223208 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-98f0388f-165b-43d1-a7f4-d339c057134a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:03.224024 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-98f0388f-165b-43d1-a7f4-d339c057134a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:03.224469 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-98f0388f-165b-43d1-a7f4-d339c057134a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:03.353009 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-98f0388f-165b-43d1-a7f4-d339c057134a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:03.360917 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-98f0388f-165b-43d1-a7f4-d339c057134a tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.148952 Mar 03 02:58:03.361484 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1469/3173] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:03 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:03.490925 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5aee3411-e4d1-437c-9af0-ef6cbbafd88b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:03.491526 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5aee3411-e4d1-437c-9af0-ef6cbbafd88b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:03.498674 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5aee3411-e4d1-437c-9af0-ef6cbbafd88b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:03.499123 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5aee3411-e4d1-437c-9af0-ef6cbbafd88b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:03.499932 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5aee3411-e4d1-437c-9af0-ef6cbbafd88b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:03.500367 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5aee3411-e4d1-437c-9af0-ef6cbbafd88b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:03.546742 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-cec35aaa-be5f-4f3a-a39a-87855493c2a2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:03.547457 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-cec35aaa-be5f-4f3a-a39a-87855493c2a2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:03.553260 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cec35aaa-be5f-4f3a-a39a-87855493c2a2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:03.553833 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cec35aaa-be5f-4f3a-a39a-87855493c2a2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:03.554630 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cec35aaa-be5f-4f3a-a39a-87855493c2a2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:03.555138 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cec35aaa-be5f-4f3a-a39a-87855493c2a2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:03.636806 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5aee3411-e4d1-437c-9af0-ef6cbbafd88b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:03.645078 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5aee3411-e4d1-437c-9af0-ef6cbbafd88b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.157951 Mar 03 02:58:03.645899 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1705/3174] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:03 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:03.650184 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b3f0f0f5-659a-4f08-8c0a-c505f3900387 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:03.650775 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b3f0f0f5-659a-4f08-8c0a-c505f3900387 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:03.656570 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b3f0f0f5-659a-4f08-8c0a-c505f3900387 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:03.657026 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b3f0f0f5-659a-4f08-8c0a-c505f3900387 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:03.657805 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b3f0f0f5-659a-4f08-8c0a-c505f3900387 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:03.658236 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b3f0f0f5-659a-4f08-8c0a-c505f3900387 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:03.705080 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-cec35aaa-be5f-4f3a-a39a-87855493c2a2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:03.712775 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-cec35aaa-be5f-4f3a-a39a-87855493c2a2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.170409 Mar 03 02:58:03.713360 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1470/3175] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:03 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:58:03.722645 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b3f0f0f5-659a-4f08-8c0a-c505f3900387 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:03.730594 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b3f0f0f5-659a-4f08-8c0a-c505f3900387 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.083964 Mar 03 02:58:03.731806 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1706/3176] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:03 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:04.377816 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5a6641e8-784a-47fe-b535-758415d46257 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:04.378431 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5a6641e8-784a-47fe-b535-758415d46257 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:04.384693 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5a6641e8-784a-47fe-b535-758415d46257 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:04.385148 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5a6641e8-784a-47fe-b535-758415d46257 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:04.385927 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5a6641e8-784a-47fe-b535-758415d46257 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:04.386370 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5a6641e8-784a-47fe-b535-758415d46257 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:04.517606 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5a6641e8-784a-47fe-b535-758415d46257 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:04.525423 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5a6641e8-784a-47fe-b535-758415d46257 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.151480 Mar 03 02:58:04.525999 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1471/3177] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:04 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:04.662215 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-68c9a846-e73f-41bc-8248-c059a95a75db tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:04.662740 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-68c9a846-e73f-41bc-8248-c059a95a75db tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:04.669108 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-68c9a846-e73f-41bc-8248-c059a95a75db tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:04.669558 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-68c9a846-e73f-41bc-8248-c059a95a75db tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:04.670344 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-68c9a846-e73f-41bc-8248-c059a95a75db tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:04.670786 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-68c9a846-e73f-41bc-8248-c059a95a75db tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:04.730242 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e4cdaa56-6fe4-4b2b-be95-57de8e4b236e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:04.731056 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e4cdaa56-6fe4-4b2b-be95-57de8e4b236e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:04.736628 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e4cdaa56-6fe4-4b2b-be95-57de8e4b236e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:04.737083 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e4cdaa56-6fe4-4b2b-be95-57de8e4b236e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:04.737869 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e4cdaa56-6fe4-4b2b-be95-57de8e4b236e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:04.738309 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e4cdaa56-6fe4-4b2b-be95-57de8e4b236e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:04.801525 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-68c9a846-e73f-41bc-8248-c059a95a75db tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:04.810257 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-68c9a846-e73f-41bc-8248-c059a95a75db tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.150920 Mar 03 02:58:04.810917 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1707/3178] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:04 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:04.815407 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-54ab2b6b-b7fc-479c-b705-e86cac8ac568 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:04.816030 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-54ab2b6b-b7fc-479c-b705-e86cac8ac568 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:04.821688 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-54ab2b6b-b7fc-479c-b705-e86cac8ac568 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:04.822141 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-54ab2b6b-b7fc-479c-b705-e86cac8ac568 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:04.822921 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-54ab2b6b-b7fc-479c-b705-e86cac8ac568 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:04.823356 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-54ab2b6b-b7fc-479c-b705-e86cac8ac568 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:04.870833 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e4cdaa56-6fe4-4b2b-be95-57de8e4b236e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:04.880008 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e4cdaa56-6fe4-4b2b-be95-57de8e4b236e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.154039 Mar 03 02:58:04.880580 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1472/3179] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:04 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:58:04.884495 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-54ab2b6b-b7fc-479c-b705-e86cac8ac568 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:04.893518 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-54ab2b6b-b7fc-479c-b705-e86cac8ac568 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.081657 Mar 03 02:58:04.894075 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1708/3180] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:04 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:05.543159 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2349f3f4-3b7b-4431-8ed0-28578d85b654 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:05.544090 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2349f3f4-3b7b-4431-8ed0-28578d85b654 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:05.549905 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2349f3f4-3b7b-4431-8ed0-28578d85b654 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:05.550351 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2349f3f4-3b7b-4431-8ed0-28578d85b654 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:05.551129 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2349f3f4-3b7b-4431-8ed0-28578d85b654 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:05.551563 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2349f3f4-3b7b-4431-8ed0-28578d85b654 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:05.684441 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2349f3f4-3b7b-4431-8ed0-28578d85b654 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:05.692102 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2349f3f4-3b7b-4431-8ed0-28578d85b654 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.152936 Mar 03 02:58:05.692668 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1473/3181] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:05 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:05.828471 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c8bb3195-dbc2-44ea-8704-573fbeee4d9f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:05.829179 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c8bb3195-dbc2-44ea-8704-573fbeee4d9f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:05.835710 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c8bb3195-dbc2-44ea-8704-573fbeee4d9f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:05.836163 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c8bb3195-dbc2-44ea-8704-573fbeee4d9f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:05.836932 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c8bb3195-dbc2-44ea-8704-573fbeee4d9f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:05.837366 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c8bb3195-dbc2-44ea-8704-573fbeee4d9f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:05.898128 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-17fe2e78-ac3b-42c9-b5d9-6d9da15ce269 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:05.898708 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-17fe2e78-ac3b-42c9-b5d9-6d9da15ce269 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:05.905378 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-17fe2e78-ac3b-42c9-b5d9-6d9da15ce269 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:05.905831 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-17fe2e78-ac3b-42c9-b5d9-6d9da15ce269 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:05.906612 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-17fe2e78-ac3b-42c9-b5d9-6d9da15ce269 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:05.907043 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-17fe2e78-ac3b-42c9-b5d9-6d9da15ce269 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:05.972398 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c8bb3195-dbc2-44ea-8704-573fbeee4d9f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:05.980423 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c8bb3195-dbc2-44ea-8704-573fbeee4d9f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.157557 Mar 03 02:58:05.981072 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1709/3182] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:05 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:05.985625 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-811dccd3-fb5c-4c49-b7bb-5fe5aba5b278 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:05.986226 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-811dccd3-fb5c-4c49-b7bb-5fe5aba5b278 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:05.991738 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-811dccd3-fb5c-4c49-b7bb-5fe5aba5b278 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:05.992189 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-811dccd3-fb5c-4c49-b7bb-5fe5aba5b278 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:05.992967 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-811dccd3-fb5c-4c49-b7bb-5fe5aba5b278 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:05.993397 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-811dccd3-fb5c-4c49-b7bb-5fe5aba5b278 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:06.046943 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-17fe2e78-ac3b-42c9-b5d9-6d9da15ce269 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:06.053980 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-811dccd3-fb5c-4c49-b7bb-5fe5aba5b278 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:06.054956 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-17fe2e78-ac3b-42c9-b5d9-6d9da15ce269 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.160634 Mar 03 02:58:06.055533 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1474/3183] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:05 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:58:06.062013 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-811dccd3-fb5c-4c49-b7bb-5fe5aba5b278 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079870 Mar 03 02:58:06.062548 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1710/3184] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:05 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:06.716499 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c21c33fc-391f-4c7b-93ef-d2e730e4a356 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:06.717036 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c21c33fc-391f-4c7b-93ef-d2e730e4a356 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:06.723247 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c21c33fc-391f-4c7b-93ef-d2e730e4a356 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:06.723742 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c21c33fc-391f-4c7b-93ef-d2e730e4a356 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:06.724515 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c21c33fc-391f-4c7b-93ef-d2e730e4a356 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:06.724953 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c21c33fc-391f-4c7b-93ef-d2e730e4a356 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:06.858433 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c21c33fc-391f-4c7b-93ef-d2e730e4a356 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:06.866078 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c21c33fc-391f-4c7b-93ef-d2e730e4a356 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.154091 Mar 03 02:58:06.866674 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1475/3185] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:06 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:06.998361 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b974e7b7-ceae-4c58-aeb6-5d8cd48515a5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:06.998922 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b974e7b7-ceae-4c58-aeb6-5d8cd48515a5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:07.005235 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b974e7b7-ceae-4c58-aeb6-5d8cd48515a5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:07.005679 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b974e7b7-ceae-4c58-aeb6-5d8cd48515a5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:07.006448 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b974e7b7-ceae-4c58-aeb6-5d8cd48515a5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:07.006912 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b974e7b7-ceae-4c58-aeb6-5d8cd48515a5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:07.072449 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1e6f7940-8892-4aac-906f-5e3fe660c124 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:07.073342 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1e6f7940-8892-4aac-906f-5e3fe660c124 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:07.079312 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1e6f7940-8892-4aac-906f-5e3fe660c124 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:07.079819 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1e6f7940-8892-4aac-906f-5e3fe660c124 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:07.080881 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1e6f7940-8892-4aac-906f-5e3fe660c124 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:07.081339 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1e6f7940-8892-4aac-906f-5e3fe660c124 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:07.142844 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b974e7b7-ceae-4c58-aeb6-5d8cd48515a5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:07.150570 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b974e7b7-ceae-4c58-aeb6-5d8cd48515a5 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.156311 Mar 03 02:58:07.151145 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1711/3186] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:06 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:07.156099 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-080e0ebf-547c-43cb-950c-a9eb048fd203 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:07.156707 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-080e0ebf-547c-43cb-950c-a9eb048fd203 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:07.163368 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-080e0ebf-547c-43cb-950c-a9eb048fd203 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:07.163858 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-080e0ebf-547c-43cb-950c-a9eb048fd203 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:07.164647 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-080e0ebf-547c-43cb-950c-a9eb048fd203 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:07.165094 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-080e0ebf-547c-43cb-950c-a9eb048fd203 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:07.211685 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1e6f7940-8892-4aac-906f-5e3fe660c124 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:07.220250 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1e6f7940-8892-4aac-906f-5e3fe660c124 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.151978 Mar 03 02:58:07.220824 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1476/3187] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:07 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:58:07.224053 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-080e0ebf-547c-43cb-950c-a9eb048fd203 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:07.233017 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-080e0ebf-547c-43cb-950c-a9eb048fd203 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080886 Mar 03 02:58:07.233580 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1712/3188] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:07 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:07.883754 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d0f0ce1a-ea28-46ba-98b7-f1dee5cd96c5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:07.884369 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d0f0ce1a-ea28-46ba-98b7-f1dee5cd96c5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:07.891244 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d0f0ce1a-ea28-46ba-98b7-f1dee5cd96c5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:07.891746 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d0f0ce1a-ea28-46ba-98b7-f1dee5cd96c5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:07.892531 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d0f0ce1a-ea28-46ba-98b7-f1dee5cd96c5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:07.892977 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d0f0ce1a-ea28-46ba-98b7-f1dee5cd96c5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:08.027699 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d0f0ce1a-ea28-46ba-98b7-f1dee5cd96c5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:08.035966 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d0f0ce1a-ea28-46ba-98b7-f1dee5cd96c5 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.156128 Mar 03 02:58:08.036537 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1477/3189] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:07 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:08.168154 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e70d76ba-91ea-4be5-8908-2b996d8f7adb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:08.169459 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e70d76ba-91ea-4be5-8908-2b996d8f7adb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:08.175627 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e70d76ba-91ea-4be5-8908-2b996d8f7adb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:08.176071 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e70d76ba-91ea-4be5-8908-2b996d8f7adb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:08.176836 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e70d76ba-91ea-4be5-8908-2b996d8f7adb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:08.177268 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e70d76ba-91ea-4be5-8908-2b996d8f7adb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:08.238107 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-46ed8bf7-8b74-4f12-b804-e002a0071626 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:08.238710 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-46ed8bf7-8b74-4f12-b804-e002a0071626 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:08.244520 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-46ed8bf7-8b74-4f12-b804-e002a0071626 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:08.244980 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-46ed8bf7-8b74-4f12-b804-e002a0071626 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:08.245767 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-46ed8bf7-8b74-4f12-b804-e002a0071626 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:08.246211 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-46ed8bf7-8b74-4f12-b804-e002a0071626 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:08.317172 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e70d76ba-91ea-4be5-8908-2b996d8f7adb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:08.325146 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e70d76ba-91ea-4be5-8908-2b996d8f7adb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.160788 Mar 03 02:58:08.325909 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1713/3190] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:08 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:08.349595 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ad65cb1e-a61c-4086-9421-520180a814c1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:08.350205 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ad65cb1e-a61c-4086-9421-520180a814c1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:08.360568 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ad65cb1e-a61c-4086-9421-520180a814c1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:08.361034 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ad65cb1e-a61c-4086-9421-520180a814c1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:08.361810 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ad65cb1e-a61c-4086-9421-520180a814c1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:08.362246 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ad65cb1e-a61c-4086-9421-520180a814c1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:08.382285 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-46ed8bf7-8b74-4f12-b804-e002a0071626 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:08.390107 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-46ed8bf7-8b74-4f12-b804-e002a0071626 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.155913 Mar 03 02:58:08.390760 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1478/3191] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:08 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:58:08.423152 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ad65cb1e-a61c-4086-9421-520180a814c1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:08.430866 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ad65cb1e-a61c-4086-9421-520180a814c1 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.089017 Mar 03 02:58:08.431429 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1714/3192] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:08 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:09.054195 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-46a0e661-9383-440b-93ab-755cf1f6e858 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:09.054803 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-46a0e661-9383-440b-93ab-755cf1f6e858 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:09.061144 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-46a0e661-9383-440b-93ab-755cf1f6e858 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:09.061580 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-46a0e661-9383-440b-93ab-755cf1f6e858 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:09.062358 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-46a0e661-9383-440b-93ab-755cf1f6e858 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:09.062801 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-46a0e661-9383-440b-93ab-755cf1f6e858 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:09.201221 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-46a0e661-9383-440b-93ab-755cf1f6e858 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:09.209652 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-46a0e661-9383-440b-93ab-755cf1f6e858 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.159327 Mar 03 02:58:09.210226 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1479/3193] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:09 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:09.352047 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5ba90a12-50f4-445d-98cb-9c15cb619901 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:09.352660 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5ba90a12-50f4-445d-98cb-9c15cb619901 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:09.359143 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5ba90a12-50f4-445d-98cb-9c15cb619901 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:09.359597 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5ba90a12-50f4-445d-98cb-9c15cb619901 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:09.360410 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5ba90a12-50f4-445d-98cb-9c15cb619901 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:09.360883 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5ba90a12-50f4-445d-98cb-9c15cb619901 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:09.406416 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3d698842-af19-4ea1-bd4b-5703134b8b59 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:09.407165 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3d698842-af19-4ea1-bd4b-5703134b8b59 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:09.412998 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3d698842-af19-4ea1-bd4b-5703134b8b59 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:09.413449 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3d698842-af19-4ea1-bd4b-5703134b8b59 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:09.414229 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3d698842-af19-4ea1-bd4b-5703134b8b59 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:09.414701 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3d698842-af19-4ea1-bd4b-5703134b8b59 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:09.494740 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5ba90a12-50f4-445d-98cb-9c15cb619901 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:09.503243 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5ba90a12-50f4-445d-98cb-9c15cb619901 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.155053 Mar 03 02:58:09.503850 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1715/3194] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:09 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:09.508293 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-195b4f8d-ecbc-4c7c-b6cd-92bafe003ae4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:09.508896 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-195b4f8d-ecbc-4c7c-b6cd-92bafe003ae4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:09.515554 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-195b4f8d-ecbc-4c7c-b6cd-92bafe003ae4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:09.516114 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-195b4f8d-ecbc-4c7c-b6cd-92bafe003ae4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:09.516905 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-195b4f8d-ecbc-4c7c-b6cd-92bafe003ae4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:09.517349 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-195b4f8d-ecbc-4c7c-b6cd-92bafe003ae4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:09.552385 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3d698842-af19-4ea1-bd4b-5703134b8b59 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:09.561719 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3d698842-af19-4ea1-bd4b-5703134b8b59 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.159322 Mar 03 02:58:09.562302 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1480/3195] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:09 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:58:09.579829 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-195b4f8d-ecbc-4c7c-b6cd-92bafe003ae4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:09.587800 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-195b4f8d-ecbc-4c7c-b6cd-92bafe003ae4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.083002 Mar 03 02:58:09.588358 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1716/3196] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:09 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:10.226746 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-fa2deb95-899c-472b-a8fd-dbc63c72d559 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:10.227346 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-fa2deb95-899c-472b-a8fd-dbc63c72d559 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:10.234462 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fa2deb95-899c-472b-a8fd-dbc63c72d559 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:10.234908 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fa2deb95-899c-472b-a8fd-dbc63c72d559 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:10.235702 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fa2deb95-899c-472b-a8fd-dbc63c72d559 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:10.236134 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fa2deb95-899c-472b-a8fd-dbc63c72d559 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:10.365001 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-fa2deb95-899c-472b-a8fd-dbc63c72d559 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:10.372656 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-fa2deb95-899c-472b-a8fd-dbc63c72d559 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.149790 Mar 03 02:58:10.373218 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1481/3197] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:10 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:10.521509 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4a9c1192-4c06-4fea-beca-c7cbe5c7e96d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:10.522122 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4a9c1192-4c06-4fea-beca-c7cbe5c7e96d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:10.528995 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4a9c1192-4c06-4fea-beca-c7cbe5c7e96d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:10.529449 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4a9c1192-4c06-4fea-beca-c7cbe5c7e96d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:10.530227 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4a9c1192-4c06-4fea-beca-c7cbe5c7e96d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:10.530664 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4a9c1192-4c06-4fea-beca-c7cbe5c7e96d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:10.579330 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b4770f13-3b32-4f44-87f5-a4cc6550d15d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:10.579991 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b4770f13-3b32-4f44-87f5-a4cc6550d15d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:10.585746 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b4770f13-3b32-4f44-87f5-a4cc6550d15d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:10.586196 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b4770f13-3b32-4f44-87f5-a4cc6550d15d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:10.586979 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b4770f13-3b32-4f44-87f5-a4cc6550d15d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:10.587418 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b4770f13-3b32-4f44-87f5-a4cc6550d15d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:10.662483 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4a9c1192-4c06-4fea-beca-c7cbe5c7e96d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:10.670221 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4a9c1192-4c06-4fea-beca-c7cbe5c7e96d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.152452 Mar 03 02:58:10.670771 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1717/3198] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:10 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:10.675154 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-deffd42d-0ede-41d8-b375-fc2417705438 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:10.675997 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-deffd42d-0ede-41d8-b375-fc2417705438 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:10.683435 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-deffd42d-0ede-41d8-b375-fc2417705438 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:10.684525 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-deffd42d-0ede-41d8-b375-fc2417705438 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:10.685422 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-deffd42d-0ede-41d8-b375-fc2417705438 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:10.685858 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-deffd42d-0ede-41d8-b375-fc2417705438 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:10.727892 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b4770f13-3b32-4f44-87f5-a4cc6550d15d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:10.736713 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b4770f13-3b32-4f44-87f5-a4cc6550d15d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.161217 Mar 03 02:58:10.737295 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1482/3199] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:10 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:58:10.745599 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-deffd42d-0ede-41d8-b375-fc2417705438 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:10.753830 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-deffd42d-0ede-41d8-b375-fc2417705438 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.082116 Mar 03 02:58:10.754427 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1718/3200] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:10 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:11.390384 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d4d421ef-6984-4fe0-8281-d2edcee26c34 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:11.391000 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d4d421ef-6984-4fe0-8281-d2edcee26c34 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:11.397322 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d4d421ef-6984-4fe0-8281-d2edcee26c34 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:11.397777 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d4d421ef-6984-4fe0-8281-d2edcee26c34 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:11.398553 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d4d421ef-6984-4fe0-8281-d2edcee26c34 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:11.398998 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d4d421ef-6984-4fe0-8281-d2edcee26c34 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:11.527230 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d4d421ef-6984-4fe0-8281-d2edcee26c34 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:11.535519 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d4d421ef-6984-4fe0-8281-d2edcee26c34 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.149216 Mar 03 02:58:11.536117 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1483/3201] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:11 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:11.686375 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-11a00b78-fe32-48f6-ae34-c30e47a047c2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:11.686905 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-11a00b78-fe32-48f6-ae34-c30e47a047c2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:11.693146 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-11a00b78-fe32-48f6-ae34-c30e47a047c2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:11.693600 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-11a00b78-fe32-48f6-ae34-c30e47a047c2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:11.694379 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-11a00b78-fe32-48f6-ae34-c30e47a047c2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:11.694816 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-11a00b78-fe32-48f6-ae34-c30e47a047c2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:11.754298 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-dd4f7e93-6e30-476d-8e92-9f00a98e6def tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:11.755626 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-dd4f7e93-6e30-476d-8e92-9f00a98e6def tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:11.761447 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dd4f7e93-6e30-476d-8e92-9f00a98e6def tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:11.762397 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dd4f7e93-6e30-476d-8e92-9f00a98e6def tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:11.763284 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dd4f7e93-6e30-476d-8e92-9f00a98e6def tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:11.763758 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dd4f7e93-6e30-476d-8e92-9f00a98e6def tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:11.831398 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-11a00b78-fe32-48f6-ae34-c30e47a047c2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:11.839162 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-11a00b78-fe32-48f6-ae34-c30e47a047c2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.156790 Mar 03 02:58:11.839807 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1719/3202] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:11 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:58:11.844865 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-cebac25d-ee59-4c88-a09f-89b598e7c47e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:11.849646 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-cebac25d-ee59-4c88-a09f-89b598e7c47e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:11.855804 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cebac25d-ee59-4c88-a09f-89b598e7c47e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:11.856373 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cebac25d-ee59-4c88-a09f-89b598e7c47e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:11.857153 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cebac25d-ee59-4c88-a09f-89b598e7c47e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:11.857586 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cebac25d-ee59-4c88-a09f-89b598e7c47e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:11.893809 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-dd4f7e93-6e30-476d-8e92-9f00a98e6def tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:11.901658 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-dd4f7e93-6e30-476d-8e92-9f00a98e6def tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.151242 Mar 03 02:58:11.902227 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1484/3203] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:11 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:58:11.916192 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-cebac25d-ee59-4c88-a09f-89b598e7c47e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:11.924154 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-cebac25d-ee59-4c88-a09f-89b598e7c47e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.082797 Mar 03 02:58:11.924714 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1720/3204] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:11 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:12.553233 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8ea10db0-ba37-452c-85d5-e603e13abe88 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:12.553840 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8ea10db0-ba37-452c-85d5-e603e13abe88 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:12.560681 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8ea10db0-ba37-452c-85d5-e603e13abe88 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:12.561127 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8ea10db0-ba37-452c-85d5-e603e13abe88 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:12.561891 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8ea10db0-ba37-452c-85d5-e603e13abe88 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:12.562326 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8ea10db0-ba37-452c-85d5-e603e13abe88 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:12.693431 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8ea10db0-ba37-452c-85d5-e603e13abe88 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:12.701148 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8ea10db0-ba37-452c-85d5-e603e13abe88 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.151818 Mar 03 02:58:12.701705 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1485/3205] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:12 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:12.857749 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-78c78681-8e45-4078-915a-43ae8ed41162 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:12.858346 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-78c78681-8e45-4078-915a-43ae8ed41162 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:12.864499 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-78c78681-8e45-4078-915a-43ae8ed41162 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:12.864943 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-78c78681-8e45-4078-915a-43ae8ed41162 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:12.865708 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-78c78681-8e45-4078-915a-43ae8ed41162 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:12.866139 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-78c78681-8e45-4078-915a-43ae8ed41162 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:12.920608 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0d11746d-66ee-498a-a9a9-3555f79026c5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:12.921344 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0d11746d-66ee-498a-a9a9-3555f79026c5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:12.927049 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0d11746d-66ee-498a-a9a9-3555f79026c5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:12.927497 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0d11746d-66ee-498a-a9a9-3555f79026c5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:12.928318 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0d11746d-66ee-498a-a9a9-3555f79026c5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:12.928755 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0d11746d-66ee-498a-a9a9-3555f79026c5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:13.003051 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-78c78681-8e45-4078-915a-43ae8ed41162 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:13.010971 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-78c78681-8e45-4078-915a-43ae8ed41162 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.158027 Mar 03 02:58:13.011537 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1721/3206] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:12 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:13.015940 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-70b7a47d-4d57-48c0-8ce3-47e4f0f44206 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:13.016533 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-70b7a47d-4d57-48c0-8ce3-47e4f0f44206 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:13.022304 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-70b7a47d-4d57-48c0-8ce3-47e4f0f44206 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:13.022749 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-70b7a47d-4d57-48c0-8ce3-47e4f0f44206 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:13.023519 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-70b7a47d-4d57-48c0-8ce3-47e4f0f44206 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:13.023983 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-70b7a47d-4d57-48c0-8ce3-47e4f0f44206 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:13.061478 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0d11746d-66ee-498a-a9a9-3555f79026c5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:13.069289 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0d11746d-66ee-498a-a9a9-3555f79026c5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.154064 Mar 03 02:58:13.069870 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1486/3207] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:12 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:58:13.086189 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-70b7a47d-4d57-48c0-8ce3-47e4f0f44206 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:13.094470 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-70b7a47d-4d57-48c0-8ce3-47e4f0f44206 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.081994 Mar 03 02:58:13.095037 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1722/3208] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:13 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:13.718157 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d444689b-4fcf-47cd-869b-682060cb0588 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:13.718788 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d444689b-4fcf-47cd-869b-682060cb0588 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:13.725069 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d444689b-4fcf-47cd-869b-682060cb0588 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:13.725521 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d444689b-4fcf-47cd-869b-682060cb0588 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:13.726314 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d444689b-4fcf-47cd-869b-682060cb0588 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:13.726745 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d444689b-4fcf-47cd-869b-682060cb0588 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:13.862901 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d444689b-4fcf-47cd-869b-682060cb0588 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:13.870703 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d444689b-4fcf-47cd-869b-682060cb0588 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.156421 Mar 03 02:58:13.871786 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1487/3209] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:13 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:14.027192 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-81241e7c-01c9-4720-b6ae-28f6daa04674 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:14.027940 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-81241e7c-01c9-4720-b6ae-28f6daa04674 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:14.034113 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-81241e7c-01c9-4720-b6ae-28f6daa04674 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:14.034558 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-81241e7c-01c9-4720-b6ae-28f6daa04674 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:14.035327 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-81241e7c-01c9-4720-b6ae-28f6daa04674 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:14.035800 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-81241e7c-01c9-4720-b6ae-28f6daa04674 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:14.086272 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-640b6225-cfca-42c1-863b-a10a00204a8e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:14.086883 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-640b6225-cfca-42c1-863b-a10a00204a8e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:14.093394 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-640b6225-cfca-42c1-863b-a10a00204a8e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:14.093848 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-640b6225-cfca-42c1-863b-a10a00204a8e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:14.094646 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-640b6225-cfca-42c1-863b-a10a00204a8e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:14.095086 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-640b6225-cfca-42c1-863b-a10a00204a8e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:14.170451 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-81241e7c-01c9-4720-b6ae-28f6daa04674 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:14.178249 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-81241e7c-01c9-4720-b6ae-28f6daa04674 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.154946 Mar 03 02:58:14.178822 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1723/3210] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:14 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:14.183329 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f5a44f88-7e1c-48b3-98bc-3e85427431d4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:14.184521 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f5a44f88-7e1c-48b3-98bc-3e85427431d4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:14.190320 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f5a44f88-7e1c-48b3-98bc-3e85427431d4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:14.190774 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f5a44f88-7e1c-48b3-98bc-3e85427431d4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:14.191547 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f5a44f88-7e1c-48b3-98bc-3e85427431d4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:14.192060 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f5a44f88-7e1c-48b3-98bc-3e85427431d4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:14.227387 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-640b6225-cfca-42c1-863b-a10a00204a8e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:14.236199 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-640b6225-cfca-42c1-863b-a10a00204a8e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.153785 Mar 03 02:58:14.236837 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1488/3211] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:14 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:58:14.252823 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f5a44f88-7e1c-48b3-98bc-3e85427431d4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:14.260502 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f5a44f88-7e1c-48b3-98bc-3e85427431d4 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080751 Mar 03 02:58:14.261067 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1724/3212] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:14 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:14.889515 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c013aef9-b103-439f-9ab8-98ef8da124f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:14.890046 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c013aef9-b103-439f-9ab8-98ef8da124f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:14.896288 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c013aef9-b103-439f-9ab8-98ef8da124f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:14.896758 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c013aef9-b103-439f-9ab8-98ef8da124f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:14.897525 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c013aef9-b103-439f-9ab8-98ef8da124f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:14.897960 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c013aef9-b103-439f-9ab8-98ef8da124f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:15.031806 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c013aef9-b103-439f-9ab8-98ef8da124f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:15.039366 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c013aef9-b103-439f-9ab8-98ef8da124f6 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.154948 Mar 03 02:58:15.039962 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1489/3213] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:14 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:15.195845 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5454e146-7630-4ad5-871a-15884ebb3736 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:15.196402 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5454e146-7630-4ad5-871a-15884ebb3736 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:15.203201 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5454e146-7630-4ad5-871a-15884ebb3736 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:15.203670 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5454e146-7630-4ad5-871a-15884ebb3736 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:15.204444 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5454e146-7630-4ad5-871a-15884ebb3736 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:15.204874 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5454e146-7630-4ad5-871a-15884ebb3736 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:15.253413 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-cf7ecfbd-2cc2-48b5-ba57-b0cfa04e8e4d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:15.253998 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-cf7ecfbd-2cc2-48b5-ba57-b0cfa04e8e4d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:15.259885 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cf7ecfbd-2cc2-48b5-ba57-b0cfa04e8e4d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:15.260339 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cf7ecfbd-2cc2-48b5-ba57-b0cfa04e8e4d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:15.261107 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cf7ecfbd-2cc2-48b5-ba57-b0cfa04e8e4d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:15.261538 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cf7ecfbd-2cc2-48b5-ba57-b0cfa04e8e4d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:15.340666 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5454e146-7630-4ad5-871a-15884ebb3736 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:15.348589 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5454e146-7630-4ad5-871a-15884ebb3736 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.156633 Mar 03 02:58:15.349372 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1725/3214] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:15 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:15.353539 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b92b47f3-3d75-45ae-838a-ee81f7288d06 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:15.354133 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b92b47f3-3d75-45ae-838a-ee81f7288d06 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:15.360136 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b92b47f3-3d75-45ae-838a-ee81f7288d06 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:15.360589 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b92b47f3-3d75-45ae-838a-ee81f7288d06 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:15.361362 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b92b47f3-3d75-45ae-838a-ee81f7288d06 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:15.361794 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b92b47f3-3d75-45ae-838a-ee81f7288d06 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:15.393498 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-cf7ecfbd-2cc2-48b5-ba57-b0cfa04e8e4d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:15.401227 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-cf7ecfbd-2cc2-48b5-ba57-b0cfa04e8e4d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.151657 Mar 03 02:58:15.401788 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1490/3215] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:15 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:58:15.420966 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b92b47f3-3d75-45ae-838a-ee81f7288d06 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:15.428727 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b92b47f3-3d75-45ae-838a-ee81f7288d06 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.078657 Mar 03 02:58:15.429293 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1726/3216] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:15 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:16.056109 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9f9298b6-5dfe-469e-bb8b-dfa06e326328 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:16.056716 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9f9298b6-5dfe-469e-bb8b-dfa06e326328 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:16.063100 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9f9298b6-5dfe-469e-bb8b-dfa06e326328 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:16.063547 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9f9298b6-5dfe-469e-bb8b-dfa06e326328 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:16.064347 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9f9298b6-5dfe-469e-bb8b-dfa06e326328 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:16.064787 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9f9298b6-5dfe-469e-bb8b-dfa06e326328 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:16.193528 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9f9298b6-5dfe-469e-bb8b-dfa06e326328 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:16.201771 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9f9298b6-5dfe-469e-bb8b-dfa06e326328 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.149572 Mar 03 02:58:16.202332 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1491/3217] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:16 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:16.365815 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-779334af-792e-4b42-943f-934ed0b1c78f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:16.366418 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-779334af-792e-4b42-943f-934ed0b1c78f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:16.373474 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-779334af-792e-4b42-943f-934ed0b1c78f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:16.373926 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-779334af-792e-4b42-943f-934ed0b1c78f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:16.374695 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-779334af-792e-4b42-943f-934ed0b1c78f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:16.375127 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-779334af-792e-4b42-943f-934ed0b1c78f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:16.419205 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-795f568e-4dd0-4ce1-b30c-abe722838350 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:16.419845 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-795f568e-4dd0-4ce1-b30c-abe722838350 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:16.425549 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-795f568e-4dd0-4ce1-b30c-abe722838350 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:16.426001 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-795f568e-4dd0-4ce1-b30c-abe722838350 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:16.426781 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-795f568e-4dd0-4ce1-b30c-abe722838350 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:16.427227 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-795f568e-4dd0-4ce1-b30c-abe722838350 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:16.505473 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-779334af-792e-4b42-943f-934ed0b1c78f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:16.513502 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-779334af-792e-4b42-943f-934ed0b1c78f tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.151479 Mar 03 02:58:16.514076 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1727/3218] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:16 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:16.518545 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-fc553d08-cb3a-405f-9ac5-f824d9a3026e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:16.519145 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-fc553d08-cb3a-405f-9ac5-f824d9a3026e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:16.524847 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fc553d08-cb3a-405f-9ac5-f824d9a3026e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:16.525291 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fc553d08-cb3a-405f-9ac5-f824d9a3026e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:16.526090 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fc553d08-cb3a-405f-9ac5-f824d9a3026e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:16.526522 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fc553d08-cb3a-405f-9ac5-f824d9a3026e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:16.563702 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-795f568e-4dd0-4ce1-b30c-abe722838350 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:16.571414 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-795f568e-4dd0-4ce1-b30c-abe722838350 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.156763 Mar 03 02:58:16.572017 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1492/3219] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:16 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:58:16.588911 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-fc553d08-cb3a-405f-9ac5-f824d9a3026e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:16.597875 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-fc553d08-cb3a-405f-9ac5-f824d9a3026e tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.082869 Mar 03 02:58:16.598438 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1728/3220] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:16 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:17.218632 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-95b084ce-31c5-48ad-8835-ef541cd71313 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:17.219234 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-95b084ce-31c5-48ad-8835-ef541cd71313 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:17.225422 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-95b084ce-31c5-48ad-8835-ef541cd71313 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:17.225868 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-95b084ce-31c5-48ad-8835-ef541cd71313 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:17.226665 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-95b084ce-31c5-48ad-8835-ef541cd71313 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:17.227095 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-95b084ce-31c5-48ad-8835-ef541cd71313 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:17.356095 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-95b084ce-31c5-48ad-8835-ef541cd71313 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:17.363849 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-95b084ce-31c5-48ad-8835-ef541cd71313 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.149125 Mar 03 02:58:17.364406 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1493/3221] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:17 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:17.530594 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5465c03d-3380-457e-9856-5d407bbb3f13 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:17.531231 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5465c03d-3380-457e-9856-5d407bbb3f13 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:17.537408 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5465c03d-3380-457e-9856-5d407bbb3f13 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:17.537864 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5465c03d-3380-457e-9856-5d407bbb3f13 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:17.538639 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5465c03d-3380-457e-9856-5d407bbb3f13 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:17.539078 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5465c03d-3380-457e-9856-5d407bbb3f13 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:17.589312 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-78783cb7-1673-4b81-b641-8fa5bc79f40c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:17.590466 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-78783cb7-1673-4b81-b641-8fa5bc79f40c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:17.596391 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-78783cb7-1673-4b81-b641-8fa5bc79f40c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:17.596844 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-78783cb7-1673-4b81-b641-8fa5bc79f40c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:17.597631 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-78783cb7-1673-4b81-b641-8fa5bc79f40c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:17.598069 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-78783cb7-1673-4b81-b641-8fa5bc79f40c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:17.670740 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5465c03d-3380-457e-9856-5d407bbb3f13 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:17.678449 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5465c03d-3380-457e-9856-5d407bbb3f13 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.152213 Mar 03 02:58:17.679113 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1729/3222] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:17 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:17.684449 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4b487baa-9867-47f6-b27f-922d77d68d4f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:17.685247 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4b487baa-9867-47f6-b27f-922d77d68d4f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:17.691186 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4b487baa-9867-47f6-b27f-922d77d68d4f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:17.691672 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4b487baa-9867-47f6-b27f-922d77d68d4f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:17.692460 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4b487baa-9867-47f6-b27f-922d77d68d4f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:17.692896 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4b487baa-9867-47f6-b27f-922d77d68d4f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:17.734398 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-78783cb7-1673-4b81-b641-8fa5bc79f40c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:17.742151 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-78783cb7-1673-4b81-b641-8fa5bc79f40c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.156651 Mar 03 02:58:17.742941 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1494/3223] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:17 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:58:17.754386 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4b487baa-9867-47f6-b27f-922d77d68d4f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:17.762638 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4b487baa-9867-47f6-b27f-922d77d68d4f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.082198 Mar 03 02:58:17.763207 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1730/3224] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:17 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:18.381300 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1695f74a-a1d0-4ad4-bdb1-6ea8b3765d51 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:18.381946 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1695f74a-a1d0-4ad4-bdb1-6ea8b3765d51 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:18.388333 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1695f74a-a1d0-4ad4-bdb1-6ea8b3765d51 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:18.388792 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1695f74a-a1d0-4ad4-bdb1-6ea8b3765d51 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:18.389571 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1695f74a-a1d0-4ad4-bdb1-6ea8b3765d51 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:18.390040 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1695f74a-a1d0-4ad4-bdb1-6ea8b3765d51 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:18.521685 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1695f74a-a1d0-4ad4-bdb1-6ea8b3765d51 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:18.530115 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1695f74a-a1d0-4ad4-bdb1-6ea8b3765d51 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.152693 Mar 03 02:58:18.530701 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1495/3225] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:18 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:18.695217 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-351ed572-8420-42fb-8bb6-efe860bc5d08 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:18.695784 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-351ed572-8420-42fb-8bb6-efe860bc5d08 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:18.701973 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-351ed572-8420-42fb-8bb6-efe860bc5d08 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:18.702412 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-351ed572-8420-42fb-8bb6-efe860bc5d08 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:18.703196 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-351ed572-8420-42fb-8bb6-efe860bc5d08 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:18.703649 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-351ed572-8420-42fb-8bb6-efe860bc5d08 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:18.759409 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e302114e-8834-4a1a-8c3a-1ba05e6f3be6 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:18.760038 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e302114e-8834-4a1a-8c3a-1ba05e6f3be6 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:18.765863 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e302114e-8834-4a1a-8c3a-1ba05e6f3be6 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:18.766310 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e302114e-8834-4a1a-8c3a-1ba05e6f3be6 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:18.767085 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e302114e-8834-4a1a-8c3a-1ba05e6f3be6 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:18.767521 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e302114e-8834-4a1a-8c3a-1ba05e6f3be6 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:18.838630 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-351ed572-8420-42fb-8bb6-efe860bc5d08 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:18.846754 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-351ed572-8420-42fb-8bb6-efe860bc5d08 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.155283 Mar 03 02:58:18.847330 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1731/3226] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:18 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:18.851859 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ce20c1a8-79fd-4300-8672-05226627b534 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:18.852462 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ce20c1a8-79fd-4300-8672-05226627b534 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:18.860121 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ce20c1a8-79fd-4300-8672-05226627b534 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:18.860573 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ce20c1a8-79fd-4300-8672-05226627b534 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:18.861368 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ce20c1a8-79fd-4300-8672-05226627b534 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:18.861995 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ce20c1a8-79fd-4300-8672-05226627b534 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:18.901698 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e302114e-8834-4a1a-8c3a-1ba05e6f3be6 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:18.910585 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e302114e-8834-4a1a-8c3a-1ba05e6f3be6 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.154932 Mar 03 02:58:18.911160 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1496/3227] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:18 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:58:18.928055 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ce20c1a8-79fd-4300-8672-05226627b534 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:18.936557 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ce20c1a8-79fd-4300-8672-05226627b534 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.088195 Mar 03 02:58:18.937160 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1732/3228] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:18 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:19.547861 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6afb8384-f506-483a-b662-f092a1db5506 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:19.548485 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6afb8384-f506-483a-b662-f092a1db5506 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:19.554704 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6afb8384-f506-483a-b662-f092a1db5506 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:19.555154 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6afb8384-f506-483a-b662-f092a1db5506 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:19.555944 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6afb8384-f506-483a-b662-f092a1db5506 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:19.556376 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6afb8384-f506-483a-b662-f092a1db5506 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:19.690787 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-6afb8384-f506-483a-b662-f092a1db5506 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:19.698495 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6afb8384-f506-483a-b662-f092a1db5506 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.155228 Mar 03 02:58:19.699060 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1497/3229] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:19 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:19.864073 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-dcda3986-4baa-4fc8-9326-2dd954e2f33b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:19.864680 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-dcda3986-4baa-4fc8-9326-2dd954e2f33b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:19.870859 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dcda3986-4baa-4fc8-9326-2dd954e2f33b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:19.871347 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dcda3986-4baa-4fc8-9326-2dd954e2f33b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:19.872143 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dcda3986-4baa-4fc8-9326-2dd954e2f33b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:19.872579 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dcda3986-4baa-4fc8-9326-2dd954e2f33b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:19.928348 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-724ca852-2322-4ddc-b545-eedb475b37be tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:19.928969 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-724ca852-2322-4ddc-b545-eedb475b37be tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:19.934860 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-724ca852-2322-4ddc-b545-eedb475b37be tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:19.935342 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-724ca852-2322-4ddc-b545-eedb475b37be tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:19.936277 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-724ca852-2322-4ddc-b545-eedb475b37be tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:19.937289 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-724ca852-2322-4ddc-b545-eedb475b37be tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:20.005637 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-dcda3986-4baa-4fc8-9326-2dd954e2f33b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:20.014123 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-dcda3986-4baa-4fc8-9326-2dd954e2f33b tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.153836 Mar 03 02:58:20.014706 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1733/3230] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:19 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:20.019060 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-557c33a9-00a8-4466-888b-657b9f69b43c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:20.019788 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-557c33a9-00a8-4466-888b-657b9f69b43c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:20.025559 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-557c33a9-00a8-4466-888b-657b9f69b43c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:20.026010 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-557c33a9-00a8-4466-888b-657b9f69b43c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:20.026786 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-557c33a9-00a8-4466-888b-657b9f69b43c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:20.027222 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-557c33a9-00a8-4466-888b-657b9f69b43c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:20.073315 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-724ca852-2322-4ddc-b545-eedb475b37be tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:20.081514 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-724ca852-2322-4ddc-b545-eedb475b37be tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.157058 Mar 03 02:58:20.082284 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1498/3231] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:19 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:58:20.088284 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-557c33a9-00a8-4466-888b-657b9f69b43c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:20.096079 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-557c33a9-00a8-4466-888b-657b9f69b43c tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080447 Mar 03 02:58:20.096635 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1734/3232] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:20 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:20.715891 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-94bddf19-0671-4f4d-9594-e6d55ec6e0f3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:20.716506 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-94bddf19-0671-4f4d-9594-e6d55ec6e0f3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:20.722762 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-94bddf19-0671-4f4d-9594-e6d55ec6e0f3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:20.723238 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-94bddf19-0671-4f4d-9594-e6d55ec6e0f3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:20.724039 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-94bddf19-0671-4f4d-9594-e6d55ec6e0f3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:20.724480 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-94bddf19-0671-4f4d-9594-e6d55ec6e0f3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:20.860739 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-94bddf19-0671-4f4d-9594-e6d55ec6e0f3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:20.868454 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-94bddf19-0671-4f4d-9594-e6d55ec6e0f3 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.156934 Mar 03 02:58:20.869023 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1499/3233] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:20 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:21.030874 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-48647e72-bce4-4fc4-a9c8-cdd841a2331c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:21.031397 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-48647e72-bce4-4fc4-a9c8-cdd841a2331c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:21.037566 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-48647e72-bce4-4fc4-a9c8-cdd841a2331c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:21.038012 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-48647e72-bce4-4fc4-a9c8-cdd841a2331c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:21.038778 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-48647e72-bce4-4fc4-a9c8-cdd841a2331c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:21.039208 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-48647e72-bce4-4fc4-a9c8-cdd841a2331c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:21.098669 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f11b8ba4-ddc4-4699-9be6-ffeeafe382f7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:21.099293 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f11b8ba4-ddc4-4699-9be6-ffeeafe382f7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:21.105274 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f11b8ba4-ddc4-4699-9be6-ffeeafe382f7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:21.105779 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f11b8ba4-ddc4-4699-9be6-ffeeafe382f7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:21.106518 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f11b8ba4-ddc4-4699-9be6-ffeeafe382f7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:21.106946 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f11b8ba4-ddc4-4699-9be6-ffeeafe382f7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:21.176819 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-48647e72-bce4-4fc4-a9c8-cdd841a2331c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:21.185141 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-48647e72-bce4-4fc4-a9c8-cdd841a2331c tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.158803 Mar 03 02:58:21.185720 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1735/3234] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:21 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:21.190158 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7e0eef23-0733-4a8b-84e2-4c43525d1d67 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:21.190707 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7e0eef23-0733-4a8b-84e2-4c43525d1d67 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:21.196344 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7e0eef23-0733-4a8b-84e2-4c43525d1d67 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:21.196788 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7e0eef23-0733-4a8b-84e2-4c43525d1d67 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:21.197554 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7e0eef23-0733-4a8b-84e2-4c43525d1d67 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:21.197986 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7e0eef23-0733-4a8b-84e2-4c43525d1d67 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:21.243186 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f11b8ba4-ddc4-4699-9be6-ffeeafe382f7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:21.251755 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f11b8ba4-ddc4-4699-9be6-ffeeafe382f7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.156877 Mar 03 02:58:21.252610 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1500/3235] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:21 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:58:21.258217 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-7e0eef23-0733-4a8b-84e2-4c43525d1d67 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:21.266612 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7e0eef23-0733-4a8b-84e2-4c43525d1d67 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079937 Mar 03 02:58:21.267209 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1736/3236] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:21 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:21.886298 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-10b69bcc-dc6e-4c25-aa9d-cf1d0c956c0d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:21.887395 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-10b69bcc-dc6e-4c25-aa9d-cf1d0c956c0d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:21.893587 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-10b69bcc-dc6e-4c25-aa9d-cf1d0c956c0d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:21.894043 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-10b69bcc-dc6e-4c25-aa9d-cf1d0c956c0d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:21.894806 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-10b69bcc-dc6e-4c25-aa9d-cf1d0c956c0d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:21.895237 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-10b69bcc-dc6e-4c25-aa9d-cf1d0c956c0d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:22.029534 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-10b69bcc-dc6e-4c25-aa9d-cf1d0c956c0d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:22.037485 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-10b69bcc-dc6e-4c25-aa9d-cf1d0c956c0d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.155117 Mar 03 02:58:22.038061 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1501/3237] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:21 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:22.202681 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-19c29be7-95d6-4cd0-a81a-636e135d1a19 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:22.203209 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-19c29be7-95d6-4cd0-a81a-636e135d1a19 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:22.209377 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-19c29be7-95d6-4cd0-a81a-636e135d1a19 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:22.209825 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-19c29be7-95d6-4cd0-a81a-636e135d1a19 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:22.210588 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-19c29be7-95d6-4cd0-a81a-636e135d1a19 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:22.211020 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-19c29be7-95d6-4cd0-a81a-636e135d1a19 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:22.269095 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-454cdcb0-2af4-455a-bbd5-b266c5aef80a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:22.269702 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-454cdcb0-2af4-455a-bbd5-b266c5aef80a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:22.275321 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-454cdcb0-2af4-455a-bbd5-b266c5aef80a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:22.275805 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-454cdcb0-2af4-455a-bbd5-b266c5aef80a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:22.276580 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-454cdcb0-2af4-455a-bbd5-b266c5aef80a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:22.277016 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-454cdcb0-2af4-455a-bbd5-b266c5aef80a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:22.346362 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-19c29be7-95d6-4cd0-a81a-636e135d1a19 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:22.354094 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-19c29be7-95d6-4cd0-a81a-636e135d1a19 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.155852 Mar 03 02:58:22.354927 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1737/3238] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:22 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:22.363944 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2fe2ae7a-9318-401d-ade4-683bd8e10f7f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:22.364551 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2fe2ae7a-9318-401d-ade4-683bd8e10f7f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:22.370365 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2fe2ae7a-9318-401d-ade4-683bd8e10f7f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:22.370823 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2fe2ae7a-9318-401d-ade4-683bd8e10f7f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:22.372310 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2fe2ae7a-9318-401d-ade4-683bd8e10f7f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:22.372748 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2fe2ae7a-9318-401d-ade4-683bd8e10f7f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:22.409527 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-454cdcb0-2af4-455a-bbd5-b266c5aef80a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:22.417313 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-454cdcb0-2af4-455a-bbd5-b266c5aef80a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.152093 Mar 03 02:58:22.417891 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1502/3239] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:22 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:58:22.431924 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2fe2ae7a-9318-401d-ade4-683bd8e10f7f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:22.440824 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2fe2ae7a-9318-401d-ade4-683bd8e10f7f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.084974 Mar 03 02:58:22.441389 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1738/3240] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:22 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:23.054241 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-92386919-9e0a-4233-a90f-5e798ec0d61f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:23.054877 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-92386919-9e0a-4233-a90f-5e798ec0d61f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:23.061153 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-92386919-9e0a-4233-a90f-5e798ec0d61f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:23.061609 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-92386919-9e0a-4233-a90f-5e798ec0d61f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:23.062395 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-92386919-9e0a-4233-a90f-5e798ec0d61f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:23.062837 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-92386919-9e0a-4233-a90f-5e798ec0d61f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:23.193042 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-92386919-9e0a-4233-a90f-5e798ec0d61f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:23.201247 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-92386919-9e0a-4233-a90f-5e798ec0d61f tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.150890 Mar 03 02:58:23.201821 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1503/3241] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:23 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:23.372052 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-42ef4aa1-9fce-4198-837f-3eaeb7448613 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:23.372656 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-42ef4aa1-9fce-4198-837f-3eaeb7448613 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:23.378818 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-42ef4aa1-9fce-4198-837f-3eaeb7448613 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:23.379261 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-42ef4aa1-9fce-4198-837f-3eaeb7448613 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:23.380050 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-42ef4aa1-9fce-4198-837f-3eaeb7448613 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:23.380485 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-42ef4aa1-9fce-4198-837f-3eaeb7448613 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:23.434993 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-96dd806f-635a-4f57-a1e0-70d000d30943 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:23.435580 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-96dd806f-635a-4f57-a1e0-70d000d30943 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:23.441368 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-96dd806f-635a-4f57-a1e0-70d000d30943 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:23.441830 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-96dd806f-635a-4f57-a1e0-70d000d30943 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:23.442621 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-96dd806f-635a-4f57-a1e0-70d000d30943 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:23.443069 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-96dd806f-635a-4f57-a1e0-70d000d30943 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:23.512633 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-42ef4aa1-9fce-4198-837f-3eaeb7448613 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:23.520225 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-42ef4aa1-9fce-4198-837f-3eaeb7448613 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.152122 Mar 03 02:58:23.520794 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1739/3242] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:23 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:23.525351 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-965fcc77-12e2-4145-aefe-07a86cfa2597 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:23.525953 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-965fcc77-12e2-4145-aefe-07a86cfa2597 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:23.531555 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-965fcc77-12e2-4145-aefe-07a86cfa2597 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:23.532035 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-965fcc77-12e2-4145-aefe-07a86cfa2597 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:23.532811 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-965fcc77-12e2-4145-aefe-07a86cfa2597 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:23.533252 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-965fcc77-12e2-4145-aefe-07a86cfa2597 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:23.584169 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-96dd806f-635a-4f57-a1e0-70d000d30943 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:23.592428 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-965fcc77-12e2-4145-aefe-07a86cfa2597 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:23.592853 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-96dd806f-635a-4f57-a1e0-70d000d30943 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.162418 Mar 03 02:58:23.593430 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1504/3243] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:23 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:58:23.601870 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-965fcc77-12e2-4145-aefe-07a86cfa2597 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080034 Mar 03 02:58:23.602429 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1740/3244] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:23 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:24.218770 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4bba27d6-d9a0-47fb-8229-6ad30672d961 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:24.219372 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4bba27d6-d9a0-47fb-8229-6ad30672d961 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:24.225942 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4bba27d6-d9a0-47fb-8229-6ad30672d961 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:24.226389 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4bba27d6-d9a0-47fb-8229-6ad30672d961 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:24.227147 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4bba27d6-d9a0-47fb-8229-6ad30672d961 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:24.227580 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4bba27d6-d9a0-47fb-8229-6ad30672d961 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:24.359354 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4bba27d6-d9a0-47fb-8229-6ad30672d961 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:24.367108 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4bba27d6-d9a0-47fb-8229-6ad30672d961 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.152896 Mar 03 02:58:24.367696 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1505/3245] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:24 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:24.537606 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5dc31bc6-b8a8-4bc8-bda9-b63f81bb44b2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:24.538216 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5dc31bc6-b8a8-4bc8-bda9-b63f81bb44b2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:24.544632 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5dc31bc6-b8a8-4bc8-bda9-b63f81bb44b2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:24.545085 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5dc31bc6-b8a8-4bc8-bda9-b63f81bb44b2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:24.545858 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5dc31bc6-b8a8-4bc8-bda9-b63f81bb44b2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:24.546295 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5dc31bc6-b8a8-4bc8-bda9-b63f81bb44b2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:24.610207 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ca8876ad-222f-4318-95cb-0ea45ba3f27e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:24.610819 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ca8876ad-222f-4318-95cb-0ea45ba3f27e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:24.616789 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ca8876ad-222f-4318-95cb-0ea45ba3f27e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:24.617237 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ca8876ad-222f-4318-95cb-0ea45ba3f27e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:24.618015 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ca8876ad-222f-4318-95cb-0ea45ba3f27e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:24.618450 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ca8876ad-222f-4318-95cb-0ea45ba3f27e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:24.683562 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5dc31bc6-b8a8-4bc8-bda9-b63f81bb44b2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:24.691285 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5dc31bc6-b8a8-4bc8-bda9-b63f81bb44b2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.157579 Mar 03 02:58:24.691891 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1741/3246] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:24 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:24.696476 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-26aa9275-5ad5-44c8-8091-d3e051b11233 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:24.697081 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-26aa9275-5ad5-44c8-8091-d3e051b11233 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:24.703208 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-26aa9275-5ad5-44c8-8091-d3e051b11233 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:24.703689 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-26aa9275-5ad5-44c8-8091-d3e051b11233 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:24.704482 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-26aa9275-5ad5-44c8-8091-d3e051b11233 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:24.704928 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-26aa9275-5ad5-44c8-8091-d3e051b11233 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:24.753206 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ca8876ad-222f-4318-95cb-0ea45ba3f27e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:24.760929 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ca8876ad-222f-4318-95cb-0ea45ba3f27e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.154649 Mar 03 02:58:24.762643 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1506/3247] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:24 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:58:24.764796 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-26aa9275-5ad5-44c8-8091-d3e051b11233 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:24.772539 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-26aa9275-5ad5-44c8-8091-d3e051b11233 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079712 Mar 03 02:58:24.773125 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1742/3248] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:24 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:25.384217 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-99e36765-51f7-4cd7-bf73-7d419fac9107 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:25.384877 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-99e36765-51f7-4cd7-bf73-7d419fac9107 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:25.391350 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-99e36765-51f7-4cd7-bf73-7d419fac9107 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:25.391839 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-99e36765-51f7-4cd7-bf73-7d419fac9107 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:25.392608 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-99e36765-51f7-4cd7-bf73-7d419fac9107 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:25.393039 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-99e36765-51f7-4cd7-bf73-7d419fac9107 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:25.521494 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-99e36765-51f7-4cd7-bf73-7d419fac9107 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:25.529259 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-99e36765-51f7-4cd7-bf73-7d419fac9107 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.148944 Mar 03 02:58:25.529819 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1507/3249] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:25 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:25.708251 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-66bd4cd8-45e6-4c1f-be70-7cee41ddd021 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:25.708789 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-66bd4cd8-45e6-4c1f-be70-7cee41ddd021 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:25.715464 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-66bd4cd8-45e6-4c1f-be70-7cee41ddd021 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:25.715959 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-66bd4cd8-45e6-4c1f-be70-7cee41ddd021 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:25.716736 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-66bd4cd8-45e6-4c1f-be70-7cee41ddd021 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:25.717173 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-66bd4cd8-45e6-4c1f-be70-7cee41ddd021 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:25.778563 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-674283df-9304-4203-afd6-ee749d43aaa1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:25.779231 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-674283df-9304-4203-afd6-ee749d43aaa1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:25.785027 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-674283df-9304-4203-afd6-ee749d43aaa1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:25.785472 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-674283df-9304-4203-afd6-ee749d43aaa1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:25.786246 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-674283df-9304-4203-afd6-ee749d43aaa1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:25.786679 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-674283df-9304-4203-afd6-ee749d43aaa1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:25.850511 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-66bd4cd8-45e6-4c1f-be70-7cee41ddd021 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:25.858545 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-66bd4cd8-45e6-4c1f-be70-7cee41ddd021 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.154183 Mar 03 02:58:25.859120 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1743/3250] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:25 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:25.863670 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a7ef5139-9c97-4082-aa57-ebdf8164d717 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:25.864272 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a7ef5139-9c97-4082-aa57-ebdf8164d717 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:25.869985 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a7ef5139-9c97-4082-aa57-ebdf8164d717 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:25.870434 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a7ef5139-9c97-4082-aa57-ebdf8164d717 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:25.871822 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a7ef5139-9c97-4082-aa57-ebdf8164d717 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:25.872350 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a7ef5139-9c97-4082-aa57-ebdf8164d717 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:25.917949 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-674283df-9304-4203-afd6-ee749d43aaa1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:25.926040 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-674283df-9304-4203-afd6-ee749d43aaa1 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.151364 Mar 03 02:58:25.926604 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1508/3251] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:25 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:58:25.934224 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a7ef5139-9c97-4082-aa57-ebdf8164d717 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:25.941986 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a7ef5139-9c97-4082-aa57-ebdf8164d717 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.081866 Mar 03 02:58:25.942589 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1744/3252] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:25 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:26.546634 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3950a8d2-7a1d-418e-9a0f-307d0e98e542 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:26.547247 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3950a8d2-7a1d-418e-9a0f-307d0e98e542 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:26.553650 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3950a8d2-7a1d-418e-9a0f-307d0e98e542 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:26.554102 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3950a8d2-7a1d-418e-9a0f-307d0e98e542 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:26.554879 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3950a8d2-7a1d-418e-9a0f-307d0e98e542 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:26.555321 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3950a8d2-7a1d-418e-9a0f-307d0e98e542 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:26.688699 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3950a8d2-7a1d-418e-9a0f-307d0e98e542 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:26.696411 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3950a8d2-7a1d-418e-9a0f-307d0e98e542 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.154141 Mar 03 02:58:26.696983 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1509/3253] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:26 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:26.876085 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1305d9ab-7d90-4005-8e10-d378103f6994 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:26.876945 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1305d9ab-7d90-4005-8e10-d378103f6994 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:26.883081 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1305d9ab-7d90-4005-8e10-d378103f6994 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:26.883525 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1305d9ab-7d90-4005-8e10-d378103f6994 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:26.884321 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1305d9ab-7d90-4005-8e10-d378103f6994 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:26.884755 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1305d9ab-7d90-4005-8e10-d378103f6994 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:26.943820 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-febf2a8e-dc88-4fc7-b033-083e85de68b5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:26.944383 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-febf2a8e-dc88-4fc7-b033-083e85de68b5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:26.950033 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-febf2a8e-dc88-4fc7-b033-083e85de68b5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:26.950544 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-febf2a8e-dc88-4fc7-b033-083e85de68b5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:26.951334 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-febf2a8e-dc88-4fc7-b033-083e85de68b5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:26.951804 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-febf2a8e-dc88-4fc7-b033-083e85de68b5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:27.021385 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1305d9ab-7d90-4005-8e10-d378103f6994 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:27.029135 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1305d9ab-7d90-4005-8e10-d378103f6994 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.157734 Mar 03 02:58:27.029844 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1745/3254] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:26 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:27.034114 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-79910f4c-148a-4fa8-85b1-b31ced288dbd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:27.034738 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-79910f4c-148a-4fa8-85b1-b31ced288dbd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:27.040699 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-79910f4c-148a-4fa8-85b1-b31ced288dbd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:27.041147 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-79910f4c-148a-4fa8-85b1-b31ced288dbd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:27.041916 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-79910f4c-148a-4fa8-85b1-b31ced288dbd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:27.042344 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-79910f4c-148a-4fa8-85b1-b31ced288dbd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:27.089236 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-febf2a8e-dc88-4fc7-b033-083e85de68b5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:27.097007 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-febf2a8e-dc88-4fc7-b033-083e85de68b5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.157176 Mar 03 02:58:27.097575 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1510/3255] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:26 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:58:27.103135 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-79910f4c-148a-4fa8-85b1-b31ced288dbd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:27.111761 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-79910f4c-148a-4fa8-85b1-b31ced288dbd tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.081091 Mar 03 02:58:27.112316 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1746/3256] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:27 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:27.714127 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-134b2d56-de5e-4ea4-8a84-bf6437519e11 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:27.715421 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-134b2d56-de5e-4ea4-8a84-bf6437519e11 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:27.721771 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-134b2d56-de5e-4ea4-8a84-bf6437519e11 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:27.722227 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-134b2d56-de5e-4ea4-8a84-bf6437519e11 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:27.723005 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-134b2d56-de5e-4ea4-8a84-bf6437519e11 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:27.723443 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-134b2d56-de5e-4ea4-8a84-bf6437519e11 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:27.858131 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-134b2d56-de5e-4ea4-8a84-bf6437519e11 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:27.866130 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-134b2d56-de5e-4ea4-8a84-bf6437519e11 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.155839 Mar 03 02:58:27.866708 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1511/3257] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:27 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:28.046681 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-adb6a416-b39d-4d8b-a2fd-091a352dcbee tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:28.047285 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-adb6a416-b39d-4d8b-a2fd-091a352dcbee tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:28.053547 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-adb6a416-b39d-4d8b-a2fd-091a352dcbee tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:28.053999 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-adb6a416-b39d-4d8b-a2fd-091a352dcbee tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:28.054772 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-adb6a416-b39d-4d8b-a2fd-091a352dcbee tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:28.055207 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-adb6a416-b39d-4d8b-a2fd-091a352dcbee tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:28.114886 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-75a0354e-3615-424e-9ad5-dff645d17be5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:28.115491 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-75a0354e-3615-424e-9ad5-dff645d17be5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:28.121820 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-75a0354e-3615-424e-9ad5-dff645d17be5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:28.122376 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-75a0354e-3615-424e-9ad5-dff645d17be5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:28.123335 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-75a0354e-3615-424e-9ad5-dff645d17be5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:28.123597 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-75a0354e-3615-424e-9ad5-dff645d17be5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:28.189367 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-adb6a416-b39d-4d8b-a2fd-091a352dcbee tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:28.197179 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-adb6a416-b39d-4d8b-a2fd-091a352dcbee tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.154971 Mar 03 02:58:28.197838 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1747/3258] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:28 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:28.203140 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-27db580b-9fed-44a6-b490-980fe64e51d3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:28.204054 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-27db580b-9fed-44a6-b490-980fe64e51d3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:28.209630 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-27db580b-9fed-44a6-b490-980fe64e51d3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:28.210094 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-27db580b-9fed-44a6-b490-980fe64e51d3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:28.210874 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-27db580b-9fed-44a6-b490-980fe64e51d3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:28.211319 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-27db580b-9fed-44a6-b490-980fe64e51d3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:28.254995 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-75a0354e-3615-424e-9ad5-dff645d17be5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:28.262972 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-75a0354e-3615-424e-9ad5-dff645d17be5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.151877 Mar 03 02:58:28.263646 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1512/3259] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:28 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:58:28.270122 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-27db580b-9fed-44a6-b490-980fe64e51d3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:28.278040 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-27db580b-9fed-44a6-b490-980fe64e51d3 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079163 Mar 03 02:58:28.278608 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1748/3260] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:28 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:28.883401 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-13cd86fb-9bda-42ec-8e4c-20ba5cc25bd9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:28.884029 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-13cd86fb-9bda-42ec-8e4c-20ba5cc25bd9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:28.890317 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-13cd86fb-9bda-42ec-8e4c-20ba5cc25bd9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:28.890761 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-13cd86fb-9bda-42ec-8e4c-20ba5cc25bd9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:28.891531 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-13cd86fb-9bda-42ec-8e4c-20ba5cc25bd9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:28.891988 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-13cd86fb-9bda-42ec-8e4c-20ba5cc25bd9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:29.026422 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-13cd86fb-9bda-42ec-8e4c-20ba5cc25bd9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:29.034765 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-13cd86fb-9bda-42ec-8e4c-20ba5cc25bd9 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.155261 Mar 03 02:58:29.035325 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1513/3261] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:28 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:29.214357 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9dce3546-fbd2-44ed-a21b-2c8624eeda6a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:29.215484 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9dce3546-fbd2-44ed-a21b-2c8624eeda6a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:29.221804 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9dce3546-fbd2-44ed-a21b-2c8624eeda6a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:29.222252 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9dce3546-fbd2-44ed-a21b-2c8624eeda6a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:29.223018 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9dce3546-fbd2-44ed-a21b-2c8624eeda6a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:29.223450 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9dce3546-fbd2-44ed-a21b-2c8624eeda6a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:29.281100 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9d82c07d-55ca-41be-975e-911febdd74ca tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:29.281689 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9d82c07d-55ca-41be-975e-911febdd74ca tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:29.288074 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9d82c07d-55ca-41be-975e-911febdd74ca tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:29.288512 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9d82c07d-55ca-41be-975e-911febdd74ca tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:29.289444 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9d82c07d-55ca-41be-975e-911febdd74ca tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:29.289888 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9d82c07d-55ca-41be-975e-911febdd74ca tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:29.359272 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9dce3546-fbd2-44ed-a21b-2c8624eeda6a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:29.367280 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9dce3546-fbd2-44ed-a21b-2c8624eeda6a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.156807 Mar 03 02:58:29.367898 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1749/3262] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:29 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:29.373606 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-145e6e3e-3c62-47a4-8196-11596d051b48 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:29.374212 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-145e6e3e-3c62-47a4-8196-11596d051b48 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:29.379993 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-145e6e3e-3c62-47a4-8196-11596d051b48 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:29.380450 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-145e6e3e-3c62-47a4-8196-11596d051b48 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:29.381237 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-145e6e3e-3c62-47a4-8196-11596d051b48 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:29.381674 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-145e6e3e-3c62-47a4-8196-11596d051b48 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:29.427898 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9d82c07d-55ca-41be-975e-911febdd74ca tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:29.436005 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9d82c07d-55ca-41be-975e-911febdd74ca tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.158781 Mar 03 02:58:29.436584 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1514/3263] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:29 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:58:29.444702 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-145e6e3e-3c62-47a4-8196-11596d051b48 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:29.452649 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-145e6e3e-3c62-47a4-8196-11596d051b48 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.083820 Mar 03 02:58:29.453211 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1750/3264] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:29 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:30.051614 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1eeeeae4-d06a-44aa-970e-cd0df067abf7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:30.052595 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1eeeeae4-d06a-44aa-970e-cd0df067abf7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:30.058675 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1eeeeae4-d06a-44aa-970e-cd0df067abf7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:30.059266 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1eeeeae4-d06a-44aa-970e-cd0df067abf7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:30.060113 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1eeeeae4-d06a-44aa-970e-cd0df067abf7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:30.060551 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1eeeeae4-d06a-44aa-970e-cd0df067abf7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:30.188707 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1eeeeae4-d06a-44aa-970e-cd0df067abf7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:30.196361 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1eeeeae4-d06a-44aa-970e-cd0df067abf7 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.148642 Mar 03 02:58:30.196927 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1515/3265] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:30 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:30.384281 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-76d9ed1b-6b08-4855-88a3-a2142373f03a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:30.384893 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-76d9ed1b-6b08-4855-88a3-a2142373f03a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:30.391699 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-76d9ed1b-6b08-4855-88a3-a2142373f03a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:30.392149 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-76d9ed1b-6b08-4855-88a3-a2142373f03a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:30.392928 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-76d9ed1b-6b08-4855-88a3-a2142373f03a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:30.393364 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-76d9ed1b-6b08-4855-88a3-a2142373f03a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:30.453818 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-05f053f4-1680-4918-b1d3-9c6ceadde33f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:30.454426 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-05f053f4-1680-4918-b1d3-9c6ceadde33f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:30.460072 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-05f053f4-1680-4918-b1d3-9c6ceadde33f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:30.460541 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-05f053f4-1680-4918-b1d3-9c6ceadde33f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:30.461299 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-05f053f4-1680-4918-b1d3-9c6ceadde33f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:30.461734 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-05f053f4-1680-4918-b1d3-9c6ceadde33f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:30.523746 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-76d9ed1b-6b08-4855-88a3-a2142373f03a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:30.531663 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-76d9ed1b-6b08-4855-88a3-a2142373f03a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.151173 Mar 03 02:58:30.532334 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1751/3266] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:30 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:30.536812 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-850d8c78-a74e-41e1-8bbf-7b5dee2c0568 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:30.537515 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-850d8c78-a74e-41e1-8bbf-7b5dee2c0568 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:30.543731 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-850d8c78-a74e-41e1-8bbf-7b5dee2c0568 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:30.544192 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-850d8c78-a74e-41e1-8bbf-7b5dee2c0568 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:30.544978 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-850d8c78-a74e-41e1-8bbf-7b5dee2c0568 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:30.545421 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-850d8c78-a74e-41e1-8bbf-7b5dee2c0568 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:30.597208 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-05f053f4-1680-4918-b1d3-9c6ceadde33f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:30.604325 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-850d8c78-a74e-41e1-8bbf-7b5dee2c0568 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:30.605127 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-05f053f4-1680-4918-b1d3-9c6ceadde33f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.155904 Mar 03 02:58:30.606481 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1516/3267] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:30 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:58:30.612947 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-850d8c78-a74e-41e1-8bbf-7b5dee2c0568 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.079584 Mar 03 02:58:30.613501 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1752/3268] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:30 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:31.214615 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6e46ba3d-e637-4cd6-97ad-1a2781a9ac6d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:31.215676 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6e46ba3d-e637-4cd6-97ad-1a2781a9ac6d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:31.221937 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6e46ba3d-e637-4cd6-97ad-1a2781a9ac6d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:31.222389 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6e46ba3d-e637-4cd6-97ad-1a2781a9ac6d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:31.223166 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6e46ba3d-e637-4cd6-97ad-1a2781a9ac6d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:31.223626 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6e46ba3d-e637-4cd6-97ad-1a2781a9ac6d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:31.360790 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-6e46ba3d-e637-4cd6-97ad-1a2781a9ac6d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:31.368582 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6e46ba3d-e637-4cd6-97ad-1a2781a9ac6d tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.157973 Mar 03 02:58:31.369158 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1517/3269] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:31 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:31.549192 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2bdfda2d-d980-45d7-bda3-22279feeaa93 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:31.549799 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2bdfda2d-d980-45d7-bda3-22279feeaa93 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:31.556063 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2bdfda2d-d980-45d7-bda3-22279feeaa93 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:31.556455 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2bdfda2d-d980-45d7-bda3-22279feeaa93 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:31.557229 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2bdfda2d-d980-45d7-bda3-22279feeaa93 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:31.557666 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2bdfda2d-d980-45d7-bda3-22279feeaa93 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:31.623187 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-35ff6a96-7b6b-4712-8d58-f09100db4df5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:31.624086 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-35ff6a96-7b6b-4712-8d58-f09100db4df5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:31.631635 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-35ff6a96-7b6b-4712-8d58-f09100db4df5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:31.632298 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-35ff6a96-7b6b-4712-8d58-f09100db4df5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:31.633117 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-35ff6a96-7b6b-4712-8d58-f09100db4df5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:31.633580 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-35ff6a96-7b6b-4712-8d58-f09100db4df5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:31.692651 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2bdfda2d-d980-45d7-bda3-22279feeaa93 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:31.700319 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2bdfda2d-d980-45d7-bda3-22279feeaa93 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.155012 Mar 03 02:58:31.701090 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1753/3270] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:31 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:31.705387 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-cd08997e-f831-4be6-9b3b-1e6fc531c901 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:31.706019 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-cd08997e-f831-4be6-9b3b-1e6fc531c901 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:31.711555 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cd08997e-f831-4be6-9b3b-1e6fc531c901 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:31.712044 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cd08997e-f831-4be6-9b3b-1e6fc531c901 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:31.712822 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cd08997e-f831-4be6-9b3b-1e6fc531c901 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:31.713259 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cd08997e-f831-4be6-9b3b-1e6fc531c901 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:31.770871 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-35ff6a96-7b6b-4712-8d58-f09100db4df5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:31.772676 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-cd08997e-f831-4be6-9b3b-1e6fc531c901 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:31.779448 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-35ff6a96-7b6b-4712-8d58-f09100db4df5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.161090 Mar 03 02:58:31.780063 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1518/3271] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:31 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:58:31.785612 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-cd08997e-f831-4be6-9b3b-1e6fc531c901 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.083717 Mar 03 02:58:31.786195 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1754/3272] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:31 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:32.387100 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-792ee68b-a79e-40bc-93b3-426b4be55c79 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:32.387728 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-792ee68b-a79e-40bc-93b3-426b4be55c79 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:32.394085 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-792ee68b-a79e-40bc-93b3-426b4be55c79 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:32.394537 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-792ee68b-a79e-40bc-93b3-426b4be55c79 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:32.395325 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-792ee68b-a79e-40bc-93b3-426b4be55c79 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:32.395804 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-792ee68b-a79e-40bc-93b3-426b4be55c79 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:32.531308 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-792ee68b-a79e-40bc-93b3-426b4be55c79 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:32.539121 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-792ee68b-a79e-40bc-93b3-426b4be55c79 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.156395 Mar 03 02:58:32.539711 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1519/3273] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:32 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:32.717513 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-fcd7a721-dcbf-4310-b400-9dfa877400a7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:32.718070 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-fcd7a721-dcbf-4310-b400-9dfa877400a7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:32.724320 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fcd7a721-dcbf-4310-b400-9dfa877400a7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:32.724771 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fcd7a721-dcbf-4310-b400-9dfa877400a7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:32.725546 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fcd7a721-dcbf-4310-b400-9dfa877400a7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:32.725977 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fcd7a721-dcbf-4310-b400-9dfa877400a7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:32.797984 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-aa5e4a2c-cb1e-41a8-a5a5-65ff10c451a9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:32.798877 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-aa5e4a2c-cb1e-41a8-a5a5-65ff10c451a9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:32.805069 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aa5e4a2c-cb1e-41a8-a5a5-65ff10c451a9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:32.805533 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aa5e4a2c-cb1e-41a8-a5a5-65ff10c451a9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:32.806339 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aa5e4a2c-cb1e-41a8-a5a5-65ff10c451a9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:32.807020 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aa5e4a2c-cb1e-41a8-a5a5-65ff10c451a9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:32.858073 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-fcd7a721-dcbf-4310-b400-9dfa877400a7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:32.866197 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-fcd7a721-dcbf-4310-b400-9dfa877400a7 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.152858 Mar 03 02:58:32.866771 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1755/3274] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:32 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:32.872012 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-24423dd4-e38e-4f11-a7ee-b885fe1c5295 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:32.872622 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-24423dd4-e38e-4f11-a7ee-b885fe1c5295 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:32.878526 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-24423dd4-e38e-4f11-a7ee-b885fe1c5295 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:32.879008 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-24423dd4-e38e-4f11-a7ee-b885fe1c5295 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:32.879826 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-24423dd4-e38e-4f11-a7ee-b885fe1c5295 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:32.880399 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-24423dd4-e38e-4f11-a7ee-b885fe1c5295 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:32.940159 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-24423dd4-e38e-4f11-a7ee-b885fe1c5295 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:32.949896 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-aa5e4a2c-cb1e-41a8-a5a5-65ff10c451a9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:32.951941 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-24423dd4-e38e-4f11-a7ee-b885fe1c5295 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.084130 Mar 03 02:58:32.952525 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1756/3275] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:32 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:32.957925 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-aa5e4a2c-cb1e-41a8-a5a5-65ff10c451a9 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.164013 Mar 03 02:58:32.958486 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1520/3276] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:32 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:58:33.556195 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2602033d-be6d-4253-8435-bdbc2883b511 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:33.556803 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2602033d-be6d-4253-8435-bdbc2883b511 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:33.563330 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2602033d-be6d-4253-8435-bdbc2883b511 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:33.563817 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2602033d-be6d-4253-8435-bdbc2883b511 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:33.564598 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2602033d-be6d-4253-8435-bdbc2883b511 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:33.565034 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2602033d-be6d-4253-8435-bdbc2883b511 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:33.697603 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2602033d-be6d-4253-8435-bdbc2883b511 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:33.706049 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2602033d-be6d-4253-8435-bdbc2883b511 tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.153666 Mar 03 02:58:33.706659 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1757/3277] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:33 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:33.884150 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a28ffa81-5862-4ea6-bb31-b4dd5c65d35d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:33.884781 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a28ffa81-5862-4ea6-bb31-b4dd5c65d35d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:33.891723 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a28ffa81-5862-4ea6-bb31-b4dd5c65d35d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:33.892170 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a28ffa81-5862-4ea6-bb31-b4dd5c65d35d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:33.892939 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a28ffa81-5862-4ea6-bb31-b4dd5c65d35d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:33.893373 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a28ffa81-5862-4ea6-bb31-b4dd5c65d35d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:33.968613 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ba2e2e2c-45bc-46cd-894f-9ccaa81adfe7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:33.969201 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ba2e2e2c-45bc-46cd-894f-9ccaa81adfe7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 9e1ff924-aedc-41f0-84df-c1ba81e1a936] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:33.975484 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ba2e2e2c-45bc-46cd-894f-9ccaa81adfe7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:33.975971 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ba2e2e2c-45bc-46cd-894f-9ccaa81adfe7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:33.976742 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ba2e2e2c-45bc-46cd-894f-9ccaa81adfe7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:33.977175 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ba2e2e2c-45bc-46cd-894f-9ccaa81adfe7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:34.032138 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a28ffa81-5862-4ea6-bb31-b4dd5c65d35d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:34.036890 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ba2e2e2c-45bc-46cd-894f-9ccaa81adfe7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:34.040342 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a28ffa81-5862-4ea6-bb31-b4dd5c65d35d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.159911 Mar 03 02:58:34.045417 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1521/3278] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:33 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:34.045888 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ba2e2e2c-45bc-46cd-894f-9ccaa81adfe7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936" status: 200 len: 1348 microversion: 2.1 time: 0.080254 Mar 03 02:58:34.045888 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1758/3279] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:33 2022] GET /compute/v2.1/servers/9e1ff924-aedc-41f0-84df-c1ba81e1a936 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:58:34.046374 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d99c7290-0efb-4c91-8c13-ee5f4c46532c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:34.047062 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d99c7290-0efb-4c91-8c13-ee5f4c46532c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:34.052983 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d99c7290-0efb-4c91-8c13-ee5f4c46532c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:34.053732 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d99c7290-0efb-4c91-8c13-ee5f4c46532c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:34.054227 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d99c7290-0efb-4c91-8c13-ee5f4c46532c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:34.054668 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d99c7290-0efb-4c91-8c13-ee5f4c46532c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:34.185904 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d99c7290-0efb-4c91-8c13-ee5f4c46532c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:34.193570 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d99c7290-0efb-4c91-8c13-ee5f4c46532c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.151271 Mar 03 02:58:34.194184 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1522/3280] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:34 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:34.723429 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-dff46994-8ae2-4bfb-8575-56377ec281db tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:34.724059 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-dff46994-8ae2-4bfb-8575-56377ec281db tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:34.730812 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dff46994-8ae2-4bfb-8575-56377ec281db tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:34.731265 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dff46994-8ae2-4bfb-8575-56377ec281db tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:34.732073 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dff46994-8ae2-4bfb-8575-56377ec281db tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:34.732596 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dff46994-8ae2-4bfb-8575-56377ec281db tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:34.862837 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-dff46994-8ae2-4bfb-8575-56377ec281db tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:34.870466 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-dff46994-8ae2-4bfb-8575-56377ec281db tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.150896 Mar 03 02:58:34.872038 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1759/3281] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:34 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:35.057119 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3fd0db8a-f508-4d5d-afbb-6e0f2250013d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:35.057729 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3fd0db8a-f508-4d5d-afbb-6e0f2250013d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:35.065092 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3fd0db8a-f508-4d5d-afbb-6e0f2250013d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:35.065543 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3fd0db8a-f508-4d5d-afbb-6e0f2250013d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:35.066318 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3fd0db8a-f508-4d5d-afbb-6e0f2250013d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:35.066754 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3fd0db8a-f508-4d5d-afbb-6e0f2250013d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:35.202128 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3fd0db8a-f508-4d5d-afbb-6e0f2250013d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:35.211763 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-33815b39-5fcf-4088-bed7-84c60e24bb61 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:35.212380 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-33815b39-5fcf-4088-bed7-84c60e24bb61 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:35.216405 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3fd0db8a-f508-4d5d-afbb-6e0f2250013d tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.162910 Mar 03 02:58:35.218702 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1523/3282] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:35 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:35.218874 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-33815b39-5fcf-4088-bed7-84c60e24bb61 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:35.219148 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-33815b39-5fcf-4088-bed7-84c60e24bb61 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:35.220165 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-33815b39-5fcf-4088-bed7-84c60e24bb61 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:35.220809 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-33815b39-5fcf-4088-bed7-84c60e24bb61 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:35.350723 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-33815b39-5fcf-4088-bed7-84c60e24bb61 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:35.359373 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-33815b39-5fcf-4088-bed7-84c60e24bb61 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.151723 Mar 03 02:58:35.359972 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1760/3283] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:35 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:58:35.888367 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-efd437c2-81d9-4bf0-ae3a-0245361d95cd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:35.888903 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-efd437c2-81d9-4bf0-ae3a-0245361d95cd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [instance: 0df5e3af-dfd2-431d-83af-1a2a02019651] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:35.895028 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-efd437c2-81d9-4bf0-ae3a-0245361d95cd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:35.895479 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-efd437c2-81d9-4bf0-ae3a-0245361d95cd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:35.896294 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-efd437c2-81d9-4bf0-ae3a-0245361d95cd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:35.896727 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-efd437c2-81d9-4bf0-ae3a-0245361d95cd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:36.026031 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-efd437c2-81d9-4bf0-ae3a-0245361d95cd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69fd047c3a1545a1a4b71d198eb20d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed6875428804fbaa1f9fb16ed63a4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:36.034385 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-efd437c2-81d9-4bf0-ae3a-0245361d95cd tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651" status: 200 len: 1601 microversion: 2.1 time: 0.150510 Mar 03 02:58:36.034951 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1524/3284] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:35 2022] GET /compute/v2.1/servers/0df5e3af-dfd2-431d-83af-1a2a02019651 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:36.050280 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-01d43a91-445d-436d-a2e1-a90ac02deb8c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] Calling method '.version_select at 0x7fb3c8068dc0>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:36.053546 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: ERROR oslo.messaging._drivers.impl_rabbit [None req-01d43a91-445d-436d-a2e1-a90ac02deb8c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [4c8461a9-8430-4dd9-9d5f-c2f5c365128e] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 03 02:58:36.234372 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9c3fc65a-844b-4e94-8cab-3e376d6a25c9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:36.235101 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9c3fc65a-844b-4e94-8cab-3e376d6a25c9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 26ff8756-bd0b-464a-9c28-75b4ee57f99d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:36.241206 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9c3fc65a-844b-4e94-8cab-3e376d6a25c9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:36.241652 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9c3fc65a-844b-4e94-8cab-3e376d6a25c9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:36.242423 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9c3fc65a-844b-4e94-8cab-3e376d6a25c9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:36.242856 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9c3fc65a-844b-4e94-8cab-3e376d6a25c9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:36.383455 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9c3fc65a-844b-4e94-8cab-3e376d6a25c9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:36.395321 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9c3fc65a-844b-4e94-8cab-3e376d6a25c9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d" status: 200 len: 1559 microversion: 2.1 time: 0.164541 Mar 03 02:58:36.396614 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1525/3285] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:36 2022] GET /compute/v2.1/servers/26ff8756-bd0b-464a-9c28-75b4ee57f99d => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:58:36.403241 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c57f3b17-a35a-4b94-844b-53ecc3866f66 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:36.404007 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c57f3b17-a35a-4b94-844b-53ecc3866f66 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:36.410684 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c57f3b17-a35a-4b94-844b-53ecc3866f66 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:36.411133 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c57f3b17-a35a-4b94-844b-53ecc3866f66 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:36.414700 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c57f3b17-a35a-4b94-844b-53ecc3866f66 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:36.415172 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c57f3b17-a35a-4b94-844b-53ecc3866f66 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:36.446316 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c57f3b17-a35a-4b94-844b-53ecc3866f66 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Going to try to terminate instance {{(pid=116859) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 03 02:58:36.554144 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c57f3b17-a35a-4b94-844b-53ecc3866f66 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 204 len: 0 microversion: 2.1 time: 0.155831 Mar 03 02:58:36.554779 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1526/3286] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Mar 3 02:58:36 2022] DELETE /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 03 02:58:36.560832 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f8518f75-70da-4c40-929c-5adc91217269 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:36.561704 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f8518f75-70da-4c40-929c-5adc91217269 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:36.568740 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f8518f75-70da-4c40-929c-5adc91217269 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:36.569195 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f8518f75-70da-4c40-929c-5adc91217269 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:36.570014 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f8518f75-70da-4c40-929c-5adc91217269 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:36.570455 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f8518f75-70da-4c40-929c-5adc91217269 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:36.705359 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f8518f75-70da-4c40-929c-5adc91217269 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:36.713185 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f8518f75-70da-4c40-929c-5adc91217269 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.157314 Mar 03 02:58:36.713745 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1527/3287] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:36 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:36.718325 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2da701b6-fe66-462b-9100-cd67b04af280 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:36.718943 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2da701b6-fe66-462b-9100-cd67b04af280 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:36.724701 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2da701b6-fe66-462b-9100-cd67b04af280 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:36.725162 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2da701b6-fe66-462b-9100-cd67b04af280 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:36.725972 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2da701b6-fe66-462b-9100-cd67b04af280 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:36.726413 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2da701b6-fe66-462b-9100-cd67b04af280 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:36.859088 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2da701b6-fe66-462b-9100-cd67b04af280 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:36.866212 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2da701b6-fe66-462b-9100-cd67b04af280 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1507 microversion: 2.1 time: 0.151549 Mar 03 02:58:36.866771 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1528/3288] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:36 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:37.059864 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO oslo.messaging._drivers.impl_rabbit [None req-01d43a91-445d-436d-a2e1-a90ac02deb8c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] [4c8461a9-8430-4dd9-9d5f-c2f5c365128e] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 56502. Mar 03 02:58:37.078088 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-01d43a91-445d-436d-a2e1-a90ac02deb8c tempest-TestMinimumBasicScenario-1758246481 tempest-TestMinimumBasicScenario-1758246481-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2084008363" status: 202 len: 0 microversion: 2.1 time: 1.031608 Mar 03 02:58:37.078694 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1761/3289] 10.222.0.30 () {58 vars in 1271 bytes} [Thu Mar 3 02:58:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2084008363 => generated 0 bytes in 1033 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 03 02:58:37.674364 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [req-eb44e60d-cceb-412a-810b-7300ce6bc548 req-b04e307a-1f71-4678-8fb1-93edfdf05e37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d34e2006-f63a-4cb6-99d2-47d791fbefcf", "name": "network-vif-deleted", "tag": "276ceb62-db32-4f9d-86c8-a5060ec08dd1"}]} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:58:37.689354 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-eb44e60d-cceb-412a-810b-7300ce6bc548 req-b04e307a-1f71-4678-8fb1-93edfdf05e37 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:37.689799 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-eb44e60d-cceb-412a-810b-7300ce6bc548 req-b04e307a-1f71-4678-8fb1-93edfdf05e37 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:37.706736 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.compute.server_external_events [req-eb44e60d-cceb-412a-810b-7300ce6bc548 req-b04e307a-1f71-4678-8fb1-93edfdf05e37 service nova] Creating event network-vif-deleted:276ceb62-db32-4f9d-86c8-a5060ec08dd1 for instance d34e2006-f63a-4cb6-99d2-47d791fbefcf on hv-cinder-81977 Mar 03 02:58:37.712183 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [req-eb44e60d-cceb-412a-810b-7300ce6bc548 req-b04e307a-1f71-4678-8fb1-93edfdf05e37 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110887 Mar 03 02:58:37.713237 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1529/3290] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:58:37.732596 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e8e1c50f-9f9b-4dc9-a8e7-3a1d451f2791 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:37.732952 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e8e1c50f-9f9b-4dc9-a8e7-3a1d451f2791 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:37.740196 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e8e1c50f-9f9b-4dc9-a8e7-3a1d451f2791 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:37.740651 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e8e1c50f-9f9b-4dc9-a8e7-3a1d451f2791 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:37.741477 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e8e1c50f-9f9b-4dc9-a8e7-3a1d451f2791 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:37.741872 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e8e1c50f-9f9b-4dc9-a8e7-3a1d451f2791 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:37.884911 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-87f88d1e-c14f-482b-847d-78857b3c935b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:37.885995 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-87f88d1e-c14f-482b-847d-78857b3c935b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:37.893210 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-87f88d1e-c14f-482b-847d-78857b3c935b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:37.893747 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-87f88d1e-c14f-482b-847d-78857b3c935b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:37.894068 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e8e1c50f-9f9b-4dc9-a8e7-3a1d451f2791 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:37.894710 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-87f88d1e-c14f-482b-847d-78857b3c935b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:37.895244 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-87f88d1e-c14f-482b-847d-78857b3c935b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:37.903898 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e8e1c50f-9f9b-4dc9-a8e7-3a1d451f2791 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.177310 Mar 03 02:58:37.904726 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1762/3291] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:37 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:37.927132 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-87f88d1e-c14f-482b-847d-78857b3c935b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:37.927569 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-87f88d1e-c14f-482b-847d-78857b3c935b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:37.928045 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.objects.instance [None req-87f88d1e-c14f-482b-847d-78857b3c935b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lazy-loading 'fault' on Instance uuid d34e2006-f63a-4cb6-99d2-47d791fbefcf {{(pid=116859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 03 02:58:38.002203 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-87f88d1e-c14f-482b-847d-78857b3c935b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:38.012054 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-87f88d1e-c14f-482b-847d-78857b3c935b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 200 len: 1312 microversion: 2.1 time: 0.130654 Mar 03 02:58:38.012756 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1530/3292] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:37 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 1312 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:58:38.921969 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0d2d94f6-63bb-4111-b0ae-11bed742bc1f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:38.922663 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0d2d94f6-63bb-4111-b0ae-11bed742bc1f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:38.929110 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0d2d94f6-63bb-4111-b0ae-11bed742bc1f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:38.929568 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0d2d94f6-63bb-4111-b0ae-11bed742bc1f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:38.930588 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0d2d94f6-63bb-4111-b0ae-11bed742bc1f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:38.931032 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0d2d94f6-63bb-4111-b0ae-11bed742bc1f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:39.029315 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-cd06af19-e424-4d3a-95b4-9d67cb0e8f46 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:39.030234 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-cd06af19-e424-4d3a-95b4-9d67cb0e8f46 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: d34e2006-f63a-4cb6-99d2-47d791fbefcf] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:39.036431 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cd06af19-e424-4d3a-95b4-9d67cb0e8f46 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:39.037136 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cd06af19-e424-4d3a-95b4-9d67cb0e8f46 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:39.037920 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cd06af19-e424-4d3a-95b4-9d67cb0e8f46 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:39.038531 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cd06af19-e424-4d3a-95b4-9d67cb0e8f46 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:39.052601 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.wsgi [None req-cd06af19-e424-4d3a-95b4-9d67cb0e8f46 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] HTTP exception thrown: Instance d34e2006-f63a-4cb6-99d2-47d791fbefcf could not be found. Mar 03 02:58:39.054282 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-cd06af19-e424-4d3a-95b4-9d67cb0e8f46 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Returning 404 to user: Instance d34e2006-f63a-4cb6-99d2-47d791fbefcf could not be found. {{(pid=116859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 02:58:39.055134 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-cd06af19-e424-4d3a-95b4-9d67cb0e8f46 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf" status: 404 len: 111 microversion: 2.1 time: 0.030409 Mar 03 02:58:39.059439 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1531/3293] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:39 2022] GET /compute/v2.1/servers/d34e2006-f63a-4cb6-99d2-47d791fbefcf => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 03 02:58:39.064536 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2b830d2f-29d0-46d6-832f-378d25562bfb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:39.064980 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2b830d2f-29d0-46d6-832f-378d25562bfb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:39.070648 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2b830d2f-29d0-46d6-832f-378d25562bfb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:39.071108 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2b830d2f-29d0-46d6-832f-378d25562bfb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:39.071937 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2b830d2f-29d0-46d6-832f-378d25562bfb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:39.072382 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2b830d2f-29d0-46d6-832f-378d25562bfb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:39.084054 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0d2d94f6-63bb-4111-b0ae-11bed742bc1f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:39.094092 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0d2d94f6-63bb-4111-b0ae-11bed742bc1f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.176623 Mar 03 02:58:39.095329 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1763/3294] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:38 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:39.100158 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2b830d2f-29d0-46d6-832f-378d25562bfb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Going to try to terminate instance {{(pid=116859) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 03 02:58:39.186462 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2b830d2f-29d0-46d6-832f-378d25562bfb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 204 len: 0 microversion: 2.1 time: 0.125413 Mar 03 02:58:39.187218 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1532/3295] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Mar 3 02:58:39 2022] DELETE /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 03 02:58:39.195886 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-af427271-b623-415d-815f-428efddeeddb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:39.196591 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-af427271-b623-415d-815f-428efddeeddb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:39.204133 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-af427271-b623-415d-815f-428efddeeddb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:39.204619 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-af427271-b623-415d-815f-428efddeeddb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:39.205434 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-af427271-b623-415d-815f-428efddeeddb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:39.205877 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-af427271-b623-415d-815f-428efddeeddb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:39.353339 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-af427271-b623-415d-815f-428efddeeddb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:39.361787 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-af427271-b623-415d-815f-428efddeeddb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1566 microversion: 2.1 time: 0.170199 Mar 03 02:58:39.362375 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1764/3296] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:39 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:40.113810 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-90710582-f6e3-41a4-a838-ffee64a95960 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:40.114507 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-90710582-f6e3-41a4-a838-ffee64a95960 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:40.124905 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-90710582-f6e3-41a4-a838-ffee64a95960 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:40.134847 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-90710582-f6e3-41a4-a838-ffee64a95960 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:40.135897 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-90710582-f6e3-41a4-a838-ffee64a95960 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:40.137713 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-90710582-f6e3-41a4-a838-ffee64a95960 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:40.380430 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-81cbed82-0c98-4df3-96b5-7a470853fe13 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:40.381739 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-81cbed82-0c98-4df3-96b5-7a470853fe13 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:40.389605 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-81cbed82-0c98-4df3-96b5-7a470853fe13 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:40.390058 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-81cbed82-0c98-4df3-96b5-7a470853fe13 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:40.391077 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-81cbed82-0c98-4df3-96b5-7a470853fe13 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:40.391516 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-81cbed82-0c98-4df3-96b5-7a470853fe13 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:40.455496 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-90710582-f6e3-41a4-a838-ffee64a95960 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:40.466067 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-90710582-f6e3-41a4-a838-ffee64a95960 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.357813 Mar 03 02:58:40.466842 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1533/3297] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:40 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:40.661697 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [req-849a8336-a287-44a0-a52d-f9f130d8079a req-7228903a-86cb-41c2-8330-f1acbc6d8af8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b9116d7-0099-4dfe-b678-192ce74500eb", "name": "network-vif-deleted", "tag": "b914fbeb-7aa5-47c8-9b2c-7bd96a54163e"}]} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:58:40.673430 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-81cbed82-0c98-4df3-96b5-7a470853fe13 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:40.687254 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-849a8336-a287-44a0-a52d-f9f130d8079a req-7228903a-86cb-41c2-8330-f1acbc6d8af8 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:40.688153 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-81cbed82-0c98-4df3-96b5-7a470853fe13 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1566 microversion: 2.1 time: 0.311282 Mar 03 02:58:40.688964 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1765/3298] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:40 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1566 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:58:40.691797 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-849a8336-a287-44a0-a52d-f9f130d8079a req-7228903a-86cb-41c2-8330-f1acbc6d8af8 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:40.704393 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.compute.server_external_events [req-849a8336-a287-44a0-a52d-f9f130d8079a req-7228903a-86cb-41c2-8330-f1acbc6d8af8 service nova] Creating event network-vif-deleted:b914fbeb-7aa5-47c8-9b2c-7bd96a54163e for instance 0b9116d7-0099-4dfe-b678-192ce74500eb on hv-cinder-81977 Mar 03 02:58:40.713856 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [req-849a8336-a287-44a0-a52d-f9f130d8079a req-7228903a-86cb-41c2-8330-f1acbc6d8af8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056009 Mar 03 02:58:40.714503 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1534/3299] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:58:41.483829 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5d2fd392-a4c1-4721-9cc7-a130bfa9006c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:41.485443 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5d2fd392-a4c1-4721-9cc7-a130bfa9006c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:41.491743 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5d2fd392-a4c1-4721-9cc7-a130bfa9006c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:41.492198 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5d2fd392-a4c1-4721-9cc7-a130bfa9006c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:41.492975 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5d2fd392-a4c1-4721-9cc7-a130bfa9006c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:41.493413 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5d2fd392-a4c1-4721-9cc7-a130bfa9006c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:41.622160 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5d2fd392-a4c1-4721-9cc7-a130bfa9006c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:41.629908 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5d2fd392-a4c1-4721-9cc7-a130bfa9006c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.150300 Mar 03 02:58:41.630467 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1766/3300] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:41 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:41.708348 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-73ee72a8-a629-4255-8566-b3581a719c62 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:41.709036 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-73ee72a8-a629-4255-8566-b3581a719c62 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:41.715800 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-73ee72a8-a629-4255-8566-b3581a719c62 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:41.716249 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-73ee72a8-a629-4255-8566-b3581a719c62 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:41.717015 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-73ee72a8-a629-4255-8566-b3581a719c62 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:41.717446 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-73ee72a8-a629-4255-8566-b3581a719c62 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:41.778430 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-73ee72a8-a629-4255-8566-b3581a719c62 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:41.786009 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-73ee72a8-a629-4255-8566-b3581a719c62 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.082275 Mar 03 02:58:41.786570 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1535/3301] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:41 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:42.647087 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-274c9906-1e3a-48a8-90bb-412eafb383d7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:42.647758 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-274c9906-1e3a-48a8-90bb-412eafb383d7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:42.654582 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-274c9906-1e3a-48a8-90bb-412eafb383d7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:42.655035 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-274c9906-1e3a-48a8-90bb-412eafb383d7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:42.655851 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-274c9906-1e3a-48a8-90bb-412eafb383d7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:42.656294 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-274c9906-1e3a-48a8-90bb-412eafb383d7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:42.786424 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-274c9906-1e3a-48a8-90bb-412eafb383d7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:42.794691 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-274c9906-1e3a-48a8-90bb-412eafb383d7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.151561 Mar 03 02:58:42.795263 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1767/3302] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:42 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:42.802696 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-fa91c029-2c4a-48a7-86ed-aa690c8f054c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:42.803311 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-fa91c029-2c4a-48a7-86ed-aa690c8f054c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:42.809630 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fa91c029-2c4a-48a7-86ed-aa690c8f054c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:42.810086 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fa91c029-2c4a-48a7-86ed-aa690c8f054c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:42.810868 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fa91c029-2c4a-48a7-86ed-aa690c8f054c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:42.811308 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fa91c029-2c4a-48a7-86ed-aa690c8f054c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:42.869732 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-fa91c029-2c4a-48a7-86ed-aa690c8f054c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:42.877731 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-fa91c029-2c4a-48a7-86ed-aa690c8f054c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078947 Mar 03 02:58:42.878410 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1536/3303] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:42 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:43.812271 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-52c28f3a-b984-416f-b577-4b17435ab6e0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:43.812877 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-52c28f3a-b984-416f-b577-4b17435ab6e0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:43.819089 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-52c28f3a-b984-416f-b577-4b17435ab6e0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:43.819536 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-52c28f3a-b984-416f-b577-4b17435ab6e0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:43.820344 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-52c28f3a-b984-416f-b577-4b17435ab6e0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:43.820783 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-52c28f3a-b984-416f-b577-4b17435ab6e0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:43.896345 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f8dc2dae-16bb-41de-81d1-3cbd455767ee tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:43.896953 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f8dc2dae-16bb-41de-81d1-3cbd455767ee tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:43.903893 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f8dc2dae-16bb-41de-81d1-3cbd455767ee tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:43.904353 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f8dc2dae-16bb-41de-81d1-3cbd455767ee tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:43.905147 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f8dc2dae-16bb-41de-81d1-3cbd455767ee tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:43.905583 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f8dc2dae-16bb-41de-81d1-3cbd455767ee tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:43.956130 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-52c28f3a-b984-416f-b577-4b17435ab6e0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:43.965682 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-52c28f3a-b984-416f-b577-4b17435ab6e0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.156506 Mar 03 02:58:43.966123 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1768/3304] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:43 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:43.967724 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f8dc2dae-16bb-41de-81d1-3cbd455767ee tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:43.975482 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f8dc2dae-16bb-41de-81d1-3cbd455767ee tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.083055 Mar 03 02:58:43.976069 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1537/3305] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:43 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:44.982970 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-42fbff45-401d-414f-991a-5c82d9ab6831 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:44.983531 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-42fbff45-401d-414f-991a-5c82d9ab6831 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:44.989727 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-42fbff45-401d-414f-991a-5c82d9ab6831 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:44.990169 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-42fbff45-401d-414f-991a-5c82d9ab6831 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:44.990943 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-42fbff45-401d-414f-991a-5c82d9ab6831 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:44.991391 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-42fbff45-401d-414f-991a-5c82d9ab6831 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:44.992548 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b6a28238-58bb-4488-9489-acc807c5e829 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:44.993161 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b6a28238-58bb-4488-9489-acc807c5e829 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:45.000187 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b6a28238-58bb-4488-9489-acc807c5e829 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:45.000640 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b6a28238-58bb-4488-9489-acc807c5e829 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:45.001429 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b6a28238-58bb-4488-9489-acc807c5e829 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:45.001870 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b6a28238-58bb-4488-9489-acc807c5e829 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:45.068925 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b6a28238-58bb-4488-9489-acc807c5e829 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:45.077061 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b6a28238-58bb-4488-9489-acc807c5e829 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.088303 Mar 03 02:58:45.077636 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1538/3306] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:44 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:58:45.129466 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-42fbff45-401d-414f-991a-5c82d9ab6831 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:45.137829 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-42fbff45-401d-414f-991a-5c82d9ab6831 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.159057 Mar 03 02:58:45.138391 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1769/3307] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:44 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:46.094246 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-84780dc3-6526-46d2-882b-0ad6eba03a64 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:46.094858 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-84780dc3-6526-46d2-882b-0ad6eba03a64 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:46.101055 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-84780dc3-6526-46d2-882b-0ad6eba03a64 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:46.101508 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-84780dc3-6526-46d2-882b-0ad6eba03a64 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:46.102283 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-84780dc3-6526-46d2-882b-0ad6eba03a64 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:46.102722 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-84780dc3-6526-46d2-882b-0ad6eba03a64 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:46.155523 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-36c8feca-8dff-4688-b03d-35570993b156 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:46.156195 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-36c8feca-8dff-4688-b03d-35570993b156 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:46.161960 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-84780dc3-6526-46d2-882b-0ad6eba03a64 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:46.162758 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-36c8feca-8dff-4688-b03d-35570993b156 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:46.163218 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-36c8feca-8dff-4688-b03d-35570993b156 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:46.164035 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-36c8feca-8dff-4688-b03d-35570993b156 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:46.164484 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-36c8feca-8dff-4688-b03d-35570993b156 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:46.172434 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-84780dc3-6526-46d2-882b-0ad6eba03a64 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.081997 Mar 03 02:58:46.173009 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1539/3308] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:46 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:46.293885 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-36c8feca-8dff-4688-b03d-35570993b156 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:46.301522 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-36c8feca-8dff-4688-b03d-35570993b156 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.150518 Mar 03 02:58:46.302018 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1770/3309] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:46 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:58:47.189266 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-95b770d8-ca38-4096-b93c-90655c628551 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:47.189873 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-95b770d8-ca38-4096-b93c-90655c628551 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:47.196107 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-95b770d8-ca38-4096-b93c-90655c628551 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:47.196594 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-95b770d8-ca38-4096-b93c-90655c628551 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:47.197371 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-95b770d8-ca38-4096-b93c-90655c628551 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:47.197813 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-95b770d8-ca38-4096-b93c-90655c628551 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:47.256873 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-95b770d8-ca38-4096-b93c-90655c628551 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:47.265237 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-95b770d8-ca38-4096-b93c-90655c628551 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079832 Mar 03 02:58:47.265791 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1540/3310] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:47 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:47.318591 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6a7c71f6-341d-4803-b5a3-787eabeebbf7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:47.319130 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6a7c71f6-341d-4803-b5a3-787eabeebbf7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:47.326257 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6a7c71f6-341d-4803-b5a3-787eabeebbf7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:47.326731 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6a7c71f6-341d-4803-b5a3-787eabeebbf7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:47.327502 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6a7c71f6-341d-4803-b5a3-787eabeebbf7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:47.327961 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6a7c71f6-341d-4803-b5a3-787eabeebbf7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:47.459470 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6a7c71f6-341d-4803-b5a3-787eabeebbf7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:47.467778 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6a7c71f6-341d-4803-b5a3-787eabeebbf7 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.153041 Mar 03 02:58:47.468344 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1771/3311] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:47 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:48.282838 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-663c318c-c1d1-493f-8f77-3a6ac9f16e19 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:48.283451 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-663c318c-c1d1-493f-8f77-3a6ac9f16e19 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:48.289678 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-663c318c-c1d1-493f-8f77-3a6ac9f16e19 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:48.290147 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-663c318c-c1d1-493f-8f77-3a6ac9f16e19 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:48.290924 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-663c318c-c1d1-493f-8f77-3a6ac9f16e19 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:48.291369 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-663c318c-c1d1-493f-8f77-3a6ac9f16e19 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:48.349476 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-663c318c-c1d1-493f-8f77-3a6ac9f16e19 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:48.358228 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-663c318c-c1d1-493f-8f77-3a6ac9f16e19 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079233 Mar 03 02:58:48.358788 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1541/3312] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:48 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:48.485337 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-cf7568d2-e21c-4565-badc-40f41e464b5c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:48.485969 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-cf7568d2-e21c-4565-badc-40f41e464b5c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:48.492180 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cf7568d2-e21c-4565-badc-40f41e464b5c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:48.492635 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cf7568d2-e21c-4565-badc-40f41e464b5c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:48.493415 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cf7568d2-e21c-4565-badc-40f41e464b5c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:48.493859 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cf7568d2-e21c-4565-badc-40f41e464b5c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:48.621879 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-cf7568d2-e21c-4565-badc-40f41e464b5c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:48.629521 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-cf7568d2-e21c-4565-badc-40f41e464b5c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.147997 Mar 03 02:58:48.630075 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1772/3313] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:48 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:49.374877 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2b8446a7-21d5-4912-810c-d5e97b233d73 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:49.375490 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2b8446a7-21d5-4912-810c-d5e97b233d73 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:49.381732 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2b8446a7-21d5-4912-810c-d5e97b233d73 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:49.382184 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2b8446a7-21d5-4912-810c-d5e97b233d73 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:49.382959 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2b8446a7-21d5-4912-810c-d5e97b233d73 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:49.383395 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2b8446a7-21d5-4912-810c-d5e97b233d73 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:49.441158 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2b8446a7-21d5-4912-810c-d5e97b233d73 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:49.449579 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2b8446a7-21d5-4912-810c-d5e97b233d73 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.077730 Mar 03 02:58:49.450147 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1542/3314] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:49 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:49.647135 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-32187031-5545-4d8c-9247-a0c0477d3d44 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:49.647707 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-32187031-5545-4d8c-9247-a0c0477d3d44 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:49.654536 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-32187031-5545-4d8c-9247-a0c0477d3d44 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:49.654983 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-32187031-5545-4d8c-9247-a0c0477d3d44 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:49.655781 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-32187031-5545-4d8c-9247-a0c0477d3d44 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:49.656215 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-32187031-5545-4d8c-9247-a0c0477d3d44 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:49.788218 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-32187031-5545-4d8c-9247-a0c0477d3d44 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:49.795994 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-32187031-5545-4d8c-9247-a0c0477d3d44 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.152723 Mar 03 02:58:49.796560 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1773/3315] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:49 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:50.466279 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-06db3fb9-bf03-4fb6-acc7-8481e528de18 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:50.466923 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-06db3fb9-bf03-4fb6-acc7-8481e528de18 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:50.473175 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-06db3fb9-bf03-4fb6-acc7-8481e528de18 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:50.473630 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-06db3fb9-bf03-4fb6-acc7-8481e528de18 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:50.474413 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-06db3fb9-bf03-4fb6-acc7-8481e528de18 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:50.474856 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-06db3fb9-bf03-4fb6-acc7-8481e528de18 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:50.534060 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-06db3fb9-bf03-4fb6-acc7-8481e528de18 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:50.541751 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-06db3fb9-bf03-4fb6-acc7-8481e528de18 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079377 Mar 03 02:58:50.542322 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1543/3316] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:50 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:50.813843 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-90bdcaf9-0f65-48d2-b567-0d82969d449c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:50.814446 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-90bdcaf9-0f65-48d2-b567-0d82969d449c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:50.820669 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-90bdcaf9-0f65-48d2-b567-0d82969d449c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:50.821113 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-90bdcaf9-0f65-48d2-b567-0d82969d449c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:50.821895 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-90bdcaf9-0f65-48d2-b567-0d82969d449c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:50.822336 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-90bdcaf9-0f65-48d2-b567-0d82969d449c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:50.963955 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-90bdcaf9-0f65-48d2-b567-0d82969d449c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:50.972163 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-90bdcaf9-0f65-48d2-b567-0d82969d449c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 200 len: 1716 microversion: 2.1 time: 0.162234 Mar 03 02:58:50.972751 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1774/3317] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:50 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 1716 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:50.990037 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4b508211-1650-4d18-86f9-226dbf40da44 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '.version_select at 0x7fb3c2f09b80>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:51.011265 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4b508211-1650-4d18-86f9-226dbf40da44 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-504147627" status: 202 len: 0 microversion: 2.1 time: 0.024993 Mar 03 02:58:51.011884 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1544/3318] 10.222.0.30 () {58 vars in 1217 bytes} [Thu Mar 3 02:58:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-504147627 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 03 02:58:51.558291 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1cb46e3a-d793-42cd-9b23-47be0dfc2d66 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:51.559069 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1cb46e3a-d793-42cd-9b23-47be0dfc2d66 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:51.564828 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1cb46e3a-d793-42cd-9b23-47be0dfc2d66 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:51.565272 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1cb46e3a-d793-42cd-9b23-47be0dfc2d66 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:51.566048 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1cb46e3a-d793-42cd-9b23-47be0dfc2d66 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:51.566481 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1cb46e3a-d793-42cd-9b23-47be0dfc2d66 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:51.645191 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1cb46e3a-d793-42cd-9b23-47be0dfc2d66 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:51.654116 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1cb46e3a-d793-42cd-9b23-47be0dfc2d66 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.099719 Mar 03 02:58:51.654703 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1775/3319] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:51 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:51.955310 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [req-b45e7556-732b-4ca2-afcc-737cd520626e req-4de57da1-8362-4a9e-8be1-9575d9e93123 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df03ab77-ba2a-4603-b517-8e7b435882f2", "tag": "efc411a0-4951-463f-9b9e-b0b169a4a793"}]} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:58:51.963942 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-b45e7556-732b-4ca2-afcc-737cd520626e req-4de57da1-8362-4a9e-8be1-9575d9e93123 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:51.964804 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-b45e7556-732b-4ca2-afcc-737cd520626e req-4de57da1-8362-4a9e-8be1-9575d9e93123 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:51.974980 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.compute.server_external_events [req-b45e7556-732b-4ca2-afcc-737cd520626e req-4de57da1-8362-4a9e-8be1-9575d9e93123 service nova] Creating event network-changed:efc411a0-4951-463f-9b9e-b0b169a4a793 for instance df03ab77-ba2a-4603-b517-8e7b435882f2 on hv-cinder-81977 Mar 03 02:58:51.980747 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [req-b45e7556-732b-4ca2-afcc-737cd520626e req-4de57da1-8362-4a9e-8be1-9575d9e93123 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029063 Mar 03 02:58:51.981359 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1545/3320] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:58:52.161681 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-faca6a47-8313-4ede-82d6-bb3207ce309e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Action: 'create', calling method: .version_select at 0x7fb3c80eb670>, body: {"keypair": {"name": "tempest-keypair-1603100855"}} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:58:52.177445 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.quota [None req-faca6a47-8313-4ede-82d6-bb3207ce309e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Getting quotas for project 204a19c418b44e9fa1c46a1fd0a0294b. Resources: {'key_pairs'} {{(pid=116858) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 03 02:58:52.182379 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.quota [None req-faca6a47-8313-4ede-82d6-bb3207ce309e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Getting quotas for user 211640f2c9e54914a33b7cf26ebf4a51 and project 204a19c418b44e9fa1c46a1fd0a0294b. Resources: {'key_pairs'} {{(pid=116858) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 03 02:58:52.312638 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.quota [None req-faca6a47-8313-4ede-82d6-bb3207ce309e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Getting quotas for project 204a19c418b44e9fa1c46a1fd0a0294b. Resources: {'key_pairs'} {{(pid=116858) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 03 02:58:52.316287 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.quota [None req-faca6a47-8313-4ede-82d6-bb3207ce309e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Getting quotas for user 211640f2c9e54914a33b7cf26ebf4a51 and project 204a19c418b44e9fa1c46a1fd0a0294b. Resources: {'key_pairs'} {{(pid=116858) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 03 02:58:52.329193 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-faca6a47-8313-4ede-82d6-bb3207ce309e tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.172621 Mar 03 02:58:52.329976 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1776/3321] 10.222.0.30 () {60 vars in 1157 bytes} [Thu Mar 3 02:58:52 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:58:52.671475 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-184a0061-6bf3-440b-a532-258e12a9c85b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:52.672495 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-184a0061-6bf3-440b-a532-258e12a9c85b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:52.678445 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-184a0061-6bf3-440b-a532-258e12a9c85b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:52.678899 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-184a0061-6bf3-440b-a532-258e12a9c85b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:52.679717 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-184a0061-6bf3-440b-a532-258e12a9c85b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:52.680155 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-184a0061-6bf3-440b-a532-258e12a9c85b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:52.758650 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-184a0061-6bf3-440b-a532-258e12a9c85b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:52.767824 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-184a0061-6bf3-440b-a532-258e12a9c85b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.100878 Mar 03 02:58:52.769963 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1546/3322] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:52 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:53.603226 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-60dbe31d-ba89-4149-9554-c58bc9284d9a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-246919723", "imageRef": "1fe11a1a-b4d0-46f5-89cd-501ceff49317", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9c930170-270e-4188-a4ea-bd425f18a7f8"}], "security_groups": [{"name": "tempest-securitygroup--429019511"}], "key_name": "tempest-keypair-1603100855", "user_data": "}} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:58:53.703469 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.network.neutron [None req-60dbe31d-ba89-4149-9554-c58bc9284d9a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] validate_networks() for [('9c930170-270e-4188-a4ea-bd425f18a7f8', None, None, None, None, None)] {{(pid=116858) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 03 02:58:53.785671 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-36eda73a-e6ce-437b-8834-e67428209692 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:53.786297 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-36eda73a-e6ce-437b-8834-e67428209692 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:53.792930 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-36eda73a-e6ce-437b-8834-e67428209692 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:53.793473 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-36eda73a-e6ce-437b-8834-e67428209692 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:53.794254 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-36eda73a-e6ce-437b-8834-e67428209692 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:53.794687 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-36eda73a-e6ce-437b-8834-e67428209692 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:53.856055 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-36eda73a-e6ce-437b-8834-e67428209692 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:53.864475 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-36eda73a-e6ce-437b-8834-e67428209692 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.082644 Mar 03 02:58:53.865042 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1547/3323] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:53 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:58:54.118726 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-60dbe31d-ba89-4149-9554-c58bc9284d9a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Flavor limits 0:0:0 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 03 02:58:54.119152 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-60dbe31d-ba89-4149-9554-c58bc9284d9a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Image limits 0:0:0 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 03 02:58:54.119641 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-60dbe31d-ba89-4149-9554-c58bc9284d9a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Flavor pref 0:0:0 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 03 02:58:54.120051 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-60dbe31d-ba89-4149-9554-c58bc9284d9a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Image pref 0:0:0 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 03 02:58:54.120897 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-60dbe31d-ba89-4149-9554-c58bc9284d9a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 03 02:58:54.128953 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-60dbe31d-ba89-4149-9554-c58bc9284d9a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:54.129404 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-60dbe31d-ba89-4149-9554-c58bc9284d9a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:54.130209 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-60dbe31d-ba89-4149-9554-c58bc9284d9a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:54.130647 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-60dbe31d-ba89-4149-9554-c58bc9284d9a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:54.147492 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.quota [None req-60dbe31d-ba89-4149-9554-c58bc9284d9a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Getting quotas for project 204a19c418b44e9fa1c46a1fd0a0294b. Resources: {'instances', 'ram', 'cores'} {{(pid=116858) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 03 02:58:54.151419 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.quota [None req-60dbe31d-ba89-4149-9554-c58bc9284d9a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Getting quotas for user 211640f2c9e54914a33b7cf26ebf4a51 and project 204a19c418b44e9fa1c46a1fd0a0294b. Resources: {'instances', 'ram', 'cores'} {{(pid=116858) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 03 02:58:54.163242 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-60dbe31d-ba89-4149-9554-c58bc9284d9a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Going to run 1 instances... {{(pid=116858) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 03 02:58:54.165527 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-60dbe31d-ba89-4149-9554-c58bc9284d9a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: 9a54383b-d874-4fb8-8c4d-e19c004d8d04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1fe11a1a-b4d0-46f5-89cd-501ceff49317',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116858) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 03 02:58:54.210243 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: ERROR oslo.messaging._drivers.impl_rabbit [None req-60dbe31d-ba89-4149-9554-c58bc9284d9a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [f9d2df22-8c48-46a2-9e04-76a6a8c11aa2] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 03 02:58:54.881262 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-24f4da22-9e53-41d4-a4b1-da2d4175a1bb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:54.881856 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-24f4da22-9e53-41d4-a4b1-da2d4175a1bb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:54.888703 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-24f4da22-9e53-41d4-a4b1-da2d4175a1bb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:54.889150 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-24f4da22-9e53-41d4-a4b1-da2d4175a1bb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:54.889917 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-24f4da22-9e53-41d4-a4b1-da2d4175a1bb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:54.890349 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-24f4da22-9e53-41d4-a4b1-da2d4175a1bb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:54.950001 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-24f4da22-9e53-41d4-a4b1-da2d4175a1bb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:54.957696 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-24f4da22-9e53-41d4-a4b1-da2d4175a1bb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080255 Mar 03 02:58:54.958300 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1548/3324] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:54 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:58:55.219858 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO oslo.messaging._drivers.impl_rabbit [None req-60dbe31d-ba89-4149-9554-c58bc9284d9a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [f9d2df22-8c48-46a2-9e04-76a6a8c11aa2] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 56668. Mar 03 02:58:55.224499 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-60dbe31d-ba89-4149-9554-c58bc9284d9a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.626021 Mar 03 02:58:55.225149 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1777/3325] 10.222.0.30 () {60 vars in 1146 bytes} [Thu Mar 3 02:58:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 1627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 03 02:58:55.236729 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2469d95a-277e-40a4-9b36-9e03b9e57ae3 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:55.237430 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2469d95a-277e-40a4-9b36-9e03b9e57ae3 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: 9a54383b-d874-4fb8-8c4d-e19c004d8d04] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:55.289231 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2469d95a-277e-40a4-9b36-9e03b9e57ae3 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:55.296001 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2469d95a-277e-40a4-9b36-9e03b9e57ae3 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04" status: 200 len: 1237 microversion: 2.1 time: 0.063177 Mar 03 02:58:55.296575 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1549/3326] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:55 2022] GET /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04 => generated 1237 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:55.974715 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6e638cd5-b3fd-4896-b27e-5c79199d4c31 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:55.975314 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6e638cd5-b3fd-4896-b27e-5c79199d4c31 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:55.982922 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6e638cd5-b3fd-4896-b27e-5c79199d4c31 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:55.983369 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6e638cd5-b3fd-4896-b27e-5c79199d4c31 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:55.984176 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6e638cd5-b3fd-4896-b27e-5c79199d4c31 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:55.984611 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6e638cd5-b3fd-4896-b27e-5c79199d4c31 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:56.042995 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6e638cd5-b3fd-4896-b27e-5c79199d4c31 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:56.050934 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6e638cd5-b3fd-4896-b27e-5c79199d4c31 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080318 Mar 03 02:58:56.051643 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1778/3327] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:55 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:56.312710 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-dab9e24c-6627-4d06-9fb4-33e9734f6604 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:56.313311 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-dab9e24c-6627-4d06-9fb4-33e9734f6604 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: 9a54383b-d874-4fb8-8c4d-e19c004d8d04] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:56.368233 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-dab9e24c-6627-4d06-9fb4-33e9734f6604 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:56.375308 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-dab9e24c-6627-4d06-9fb4-33e9734f6604 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04" status: 200 len: 1237 microversion: 2.1 time: 0.066421 Mar 03 02:58:56.375898 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1550/3328] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:56 2022] GET /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04 => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:57.067208 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-67595ab2-5f22-4b71-823b-c8ec44ec00da tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:57.067842 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-67595ab2-5f22-4b71-823b-c8ec44ec00da tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:57.074242 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-67595ab2-5f22-4b71-823b-c8ec44ec00da tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:57.074691 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-67595ab2-5f22-4b71-823b-c8ec44ec00da tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:57.075465 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-67595ab2-5f22-4b71-823b-c8ec44ec00da tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:57.075940 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-67595ab2-5f22-4b71-823b-c8ec44ec00da tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:57.134500 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-67595ab2-5f22-4b71-823b-c8ec44ec00da tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:57.142384 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-67595ab2-5f22-4b71-823b-c8ec44ec00da tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079037 Mar 03 02:58:57.142954 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1779/3329] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:57 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:57.391970 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-204a7197-171d-46da-ab83-0f7ebc457b80 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:57.392654 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-204a7197-171d-46da-ab83-0f7ebc457b80 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: 9a54383b-d874-4fb8-8c4d-e19c004d8d04] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:57.452249 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-204a7197-171d-46da-ab83-0f7ebc457b80 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:57.458835 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-204a7197-171d-46da-ab83-0f7ebc457b80 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04" status: 200 len: 1237 microversion: 2.1 time: 0.070766 Mar 03 02:58:57.459399 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1551/3330] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:57 2022] GET /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04 => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:58.159245 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5df4b4b6-f107-41f1-b21d-9d908a6aae8a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:58.159874 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5df4b4b6-f107-41f1-b21d-9d908a6aae8a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:58.166076 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5df4b4b6-f107-41f1-b21d-9d908a6aae8a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:58.166523 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5df4b4b6-f107-41f1-b21d-9d908a6aae8a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:58.167999 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5df4b4b6-f107-41f1-b21d-9d908a6aae8a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:58.168479 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5df4b4b6-f107-41f1-b21d-9d908a6aae8a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:58.225100 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5df4b4b6-f107-41f1-b21d-9d908a6aae8a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:58.233822 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5df4b4b6-f107-41f1-b21d-9d908a6aae8a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078399 Mar 03 02:58:58.234382 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1780/3331] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:58 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:58.476182 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ef0feb75-6e0a-4a2c-ae13-df5fb53511ab tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:58.476788 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ef0feb75-6e0a-4a2c-ae13-df5fb53511ab tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: 9a54383b-d874-4fb8-8c4d-e19c004d8d04] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:58.532398 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ef0feb75-6e0a-4a2c-ae13-df5fb53511ab tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:58.539017 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ef0feb75-6e0a-4a2c-ae13-df5fb53511ab tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04" status: 200 len: 1237 microversion: 2.1 time: 0.066622 Mar 03 02:58:58.539797 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1552/3332] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:58 2022] GET /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04 => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:59.251040 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9bd05bf5-9b61-4dcd-97e3-b99658c25d35 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:59.251666 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9bd05bf5-9b61-4dcd-97e3-b99658c25d35 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:59.257835 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9bd05bf5-9b61-4dcd-97e3-b99658c25d35 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:59.258284 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9bd05bf5-9b61-4dcd-97e3-b99658c25d35 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:59.259054 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9bd05bf5-9b61-4dcd-97e3-b99658c25d35 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:59.259516 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9bd05bf5-9b61-4dcd-97e3-b99658c25d35 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:59.321190 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9bd05bf5-9b61-4dcd-97e3-b99658c25d35 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:59.328914 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9bd05bf5-9b61-4dcd-97e3-b99658c25d35 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.081787 Mar 03 02:58:59.329478 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1781/3333] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:59 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:58:59.555462 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-92bfb62c-d42c-42c2-b92c-36c3bb0a909f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:58:59.556108 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-92bfb62c-d42c-42c2-b92c-36c3bb0a909f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: 9a54383b-d874-4fb8-8c4d-e19c004d8d04] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:58:59.562423 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-92bfb62c-d42c-42c2-b92c-36c3bb0a909f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:59.562877 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-92bfb62c-d42c-42c2-b92c-36c3bb0a909f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:59.563667 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-92bfb62c-d42c-42c2-b92c-36c3bb0a909f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:58:59.564105 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-92bfb62c-d42c-42c2-b92c-36c3bb0a909f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:58:59.629688 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-92bfb62c-d42c-42c2-b92c-36c3bb0a909f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:58:59.637148 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-92bfb62c-d42c-42c2-b92c-36c3bb0a909f tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04" status: 200 len: 1241 microversion: 2.1 time: 0.085432 Mar 03 02:58:59.637878 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1553/3334] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:58:59 2022] GET /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04 => generated 1241 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:00.346348 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6c2bcad0-d876-4e7e-9358-33a5a0e6a2be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:00.346960 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6c2bcad0-d876-4e7e-9358-33a5a0e6a2be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:00.353779 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6c2bcad0-d876-4e7e-9358-33a5a0e6a2be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:00.354532 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6c2bcad0-d876-4e7e-9358-33a5a0e6a2be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:00.356004 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6c2bcad0-d876-4e7e-9358-33a5a0e6a2be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:00.356666 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6c2bcad0-d876-4e7e-9358-33a5a0e6a2be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:00.440395 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6c2bcad0-d876-4e7e-9358-33a5a0e6a2be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:00.452011 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6c2bcad0-d876-4e7e-9358-33a5a0e6a2be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.109553 Mar 03 02:59:00.452603 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1782/3335] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:00 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:00.653380 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-00509818-bcce-4d38-a4fe-e94ee17f9aba tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:00.654601 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-00509818-bcce-4d38-a4fe-e94ee17f9aba tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: 9a54383b-d874-4fb8-8c4d-e19c004d8d04] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:00.660978 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-00509818-bcce-4d38-a4fe-e94ee17f9aba tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:00.661440 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-00509818-bcce-4d38-a4fe-e94ee17f9aba tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:00.662231 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-00509818-bcce-4d38-a4fe-e94ee17f9aba tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:00.662663 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-00509818-bcce-4d38-a4fe-e94ee17f9aba tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:00.764713 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-00509818-bcce-4d38-a4fe-e94ee17f9aba tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:00.774943 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-00509818-bcce-4d38-a4fe-e94ee17f9aba tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04" status: 200 len: 1295 microversion: 2.1 time: 0.125362 Mar 03 02:59:00.775929 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1554/3336] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:00 2022] GET /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04 => generated 1295 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:01.471107 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-714767f5-6543-425f-9bfe-0511969a61a5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:01.471847 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-714767f5-6543-425f-9bfe-0511969a61a5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:01.477996 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-714767f5-6543-425f-9bfe-0511969a61a5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:01.478396 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-714767f5-6543-425f-9bfe-0511969a61a5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:01.479439 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-714767f5-6543-425f-9bfe-0511969a61a5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:01.480548 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-714767f5-6543-425f-9bfe-0511969a61a5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:01.510214 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [req-4efecb22-c609-4b26-96ff-c1337ab67ce4 req-f061905c-b2cd-47c2-b58f-253ed5076adc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a54383b-d874-4fb8-8c4d-e19c004d8d04", "tag": "9d5e352d-f477-4613-ae47-22be2e1ca382"}]} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:59:01.525077 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-4efecb22-c609-4b26-96ff-c1337ab67ce4 req-f061905c-b2cd-47c2-b58f-253ed5076adc service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:01.525540 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-4efecb22-c609-4b26-96ff-c1337ab67ce4 req-f061905c-b2cd-47c2-b58f-253ed5076adc service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:01.538607 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.compute.server_external_events [req-4efecb22-c609-4b26-96ff-c1337ab67ce4 req-f061905c-b2cd-47c2-b58f-253ed5076adc service nova] Creating event network-changed:9d5e352d-f477-4613-ae47-22be2e1ca382 for instance 9a54383b-d874-4fb8-8c4d-e19c004d8d04 on hv-cinder-81977 Mar 03 02:59:01.548098 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [req-4efecb22-c609-4b26-96ff-c1337ab67ce4 req-f061905c-b2cd-47c2-b58f-253ed5076adc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041438 Mar 03 02:59:01.548634 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1555/3337] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:59:01.564751 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-714767f5-6543-425f-9bfe-0511969a61a5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:01.574317 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-714767f5-6543-425f-9bfe-0511969a61a5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.108054 Mar 03 02:59:01.574841 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1783/3338] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:01 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:01.794066 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-76350666-f5b5-41a8-a9a9-392ac8909265 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:01.794758 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-76350666-f5b5-41a8-a9a9-392ac8909265 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: 9a54383b-d874-4fb8-8c4d-e19c004d8d04] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:01.801115 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-76350666-f5b5-41a8-a9a9-392ac8909265 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:01.801570 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-76350666-f5b5-41a8-a9a9-392ac8909265 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:01.802399 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-76350666-f5b5-41a8-a9a9-392ac8909265 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:01.802838 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-76350666-f5b5-41a8-a9a9-392ac8909265 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:01.942068 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-76350666-f5b5-41a8-a9a9-392ac8909265 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:01.950759 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-76350666-f5b5-41a8-a9a9-392ac8909265 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04" status: 200 len: 1362 microversion: 2.1 time: 0.161240 Mar 03 02:59:01.951329 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1556/3339] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:01 2022] GET /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:02.590273 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4da7995f-40ac-4753-b6d0-9735cb3d8a1e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:02.590894 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4da7995f-40ac-4753-b6d0-9735cb3d8a1e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:02.597010 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4da7995f-40ac-4753-b6d0-9735cb3d8a1e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:02.597458 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4da7995f-40ac-4753-b6d0-9735cb3d8a1e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:02.598230 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4da7995f-40ac-4753-b6d0-9735cb3d8a1e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:02.598663 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4da7995f-40ac-4753-b6d0-9735cb3d8a1e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:02.688943 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4da7995f-40ac-4753-b6d0-9735cb3d8a1e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:02.697014 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4da7995f-40ac-4753-b6d0-9735cb3d8a1e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.110647 Mar 03 02:59:02.697729 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1784/3340] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:02 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:02.966747 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-aa742731-ce25-45a4-8e58-362d39a8d1fe tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:02.967385 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-aa742731-ce25-45a4-8e58-362d39a8d1fe tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: 9a54383b-d874-4fb8-8c4d-e19c004d8d04] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:02.973572 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aa742731-ce25-45a4-8e58-362d39a8d1fe tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:02.974060 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aa742731-ce25-45a4-8e58-362d39a8d1fe tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:02.974844 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aa742731-ce25-45a4-8e58-362d39a8d1fe tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:02.975283 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aa742731-ce25-45a4-8e58-362d39a8d1fe tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:03.106688 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-aa742731-ce25-45a4-8e58-362d39a8d1fe tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:03.113847 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-aa742731-ce25-45a4-8e58-362d39a8d1fe tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04" status: 200 len: 1362 microversion: 2.1 time: 0.151072 Mar 03 02:59:03.114416 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1557/3341] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:02 2022] GET /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:03.714720 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a77d530a-a0f4-4f7f-8dbc-36ddaa87ce02 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:03.715342 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a77d530a-a0f4-4f7f-8dbc-36ddaa87ce02 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:03.721523 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a77d530a-a0f4-4f7f-8dbc-36ddaa87ce02 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:03.721971 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a77d530a-a0f4-4f7f-8dbc-36ddaa87ce02 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:03.723073 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a77d530a-a0f4-4f7f-8dbc-36ddaa87ce02 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:03.723511 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a77d530a-a0f4-4f7f-8dbc-36ddaa87ce02 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:03.784062 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a77d530a-a0f4-4f7f-8dbc-36ddaa87ce02 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:03.792147 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a77d530a-a0f4-4f7f-8dbc-36ddaa87ce02 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.081492 Mar 03 02:59:03.792678 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1785/3342] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:03 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:04.131327 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4112edb2-973e-457b-a49a-82b4298920aa tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:04.132062 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4112edb2-973e-457b-a49a-82b4298920aa tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: 9a54383b-d874-4fb8-8c4d-e19c004d8d04] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:04.139209 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4112edb2-973e-457b-a49a-82b4298920aa tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:04.139788 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4112edb2-973e-457b-a49a-82b4298920aa tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:04.140572 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4112edb2-973e-457b-a49a-82b4298920aa tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:04.141008 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4112edb2-973e-457b-a49a-82b4298920aa tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:04.275844 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4112edb2-973e-457b-a49a-82b4298920aa tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:04.283448 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4112edb2-973e-457b-a49a-82b4298920aa tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04" status: 200 len: 1362 microversion: 2.1 time: 0.155844 Mar 03 02:59:04.284045 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1558/3343] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:04 2022] GET /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:04.808399 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-fd3aabd2-abbe-42c9-ac7e-469b0ef777a6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:04.809010 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-fd3aabd2-abbe-42c9-ac7e-469b0ef777a6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:04.815243 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fd3aabd2-abbe-42c9-ac7e-469b0ef777a6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:04.815728 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fd3aabd2-abbe-42c9-ac7e-469b0ef777a6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:04.816509 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fd3aabd2-abbe-42c9-ac7e-469b0ef777a6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:04.816981 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fd3aabd2-abbe-42c9-ac7e-469b0ef777a6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:04.877136 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-fd3aabd2-abbe-42c9-ac7e-469b0ef777a6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:04.884796 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-fd3aabd2-abbe-42c9-ac7e-469b0ef777a6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080307 Mar 03 02:59:04.885364 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1786/3344] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:04 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:05.300967 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7c1398e0-d40c-40fc-a485-e773137ec2aa tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:05.301605 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7c1398e0-d40c-40fc-a485-e773137ec2aa tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: 9a54383b-d874-4fb8-8c4d-e19c004d8d04] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:05.308368 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7c1398e0-d40c-40fc-a485-e773137ec2aa tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:05.308971 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7c1398e0-d40c-40fc-a485-e773137ec2aa tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:05.309856 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7c1398e0-d40c-40fc-a485-e773137ec2aa tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:05.310296 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7c1398e0-d40c-40fc-a485-e773137ec2aa tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:05.444953 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-7c1398e0-d40c-40fc-a485-e773137ec2aa tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:05.452354 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7c1398e0-d40c-40fc-a485-e773137ec2aa tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04" status: 200 len: 1362 microversion: 2.1 time: 0.155294 Mar 03 02:59:05.452926 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1559/3345] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:05 2022] GET /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:05.902099 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-bdd7218f-46d9-45dc-8d3c-97b9f4014925 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:05.902901 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-bdd7218f-46d9-45dc-8d3c-97b9f4014925 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:05.908861 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bdd7218f-46d9-45dc-8d3c-97b9f4014925 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:05.909310 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bdd7218f-46d9-45dc-8d3c-97b9f4014925 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:05.910084 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bdd7218f-46d9-45dc-8d3c-97b9f4014925 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:05.910525 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bdd7218f-46d9-45dc-8d3c-97b9f4014925 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:05.968622 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-bdd7218f-46d9-45dc-8d3c-97b9f4014925 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:05.976409 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-bdd7218f-46d9-45dc-8d3c-97b9f4014925 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078730 Mar 03 02:59:05.976978 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1787/3346] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:05 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:06.470087 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1cf58e3e-4826-4f20-97ba-bb51ef652969 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:06.470735 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1cf58e3e-4826-4f20-97ba-bb51ef652969 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: 9a54383b-d874-4fb8-8c4d-e19c004d8d04] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:06.476988 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1cf58e3e-4826-4f20-97ba-bb51ef652969 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:06.477445 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1cf58e3e-4826-4f20-97ba-bb51ef652969 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:06.478229 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1cf58e3e-4826-4f20-97ba-bb51ef652969 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:06.478673 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1cf58e3e-4826-4f20-97ba-bb51ef652969 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:06.612776 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1cf58e3e-4826-4f20-97ba-bb51ef652969 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:06.620013 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1cf58e3e-4826-4f20-97ba-bb51ef652969 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04" status: 200 len: 1362 microversion: 2.1 time: 0.153933 Mar 03 02:59:06.620680 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1560/3347] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:06 2022] GET /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:59:06.994828 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0f38cee6-9d57-4676-9e27-bac391da0b67 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:06.996237 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0f38cee6-9d57-4676-9e27-bac391da0b67 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:07.003205 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0f38cee6-9d57-4676-9e27-bac391da0b67 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:07.003672 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0f38cee6-9d57-4676-9e27-bac391da0b67 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:07.004462 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0f38cee6-9d57-4676-9e27-bac391da0b67 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:07.005263 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0f38cee6-9d57-4676-9e27-bac391da0b67 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:07.071523 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0f38cee6-9d57-4676-9e27-bac391da0b67 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:07.080680 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0f38cee6-9d57-4676-9e27-bac391da0b67 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.090352 Mar 03 02:59:07.081256 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1788/3348] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:06 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:07.166451 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [req-45eea015-0aa1-4ff8-aa19-44b374caa5c4 req-f5d5dbe5-8537-48b2-af0d-73c41206a80c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a54383b-d874-4fb8-8c4d-e19c004d8d04", "name": "network-vif-plugged", "status": "completed", "tag": "9d5e352d-f477-4613-ae47-22be2e1ca382"}]} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:59:07.174423 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-45eea015-0aa1-4ff8-aa19-44b374caa5c4 req-f5d5dbe5-8537-48b2-af0d-73c41206a80c service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:07.174945 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-45eea015-0aa1-4ff8-aa19-44b374caa5c4 req-f5d5dbe5-8537-48b2-af0d-73c41206a80c service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:07.186463 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.compute.server_external_events [req-45eea015-0aa1-4ff8-aa19-44b374caa5c4 req-f5d5dbe5-8537-48b2-af0d-73c41206a80c service nova] Creating event network-vif-plugged:9d5e352d-f477-4613-ae47-22be2e1ca382 for instance 9a54383b-d874-4fb8-8c4d-e19c004d8d04 on hv-cinder-81977 Mar 03 02:59:07.191320 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [req-45eea015-0aa1-4ff8-aa19-44b374caa5c4 req-f5d5dbe5-8537-48b2-af0d-73c41206a80c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032667 Mar 03 02:59:07.191944 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1561/3349] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:59:07.637255 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-bd085c0b-e2fa-4925-ab21-2a7ae08edc13 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:07.637935 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-bd085c0b-e2fa-4925-ab21-2a7ae08edc13 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: 9a54383b-d874-4fb8-8c4d-e19c004d8d04] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:07.645409 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bd085c0b-e2fa-4925-ab21-2a7ae08edc13 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:07.645857 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bd085c0b-e2fa-4925-ab21-2a7ae08edc13 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:07.646627 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bd085c0b-e2fa-4925-ab21-2a7ae08edc13 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:07.647061 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bd085c0b-e2fa-4925-ab21-2a7ae08edc13 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:07.777454 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-bd085c0b-e2fa-4925-ab21-2a7ae08edc13 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:07.785657 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-bd085c0b-e2fa-4925-ab21-2a7ae08edc13 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04" status: 200 len: 1362 microversion: 2.1 time: 0.152806 Mar 03 02:59:07.786275 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1789/3350] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:07 2022] GET /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:08.098473 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c74ee444-3a36-471a-9533-c60bb59133f3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:08.099165 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c74ee444-3a36-471a-9533-c60bb59133f3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:08.105507 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c74ee444-3a36-471a-9533-c60bb59133f3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:08.105950 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c74ee444-3a36-471a-9533-c60bb59133f3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:08.106715 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c74ee444-3a36-471a-9533-c60bb59133f3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:08.107150 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c74ee444-3a36-471a-9533-c60bb59133f3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:08.169650 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c74ee444-3a36-471a-9533-c60bb59133f3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:08.177274 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c74ee444-3a36-471a-9533-c60bb59133f3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.083489 Mar 03 02:59:08.177843 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1562/3351] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:08 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:08.803143 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-19ee52af-06d5-4cb4-82a9-b3dd5d0970d2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:08.803796 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-19ee52af-06d5-4cb4-82a9-b3dd5d0970d2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: 9a54383b-d874-4fb8-8c4d-e19c004d8d04] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:08.810089 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-19ee52af-06d5-4cb4-82a9-b3dd5d0970d2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:08.810536 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-19ee52af-06d5-4cb4-82a9-b3dd5d0970d2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:08.811305 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-19ee52af-06d5-4cb4-82a9-b3dd5d0970d2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:08.811770 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-19ee52af-06d5-4cb4-82a9-b3dd5d0970d2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:08.947634 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-19ee52af-06d5-4cb4-82a9-b3dd5d0970d2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:08.955225 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-19ee52af-06d5-4cb4-82a9-b3dd5d0970d2 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04" status: 200 len: 1548 microversion: 2.1 time: 0.155893 Mar 03 02:59:08.955818 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1790/3352] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:08 2022] GET /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:08.971285 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b72f171f-7db1-49fb-98d9-fc896e99e7a0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:08.971803 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b72f171f-7db1-49fb-98d9-fc896e99e7a0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: 9a54383b-d874-4fb8-8c4d-e19c004d8d04] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:08.977665 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b72f171f-7db1-49fb-98d9-fc896e99e7a0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:08.978118 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b72f171f-7db1-49fb-98d9-fc896e99e7a0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:08.978906 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b72f171f-7db1-49fb-98d9-fc896e99e7a0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:08.980135 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b72f171f-7db1-49fb-98d9-fc896e99e7a0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:09.061005 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b72f171f-7db1-49fb-98d9-fc896e99e7a0 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093524 Mar 03 02:59:09.061606 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1563/3353] 10.222.0.30 () {58 vars in 1274 bytes} [Thu Mar 3 02:59:08 2022] GET /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:59:09.194122 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d4b7c5df-9a57-4745-8ea1-fa912be68277 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:09.194762 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d4b7c5df-9a57-4745-8ea1-fa912be68277 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:09.201333 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d4b7c5df-9a57-4745-8ea1-fa912be68277 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:09.201786 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d4b7c5df-9a57-4745-8ea1-fa912be68277 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:09.202567 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d4b7c5df-9a57-4745-8ea1-fa912be68277 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:09.203004 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d4b7c5df-9a57-4745-8ea1-fa912be68277 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:09.260483 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d4b7c5df-9a57-4745-8ea1-fa912be68277 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:09.268801 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d4b7c5df-9a57-4745-8ea1-fa912be68277 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078496 Mar 03 02:59:09.269381 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1791/3354] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:09 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:10.249371 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-61c184e2-32f2-428b-b449-0309badc130a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:10.254052 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-61c184e2-32f2-428b-b449-0309badc130a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: 9a54383b-d874-4fb8-8c4d-e19c004d8d04] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:10.261552 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-61c184e2-32f2-428b-b449-0309badc130a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:10.262296 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-61c184e2-32f2-428b-b449-0309badc130a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:10.262931 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-61c184e2-32f2-428b-b449-0309badc130a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:10.263570 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-61c184e2-32f2-428b-b449-0309badc130a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:10.289500 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-61c184e2-32f2-428b-b449-0309badc130a tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04/ips" status: 200 len: 106 microversion: 2.1 time: 0.052927 Mar 03 02:59:10.290479 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1564/3355] 10.222.0.30 () {58 vars in 1247 bytes} [Thu Mar 3 02:59:10 2022] GET /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04/ips => generated 106 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 02:59:10.295115 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0dc15343-57e9-46df-8262-d6a362423e08 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:10.295904 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0dc15343-57e9-46df-8262-d6a362423e08 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:10.299526 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [req-556b98e2-6736-4453-a098-870a20f1055a req-f74b742b-9809-4ee2-b317-cc49345501c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a54383b-d874-4fb8-8c4d-e19c004d8d04", "tag": "9d5e352d-f477-4613-ae47-22be2e1ca382"}]} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 02:59:10.301985 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0dc15343-57e9-46df-8262-d6a362423e08 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:10.302450 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0dc15343-57e9-46df-8262-d6a362423e08 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:10.303302 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0dc15343-57e9-46df-8262-d6a362423e08 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:10.303970 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0dc15343-57e9-46df-8262-d6a362423e08 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:10.307504 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-556b98e2-6736-4453-a098-870a20f1055a req-f74b742b-9809-4ee2-b317-cc49345501c1 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:10.308047 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-556b98e2-6736-4453-a098-870a20f1055a req-f74b742b-9809-4ee2-b317-cc49345501c1 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:10.319186 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.compute.server_external_events [req-556b98e2-6736-4453-a098-870a20f1055a req-f74b742b-9809-4ee2-b317-cc49345501c1 service nova] Creating event network-changed:9d5e352d-f477-4613-ae47-22be2e1ca382 for instance 9a54383b-d874-4fb8-8c4d-e19c004d8d04 on hv-cinder-81977 Mar 03 02:59:10.325584 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [req-556b98e2-6736-4453-a098-870a20f1055a req-f74b742b-9809-4ee2-b317-cc49345501c1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086674 Mar 03 02:59:10.326411 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1792/3356] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 02:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 02:59:10.370588 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0dc15343-57e9-46df-8262-d6a362423e08 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:10.378643 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0dc15343-57e9-46df-8262-d6a362423e08 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.087162 Mar 03 02:59:10.379640 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1565/3357] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:10 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:11.396720 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1a0b113e-4191-46de-a93f-0a847c081893 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:11.397651 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1a0b113e-4191-46de-a93f-0a847c081893 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:11.404575 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1a0b113e-4191-46de-a93f-0a847c081893 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:11.405018 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1a0b113e-4191-46de-a93f-0a847c081893 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:11.405796 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1a0b113e-4191-46de-a93f-0a847c081893 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:11.406243 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1a0b113e-4191-46de-a93f-0a847c081893 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:11.471809 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1a0b113e-4191-46de-a93f-0a847c081893 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:11.480553 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1a0b113e-4191-46de-a93f-0a847c081893 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.088121 Mar 03 02:59:11.481130 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1793/3358] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:11 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:12.498051 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1e0e5fbe-c9bd-41cd-b919-c3e30a4afda3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:12.498686 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1e0e5fbe-c9bd-41cd-b919-c3e30a4afda3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:12.504966 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1e0e5fbe-c9bd-41cd-b919-c3e30a4afda3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:12.505445 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1e0e5fbe-c9bd-41cd-b919-c3e30a4afda3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:12.506214 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1e0e5fbe-c9bd-41cd-b919-c3e30a4afda3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:12.506648 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1e0e5fbe-c9bd-41cd-b919-c3e30a4afda3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:12.566589 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1e0e5fbe-c9bd-41cd-b919-c3e30a4afda3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:12.574836 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1e0e5fbe-c9bd-41cd-b919-c3e30a4afda3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.081322 Mar 03 02:59:12.575402 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1566/3359] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:12 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:13.592718 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e46c1670-70a5-4caa-ae08-e95adb7c15d8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:13.593325 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e46c1670-70a5-4caa-ae08-e95adb7c15d8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:13.599576 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e46c1670-70a5-4caa-ae08-e95adb7c15d8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:13.600075 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e46c1670-70a5-4caa-ae08-e95adb7c15d8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:13.600830 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e46c1670-70a5-4caa-ae08-e95adb7c15d8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:13.601269 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e46c1670-70a5-4caa-ae08-e95adb7c15d8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:13.660083 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e46c1670-70a5-4caa-ae08-e95adb7c15d8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:13.667577 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e46c1670-70a5-4caa-ae08-e95adb7c15d8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079942 Mar 03 02:59:13.668173 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1794/3360] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:13 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:14.685408 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-06781ed9-8424-4cac-8868-c5c90a7de3b3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:14.686016 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-06781ed9-8424-4cac-8868-c5c90a7de3b3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:14.692276 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-06781ed9-8424-4cac-8868-c5c90a7de3b3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:14.692723 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-06781ed9-8424-4cac-8868-c5c90a7de3b3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:14.693495 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-06781ed9-8424-4cac-8868-c5c90a7de3b3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:14.693929 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-06781ed9-8424-4cac-8868-c5c90a7de3b3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:14.754561 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-06781ed9-8424-4cac-8868-c5c90a7de3b3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:14.765750 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-06781ed9-8424-4cac-8868-c5c90a7de3b3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.084732 Mar 03 02:59:14.766344 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1567/3361] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:14 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:59:15.782224 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6912333f-110f-44f0-a451-6096f0308814 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:15.782841 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6912333f-110f-44f0-a451-6096f0308814 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:15.789052 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6912333f-110f-44f0-a451-6096f0308814 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:15.789507 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6912333f-110f-44f0-a451-6096f0308814 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:15.790284 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6912333f-110f-44f0-a451-6096f0308814 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:15.790725 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6912333f-110f-44f0-a451-6096f0308814 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:15.852427 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6912333f-110f-44f0-a451-6096f0308814 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:15.861416 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6912333f-110f-44f0-a451-6096f0308814 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.083047 Mar 03 02:59:15.861989 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1795/3362] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:15 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:16.878750 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-40ac7300-abfa-454a-b562-539d99de77a9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:16.879357 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-40ac7300-abfa-454a-b562-539d99de77a9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:16.885762 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-40ac7300-abfa-454a-b562-539d99de77a9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:16.886229 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-40ac7300-abfa-454a-b562-539d99de77a9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:16.886999 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-40ac7300-abfa-454a-b562-539d99de77a9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:16.887434 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-40ac7300-abfa-454a-b562-539d99de77a9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:16.946286 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-40ac7300-abfa-454a-b562-539d99de77a9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:16.953995 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-40ac7300-abfa-454a-b562-539d99de77a9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079113 Mar 03 02:59:16.954558 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1568/3363] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:16 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:17.971105 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e16b36c6-b30e-4a48-8717-80fad46e04d4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:17.971733 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e16b36c6-b30e-4a48-8717-80fad46e04d4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:17.977961 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e16b36c6-b30e-4a48-8717-80fad46e04d4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:17.978410 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e16b36c6-b30e-4a48-8717-80fad46e04d4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:17.979494 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e16b36c6-b30e-4a48-8717-80fad46e04d4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:17.979956 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e16b36c6-b30e-4a48-8717-80fad46e04d4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:18.039029 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e16b36c6-b30e-4a48-8717-80fad46e04d4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:18.046863 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e16b36c6-b30e-4a48-8717-80fad46e04d4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079594 Mar 03 02:59:18.047432 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1796/3364] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:17 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:19.063440 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c8efc688-ff88-43cf-a3b4-ebcad7223846 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:19.064095 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c8efc688-ff88-43cf-a3b4-ebcad7223846 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:19.070304 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c8efc688-ff88-43cf-a3b4-ebcad7223846 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:19.070751 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c8efc688-ff88-43cf-a3b4-ebcad7223846 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:19.071518 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c8efc688-ff88-43cf-a3b4-ebcad7223846 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:19.071987 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c8efc688-ff88-43cf-a3b4-ebcad7223846 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:19.132261 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c8efc688-ff88-43cf-a3b4-ebcad7223846 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:19.140431 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c8efc688-ff88-43cf-a3b4-ebcad7223846 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080907 Mar 03 02:59:19.140998 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1569/3365] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:19 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:20.156927 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c0bb12e6-64ac-4136-b91c-ea19ff530646 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:20.157535 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c0bb12e6-64ac-4136-b91c-ea19ff530646 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:20.163784 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c0bb12e6-64ac-4136-b91c-ea19ff530646 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:20.164231 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c0bb12e6-64ac-4136-b91c-ea19ff530646 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:20.165010 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c0bb12e6-64ac-4136-b91c-ea19ff530646 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:20.165444 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c0bb12e6-64ac-4136-b91c-ea19ff530646 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:20.225067 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c0bb12e6-64ac-4136-b91c-ea19ff530646 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:20.233133 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c0bb12e6-64ac-4136-b91c-ea19ff530646 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080049 Mar 03 02:59:20.233691 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1797/3366] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:20 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:59:21.249742 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-87893bc9-e6ba-4b48-906a-b2bc10f46ec6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:21.250348 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-87893bc9-e6ba-4b48-906a-b2bc10f46ec6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:21.256600 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-87893bc9-e6ba-4b48-906a-b2bc10f46ec6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:21.257049 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-87893bc9-e6ba-4b48-906a-b2bc10f46ec6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:21.257810 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-87893bc9-e6ba-4b48-906a-b2bc10f46ec6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:21.258244 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-87893bc9-e6ba-4b48-906a-b2bc10f46ec6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:21.316334 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-87893bc9-e6ba-4b48-906a-b2bc10f46ec6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:21.324029 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-87893bc9-e6ba-4b48-906a-b2bc10f46ec6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078093 Mar 03 02:59:21.324607 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1570/3367] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:21 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:22.341313 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c766977e-4ad9-4d73-830e-98fe4cde08cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:22.341923 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c766977e-4ad9-4d73-830e-98fe4cde08cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:22.348596 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c766977e-4ad9-4d73-830e-98fe4cde08cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:22.349040 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c766977e-4ad9-4d73-830e-98fe4cde08cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:22.349820 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c766977e-4ad9-4d73-830e-98fe4cde08cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:22.350237 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c766977e-4ad9-4d73-830e-98fe4cde08cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:22.409318 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c766977e-4ad9-4d73-830e-98fe4cde08cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:22.417055 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c766977e-4ad9-4d73-830e-98fe4cde08cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080213 Mar 03 02:59:22.417613 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1798/3368] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:22 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:23.434301 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9f256e36-9b6e-472c-a7b4-91a6c2a0d5ed tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:23.434896 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9f256e36-9b6e-472c-a7b4-91a6c2a0d5ed tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:23.441134 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9f256e36-9b6e-472c-a7b4-91a6c2a0d5ed tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:23.441579 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9f256e36-9b6e-472c-a7b4-91a6c2a0d5ed tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:23.442348 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9f256e36-9b6e-472c-a7b4-91a6c2a0d5ed tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:23.442780 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9f256e36-9b6e-472c-a7b4-91a6c2a0d5ed tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:23.504021 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9f256e36-9b6e-472c-a7b4-91a6c2a0d5ed tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:23.512231 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9f256e36-9b6e-472c-a7b4-91a6c2a0d5ed tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.082395 Mar 03 02:59:23.512791 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1571/3369] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:23 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:24.529655 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6c02c25d-d706-444e-a5bb-67b71bf7710f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:24.530260 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6c02c25d-d706-444e-a5bb-67b71bf7710f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:24.536478 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6c02c25d-d706-444e-a5bb-67b71bf7710f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:24.536930 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6c02c25d-d706-444e-a5bb-67b71bf7710f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:24.537704 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6c02c25d-d706-444e-a5bb-67b71bf7710f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:24.538141 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6c02c25d-d706-444e-a5bb-67b71bf7710f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:24.595743 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6c02c25d-d706-444e-a5bb-67b71bf7710f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:24.603407 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6c02c25d-d706-444e-a5bb-67b71bf7710f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078195 Mar 03 02:59:24.604266 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1799/3370] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:24 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:25.620689 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e664592c-f72c-4bcb-8122-59e344e9fea1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:25.621289 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e664592c-f72c-4bcb-8122-59e344e9fea1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:25.627414 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e664592c-f72c-4bcb-8122-59e344e9fea1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:25.627896 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e664592c-f72c-4bcb-8122-59e344e9fea1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:25.628668 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e664592c-f72c-4bcb-8122-59e344e9fea1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:25.629103 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e664592c-f72c-4bcb-8122-59e344e9fea1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:25.688932 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e664592c-f72c-4bcb-8122-59e344e9fea1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:25.696554 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e664592c-f72c-4bcb-8122-59e344e9fea1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079805 Mar 03 02:59:25.697106 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1572/3371] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:25 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:26.715086 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b9502816-17f3-4752-bae5-f5a4e438c9cf tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:26.715746 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b9502816-17f3-4752-bae5-f5a4e438c9cf tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:26.721961 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b9502816-17f3-4752-bae5-f5a4e438c9cf tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:26.722408 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b9502816-17f3-4752-bae5-f5a4e438c9cf tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:26.723182 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b9502816-17f3-4752-bae5-f5a4e438c9cf tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:26.723636 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b9502816-17f3-4752-bae5-f5a4e438c9cf tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:26.781975 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b9502816-17f3-4752-bae5-f5a4e438c9cf tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:26.789642 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b9502816-17f3-4752-bae5-f5a4e438c9cf tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079135 Mar 03 02:59:26.790203 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1800/3372] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:26 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:27.808550 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9359beb3-a3b2-47cb-b66e-c8da1c453d9a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:27.809187 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9359beb3-a3b2-47cb-b66e-c8da1c453d9a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:27.815427 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9359beb3-a3b2-47cb-b66e-c8da1c453d9a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:27.815925 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9359beb3-a3b2-47cb-b66e-c8da1c453d9a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:27.816697 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9359beb3-a3b2-47cb-b66e-c8da1c453d9a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:27.817137 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9359beb3-a3b2-47cb-b66e-c8da1c453d9a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:27.878420 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9359beb3-a3b2-47cb-b66e-c8da1c453d9a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:27.886174 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9359beb3-a3b2-47cb-b66e-c8da1c453d9a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.082181 Mar 03 02:59:27.886737 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1573/3373] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:27 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:28.903116 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1aef32be-f7fb-47b3-9987-e6cea6b8ac44 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:28.903745 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1aef32be-f7fb-47b3-9987-e6cea6b8ac44 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:28.910015 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1aef32be-f7fb-47b3-9987-e6cea6b8ac44 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:28.910470 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1aef32be-f7fb-47b3-9987-e6cea6b8ac44 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:28.911246 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1aef32be-f7fb-47b3-9987-e6cea6b8ac44 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:28.911704 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1aef32be-f7fb-47b3-9987-e6cea6b8ac44 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:28.974171 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1aef32be-f7fb-47b3-9987-e6cea6b8ac44 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:28.982036 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1aef32be-f7fb-47b3-9987-e6cea6b8ac44 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.083012 Mar 03 02:59:28.982589 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1801/3374] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:28 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:29.998808 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-340d4102-8f47-4d31-90cb-fb16351211cf tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:29.999440 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-340d4102-8f47-4d31-90cb-fb16351211cf tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:30.006325 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-340d4102-8f47-4d31-90cb-fb16351211cf tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:30.006789 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-340d4102-8f47-4d31-90cb-fb16351211cf tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:30.007585 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-340d4102-8f47-4d31-90cb-fb16351211cf tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:30.008051 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-340d4102-8f47-4d31-90cb-fb16351211cf tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:30.066654 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-340d4102-8f47-4d31-90cb-fb16351211cf tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:30.074995 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-340d4102-8f47-4d31-90cb-fb16351211cf tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080182 Mar 03 02:59:30.075560 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1574/3375] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:29 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:31.092874 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ce748955-6093-4af8-ba3e-892c2c70f3dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:31.093483 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ce748955-6093-4af8-ba3e-892c2c70f3dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:31.099698 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ce748955-6093-4af8-ba3e-892c2c70f3dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:31.100155 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ce748955-6093-4af8-ba3e-892c2c70f3dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:31.100938 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ce748955-6093-4af8-ba3e-892c2c70f3dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:31.101375 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ce748955-6093-4af8-ba3e-892c2c70f3dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:31.164970 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ce748955-6093-4af8-ba3e-892c2c70f3dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:31.173329 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ce748955-6093-4af8-ba3e-892c2c70f3dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.085383 Mar 03 02:59:31.173885 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1802/3376] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:31 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:32.190497 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-25787629-42f0-498e-bfaf-9e5f00294478 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:32.191160 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-25787629-42f0-498e-bfaf-9e5f00294478 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:32.197465 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-25787629-42f0-498e-bfaf-9e5f00294478 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:32.198088 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-25787629-42f0-498e-bfaf-9e5f00294478 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:32.198968 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-25787629-42f0-498e-bfaf-9e5f00294478 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:32.199410 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-25787629-42f0-498e-bfaf-9e5f00294478 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:32.261773 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-25787629-42f0-498e-bfaf-9e5f00294478 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:32.269670 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-25787629-42f0-498e-bfaf-9e5f00294478 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.083175 Mar 03 02:59:32.270241 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1575/3377] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:32 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:33.290621 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-bdfe6a62-b244-473a-870d-bbbb6f618527 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:33.291293 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-bdfe6a62-b244-473a-870d-bbbb6f618527 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:33.297612 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bdfe6a62-b244-473a-870d-bbbb6f618527 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:33.298057 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bdfe6a62-b244-473a-870d-bbbb6f618527 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:33.298820 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bdfe6a62-b244-473a-870d-bbbb6f618527 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:33.299253 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bdfe6a62-b244-473a-870d-bbbb6f618527 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:33.358419 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-bdfe6a62-b244-473a-870d-bbbb6f618527 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:33.366193 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-bdfe6a62-b244-473a-870d-bbbb6f618527 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079363 Mar 03 02:59:33.366758 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1803/3378] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:33 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:34.383727 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-88c3c9a6-0443-403d-b3c0-6054494de920 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:34.384332 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-88c3c9a6-0443-403d-b3c0-6054494de920 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:34.391104 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-88c3c9a6-0443-403d-b3c0-6054494de920 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:34.391549 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-88c3c9a6-0443-403d-b3c0-6054494de920 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:34.392348 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-88c3c9a6-0443-403d-b3c0-6054494de920 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:34.392781 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-88c3c9a6-0443-403d-b3c0-6054494de920 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:34.451402 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-88c3c9a6-0443-403d-b3c0-6054494de920 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:34.459126 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-88c3c9a6-0443-403d-b3c0-6054494de920 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079321 Mar 03 02:59:34.459713 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1576/3379] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:34 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:35.476639 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3110956e-4ba1-4e38-8fd3-9848989606a6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:35.477230 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3110956e-4ba1-4e38-8fd3-9848989606a6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:35.483561 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3110956e-4ba1-4e38-8fd3-9848989606a6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:35.484037 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3110956e-4ba1-4e38-8fd3-9848989606a6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:35.484808 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3110956e-4ba1-4e38-8fd3-9848989606a6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:35.485248 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3110956e-4ba1-4e38-8fd3-9848989606a6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:35.544087 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-3110956e-4ba1-4e38-8fd3-9848989606a6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:35.551682 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3110956e-4ba1-4e38-8fd3-9848989606a6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079092 Mar 03 02:59:35.552244 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1804/3380] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:35 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:36.567937 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-002146e4-91b9-4db0-b233-60ecf94a2324 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:36.568545 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-002146e4-91b9-4db0-b233-60ecf94a2324 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:36.574947 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-002146e4-91b9-4db0-b233-60ecf94a2324 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:36.575596 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-002146e4-91b9-4db0-b233-60ecf94a2324 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:36.576389 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-002146e4-91b9-4db0-b233-60ecf94a2324 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:36.576824 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-002146e4-91b9-4db0-b233-60ecf94a2324 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:36.634081 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-002146e4-91b9-4db0-b233-60ecf94a2324 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:36.642186 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-002146e4-91b9-4db0-b233-60ecf94a2324 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078158 Mar 03 02:59:36.642746 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1577/3381] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:36 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:37.658985 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c5754309-4bf5-4b10-809e-e34e6d29c1cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:37.659633 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c5754309-4bf5-4b10-809e-e34e6d29c1cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:37.665775 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c5754309-4bf5-4b10-809e-e34e6d29c1cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:37.666219 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c5754309-4bf5-4b10-809e-e34e6d29c1cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:37.666989 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c5754309-4bf5-4b10-809e-e34e6d29c1cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:37.667448 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c5754309-4bf5-4b10-809e-e34e6d29c1cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:37.725841 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c5754309-4bf5-4b10-809e-e34e6d29c1cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:37.733834 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c5754309-4bf5-4b10-809e-e34e6d29c1cd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078734 Mar 03 02:59:37.734388 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1805/3382] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:37 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:38.750985 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7441c5f4-486f-4765-a180-6e02913ffda2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:38.751615 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7441c5f4-486f-4765-a180-6e02913ffda2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:38.757886 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7441c5f4-486f-4765-a180-6e02913ffda2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:38.758333 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7441c5f4-486f-4765-a180-6e02913ffda2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:38.759111 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7441c5f4-486f-4765-a180-6e02913ffda2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:38.759554 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7441c5f4-486f-4765-a180-6e02913ffda2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:38.819818 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-7441c5f4-486f-4765-a180-6e02913ffda2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:38.828152 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7441c5f4-486f-4765-a180-6e02913ffda2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.081065 Mar 03 02:59:38.828730 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1578/3383] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:38 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:59:39.845027 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8b1f1630-6285-4c6b-b069-d20a4fda5471 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:39.845622 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8b1f1630-6285-4c6b-b069-d20a4fda5471 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:39.851846 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b1f1630-6285-4c6b-b069-d20a4fda5471 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:39.852294 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b1f1630-6285-4c6b-b069-d20a4fda5471 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:39.853065 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b1f1630-6285-4c6b-b069-d20a4fda5471 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:39.853495 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8b1f1630-6285-4c6b-b069-d20a4fda5471 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:39.914184 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8b1f1630-6285-4c6b-b069-d20a4fda5471 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:39.923465 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8b1f1630-6285-4c6b-b069-d20a4fda5471 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.082163 Mar 03 02:59:39.924125 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1806/3384] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:39 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:40.940220 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ea2cb96f-4fe7-4d74-9e76-23a9f77337ae tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:40.940855 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ea2cb96f-4fe7-4d74-9e76-23a9f77337ae tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:40.947040 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ea2cb96f-4fe7-4d74-9e76-23a9f77337ae tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:40.947484 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ea2cb96f-4fe7-4d74-9e76-23a9f77337ae tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:40.948282 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ea2cb96f-4fe7-4d74-9e76-23a9f77337ae tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:40.948771 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ea2cb96f-4fe7-4d74-9e76-23a9f77337ae tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:41.010180 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ea2cb96f-4fe7-4d74-9e76-23a9f77337ae tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:41.018434 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ea2cb96f-4fe7-4d74-9e76-23a9f77337ae tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.082056 Mar 03 02:59:41.018993 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1579/3385] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:40 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:42.036160 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f4ebcaf4-076f-4b06-a515-28fd0042cae1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:42.036770 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f4ebcaf4-076f-4b06-a515-28fd0042cae1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:42.043752 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f4ebcaf4-076f-4b06-a515-28fd0042cae1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:42.044206 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f4ebcaf4-076f-4b06-a515-28fd0042cae1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:42.044980 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f4ebcaf4-076f-4b06-a515-28fd0042cae1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:42.045418 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f4ebcaf4-076f-4b06-a515-28fd0042cae1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:42.109598 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f4ebcaf4-076f-4b06-a515-28fd0042cae1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:42.117401 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f4ebcaf4-076f-4b06-a515-28fd0042cae1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.085142 Mar 03 02:59:42.117965 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1807/3386] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:42 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:43.134999 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9a8da1bc-9b87-4be7-8180-beecf9d5f72d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:43.135633 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9a8da1bc-9b87-4be7-8180-beecf9d5f72d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:43.142465 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9a8da1bc-9b87-4be7-8180-beecf9d5f72d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:43.142915 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9a8da1bc-9b87-4be7-8180-beecf9d5f72d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:43.143773 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9a8da1bc-9b87-4be7-8180-beecf9d5f72d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:43.144208 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9a8da1bc-9b87-4be7-8180-beecf9d5f72d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:43.202627 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9a8da1bc-9b87-4be7-8180-beecf9d5f72d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:43.210246 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9a8da1bc-9b87-4be7-8180-beecf9d5f72d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079166 Mar 03 02:59:43.210817 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1580/3387] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:43 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:44.227229 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-cc95160d-3f4d-486c-9113-8fe49806db7e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:44.227859 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-cc95160d-3f4d-486c-9113-8fe49806db7e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:44.234837 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cc95160d-3f4d-486c-9113-8fe49806db7e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:44.235286 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cc95160d-3f4d-486c-9113-8fe49806db7e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:44.236095 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cc95160d-3f4d-486c-9113-8fe49806db7e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:44.236537 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cc95160d-3f4d-486c-9113-8fe49806db7e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:44.295511 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-cc95160d-3f4d-486c-9113-8fe49806db7e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:44.303201 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-cc95160d-3f4d-486c-9113-8fe49806db7e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079791 Mar 03 02:59:44.303723 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1808/3388] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:44 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:45.319350 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-91dfa236-87b6-4c07-9e26-84ce8a4342e2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:45.319965 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-91dfa236-87b6-4c07-9e26-84ce8a4342e2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:45.326677 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-91dfa236-87b6-4c07-9e26-84ce8a4342e2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:45.327135 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-91dfa236-87b6-4c07-9e26-84ce8a4342e2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:45.327945 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-91dfa236-87b6-4c07-9e26-84ce8a4342e2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:45.328386 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-91dfa236-87b6-4c07-9e26-84ce8a4342e2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:45.387427 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-91dfa236-87b6-4c07-9e26-84ce8a4342e2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:45.395565 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-91dfa236-87b6-4c07-9e26-84ce8a4342e2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080211 Mar 03 02:59:45.396152 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1581/3389] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:45 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:46.413208 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9449cf52-ebb8-4493-bdd0-4416d02706ef tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:46.413810 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9449cf52-ebb8-4493-bdd0-4416d02706ef tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:46.420594 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9449cf52-ebb8-4493-bdd0-4416d02706ef tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:46.421045 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9449cf52-ebb8-4493-bdd0-4416d02706ef tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:46.421823 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9449cf52-ebb8-4493-bdd0-4416d02706ef tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:46.422264 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9449cf52-ebb8-4493-bdd0-4416d02706ef tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:46.480558 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9449cf52-ebb8-4493-bdd0-4416d02706ef tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:46.488660 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9449cf52-ebb8-4493-bdd0-4416d02706ef tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079312 Mar 03 02:59:46.489226 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1809/3390] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:46 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:47.505931 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-33247c67-7543-4fe2-b56a-01a45fc8bf89 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:47.506538 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-33247c67-7543-4fe2-b56a-01a45fc8bf89 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:47.512874 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-33247c67-7543-4fe2-b56a-01a45fc8bf89 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:47.513323 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-33247c67-7543-4fe2-b56a-01a45fc8bf89 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:47.514094 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-33247c67-7543-4fe2-b56a-01a45fc8bf89 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:47.514524 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-33247c67-7543-4fe2-b56a-01a45fc8bf89 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:47.572939 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-33247c67-7543-4fe2-b56a-01a45fc8bf89 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:47.580700 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-33247c67-7543-4fe2-b56a-01a45fc8bf89 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078681 Mar 03 02:59:47.581255 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1582/3391] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:47 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:48.596855 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-93992687-4f1a-4130-afec-c85fb68ee4ba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:48.597460 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-93992687-4f1a-4130-afec-c85fb68ee4ba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:48.604088 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-93992687-4f1a-4130-afec-c85fb68ee4ba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:48.604538 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-93992687-4f1a-4130-afec-c85fb68ee4ba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:48.605305 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-93992687-4f1a-4130-afec-c85fb68ee4ba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:48.605736 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-93992687-4f1a-4130-afec-c85fb68ee4ba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:48.671514 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-93992687-4f1a-4130-afec-c85fb68ee4ba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:48.679206 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-93992687-4f1a-4130-afec-c85fb68ee4ba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.086209 Mar 03 02:59:48.679793 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1810/3392] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:48 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:49.696147 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9c6ae59e-e85f-4f12-8226-dc66cf30e979 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:49.696760 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9c6ae59e-e85f-4f12-8226-dc66cf30e979 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:49.703475 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9c6ae59e-e85f-4f12-8226-dc66cf30e979 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:49.703950 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9c6ae59e-e85f-4f12-8226-dc66cf30e979 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:49.704726 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9c6ae59e-e85f-4f12-8226-dc66cf30e979 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:49.705159 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9c6ae59e-e85f-4f12-8226-dc66cf30e979 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:49.763684 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9c6ae59e-e85f-4f12-8226-dc66cf30e979 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:49.771376 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9c6ae59e-e85f-4f12-8226-dc66cf30e979 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079191 Mar 03 02:59:49.771977 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1583/3393] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:49 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:50.787759 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8fd37b6e-bb95-46ee-ba4e-65fba7d89cc4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:50.788396 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8fd37b6e-bb95-46ee-ba4e-65fba7d89cc4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:50.795035 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8fd37b6e-bb95-46ee-ba4e-65fba7d89cc4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:50.795484 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8fd37b6e-bb95-46ee-ba4e-65fba7d89cc4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:50.796288 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8fd37b6e-bb95-46ee-ba4e-65fba7d89cc4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:50.796727 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8fd37b6e-bb95-46ee-ba4e-65fba7d89cc4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:50.855349 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8fd37b6e-bb95-46ee-ba4e-65fba7d89cc4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:50.863443 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8fd37b6e-bb95-46ee-ba4e-65fba7d89cc4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079652 Mar 03 02:59:50.864031 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1811/3394] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:50 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:51.880710 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d35d0895-1a75-4e91-a9a7-0ec5e6118720 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:51.881319 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d35d0895-1a75-4e91-a9a7-0ec5e6118720 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:51.888159 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d35d0895-1a75-4e91-a9a7-0ec5e6118720 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:51.888622 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d35d0895-1a75-4e91-a9a7-0ec5e6118720 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:51.889411 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d35d0895-1a75-4e91-a9a7-0ec5e6118720 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:51.889849 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d35d0895-1a75-4e91-a9a7-0ec5e6118720 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:51.947900 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d35d0895-1a75-4e91-a9a7-0ec5e6118720 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:51.956138 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d35d0895-1a75-4e91-a9a7-0ec5e6118720 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079212 Mar 03 02:59:51.956712 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1584/3395] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:51 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:59:52.973079 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-35c67c2c-7dae-4f44-8269-56db901c699a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:52.973765 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-35c67c2c-7dae-4f44-8269-56db901c699a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:52.980666 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-35c67c2c-7dae-4f44-8269-56db901c699a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:52.981711 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-35c67c2c-7dae-4f44-8269-56db901c699a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:52.982629 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-35c67c2c-7dae-4f44-8269-56db901c699a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:52.983074 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-35c67c2c-7dae-4f44-8269-56db901c699a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:53.041505 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-35c67c2c-7dae-4f44-8269-56db901c699a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:53.049888 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-35c67c2c-7dae-4f44-8269-56db901c699a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080846 Mar 03 02:59:53.050466 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1812/3396] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:52 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 02:59:54.067661 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8d4f0a13-1eec-4ab3-b53f-08dcfa5f859e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:54.068270 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8d4f0a13-1eec-4ab3-b53f-08dcfa5f859e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:54.074483 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8d4f0a13-1eec-4ab3-b53f-08dcfa5f859e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:54.076038 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8d4f0a13-1eec-4ab3-b53f-08dcfa5f859e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:54.077366 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8d4f0a13-1eec-4ab3-b53f-08dcfa5f859e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:54.077366 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8d4f0a13-1eec-4ab3-b53f-08dcfa5f859e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:54.141839 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8d4f0a13-1eec-4ab3-b53f-08dcfa5f859e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:54.149463 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8d4f0a13-1eec-4ab3-b53f-08dcfa5f859e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.085700 Mar 03 02:59:54.150023 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1585/3397] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:54 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:55.166720 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-16347b6a-e0e8-44c3-a58d-e231709cabdb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:55.167328 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-16347b6a-e0e8-44c3-a58d-e231709cabdb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:55.173837 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-16347b6a-e0e8-44c3-a58d-e231709cabdb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:55.174291 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-16347b6a-e0e8-44c3-a58d-e231709cabdb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:55.175068 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-16347b6a-e0e8-44c3-a58d-e231709cabdb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:55.175506 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-16347b6a-e0e8-44c3-a58d-e231709cabdb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:55.239310 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-16347b6a-e0e8-44c3-a58d-e231709cabdb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:55.247775 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-16347b6a-e0e8-44c3-a58d-e231709cabdb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.084920 Mar 03 02:59:55.248339 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1813/3398] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:55 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:56.264850 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-46d809f4-92f2-46da-b7f4-0d34c0662e63 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:56.265464 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-46d809f4-92f2-46da-b7f4-0d34c0662e63 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:56.271703 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-46d809f4-92f2-46da-b7f4-0d34c0662e63 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:56.272160 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-46d809f4-92f2-46da-b7f4-0d34c0662e63 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:56.272944 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-46d809f4-92f2-46da-b7f4-0d34c0662e63 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:56.273386 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-46d809f4-92f2-46da-b7f4-0d34c0662e63 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:56.331559 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-46d809f4-92f2-46da-b7f4-0d34c0662e63 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:56.339293 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-46d809f4-92f2-46da-b7f4-0d34c0662e63 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078831 Mar 03 02:59:56.339905 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1586/3399] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:56 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:57.357824 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-788d8ee7-c138-405a-b835-3a1609c7179c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:57.358427 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-788d8ee7-c138-405a-b835-3a1609c7179c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:57.364648 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-788d8ee7-c138-405a-b835-3a1609c7179c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:57.365098 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-788d8ee7-c138-405a-b835-3a1609c7179c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:57.365872 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-788d8ee7-c138-405a-b835-3a1609c7179c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:57.366309 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-788d8ee7-c138-405a-b835-3a1609c7179c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:57.425818 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-788d8ee7-c138-405a-b835-3a1609c7179c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:57.433439 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-788d8ee7-c138-405a-b835-3a1609c7179c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080524 Mar 03 02:59:57.434047 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1814/3400] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:57 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:58.450757 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7f7895e0-1937-48b5-a729-ef7518c6d663 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:58.451380 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7f7895e0-1937-48b5-a729-ef7518c6d663 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:58.457602 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7f7895e0-1937-48b5-a729-ef7518c6d663 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:58.458060 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7f7895e0-1937-48b5-a729-ef7518c6d663 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:58.458839 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7f7895e0-1937-48b5-a729-ef7518c6d663 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:58.459281 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7f7895e0-1937-48b5-a729-ef7518c6d663 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:58.517969 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-7f7895e0-1937-48b5-a729-ef7518c6d663 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:58.525551 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7f7895e0-1937-48b5-a729-ef7518c6d663 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079370 Mar 03 02:59:58.526118 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1587/3401] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:58 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 02:59:59.541971 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-65bb3bb9-f85b-4506-a352-7db453de97dc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 02:59:59.542586 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-65bb3bb9-f85b-4506-a352-7db453de97dc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 02:59:59.549307 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-65bb3bb9-f85b-4506-a352-7db453de97dc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:59.549755 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-65bb3bb9-f85b-4506-a352-7db453de97dc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:59.550524 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-65bb3bb9-f85b-4506-a352-7db453de97dc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 02:59:59.550955 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-65bb3bb9-f85b-4506-a352-7db453de97dc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 02:59:59.609694 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-65bb3bb9-f85b-4506-a352-7db453de97dc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 02:59:59.617292 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-65bb3bb9-f85b-4506-a352-7db453de97dc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079195 Mar 03 02:59:59.617851 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1815/3402] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 02:59:59 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:00.634276 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1c55ae4c-e8e8-4564-b6d1-1882c3c7fc67 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:00.634863 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1c55ae4c-e8e8-4564-b6d1-1882c3c7fc67 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:00.641418 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1c55ae4c-e8e8-4564-b6d1-1882c3c7fc67 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:00.641864 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1c55ae4c-e8e8-4564-b6d1-1882c3c7fc67 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:00.642637 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1c55ae4c-e8e8-4564-b6d1-1882c3c7fc67 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:00.643074 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1c55ae4c-e8e8-4564-b6d1-1882c3c7fc67 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:00.701873 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1c55ae4c-e8e8-4564-b6d1-1882c3c7fc67 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:00.709568 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1c55ae4c-e8e8-4564-b6d1-1882c3c7fc67 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079207 Mar 03 03:00:00.710131 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1588/3403] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:00 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:01.726271 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5d0d05f3-9f78-44cc-839c-d20bf1fb95b1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:01.726873 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5d0d05f3-9f78-44cc-839c-d20bf1fb95b1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:01.733344 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5d0d05f3-9f78-44cc-839c-d20bf1fb95b1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:01.733790 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5d0d05f3-9f78-44cc-839c-d20bf1fb95b1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:01.734568 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5d0d05f3-9f78-44cc-839c-d20bf1fb95b1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:01.735001 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5d0d05f3-9f78-44cc-839c-d20bf1fb95b1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:01.809492 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5d0d05f3-9f78-44cc-839c-d20bf1fb95b1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:01.817117 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5d0d05f3-9f78-44cc-839c-d20bf1fb95b1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.094750 Mar 03 03:00:01.817677 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1816/3404] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:01 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:02.834395 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a65ee048-d6d0-4f78-9acf-1511fd6ed5fa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:02.835024 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a65ee048-d6d0-4f78-9acf-1511fd6ed5fa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:02.841912 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a65ee048-d6d0-4f78-9acf-1511fd6ed5fa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:02.842350 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a65ee048-d6d0-4f78-9acf-1511fd6ed5fa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:02.843117 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a65ee048-d6d0-4f78-9acf-1511fd6ed5fa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:02.843546 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a65ee048-d6d0-4f78-9acf-1511fd6ed5fa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:02.900874 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a65ee048-d6d0-4f78-9acf-1511fd6ed5fa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:02.909119 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a65ee048-d6d0-4f78-9acf-1511fd6ed5fa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078609 Mar 03 03:00:02.909682 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1589/3405] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:02 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:03.925799 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a6af0f6f-757b-42ed-9bf8-c9792f1b120c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:03.926390 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a6af0f6f-757b-42ed-9bf8-c9792f1b120c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:03.932532 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a6af0f6f-757b-42ed-9bf8-c9792f1b120c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:03.932995 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a6af0f6f-757b-42ed-9bf8-c9792f1b120c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:03.933815 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a6af0f6f-757b-42ed-9bf8-c9792f1b120c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:03.934257 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a6af0f6f-757b-42ed-9bf8-c9792f1b120c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:03.993151 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a6af0f6f-757b-42ed-9bf8-c9792f1b120c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:04.001480 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a6af0f6f-757b-42ed-9bf8-c9792f1b120c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080346 Mar 03 03:00:04.002053 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1817/3406] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:03 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:05.018709 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-02c869f2-99c5-45b4-8a61-ad50f78b25f3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:05.019315 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-02c869f2-99c5-45b4-8a61-ad50f78b25f3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:05.025862 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-02c869f2-99c5-45b4-8a61-ad50f78b25f3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:05.026342 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-02c869f2-99c5-45b4-8a61-ad50f78b25f3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:05.027156 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-02c869f2-99c5-45b4-8a61-ad50f78b25f3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:05.027642 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-02c869f2-99c5-45b4-8a61-ad50f78b25f3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:05.087573 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-02c869f2-99c5-45b4-8a61-ad50f78b25f3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:05.096632 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-02c869f2-99c5-45b4-8a61-ad50f78b25f3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.081769 Mar 03 03:00:05.097209 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1590/3407] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:05 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:06.114108 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-33235820-ea58-412b-8995-1589cba04562 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:06.114716 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-33235820-ea58-412b-8995-1589cba04562 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:06.120666 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-33235820-ea58-412b-8995-1589cba04562 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:06.121122 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-33235820-ea58-412b-8995-1589cba04562 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:06.121896 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-33235820-ea58-412b-8995-1589cba04562 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:06.122526 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-33235820-ea58-412b-8995-1589cba04562 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:06.179937 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-33235820-ea58-412b-8995-1589cba04562 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:06.187458 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-33235820-ea58-412b-8995-1589cba04562 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.077279 Mar 03 03:00:06.188061 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1818/3408] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:06 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:07.204380 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-85d861bd-b50c-4b55-9ffd-23e4e1b7e9f8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:07.205102 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-85d861bd-b50c-4b55-9ffd-23e4e1b7e9f8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:07.210941 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-85d861bd-b50c-4b55-9ffd-23e4e1b7e9f8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:07.211396 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-85d861bd-b50c-4b55-9ffd-23e4e1b7e9f8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:07.212208 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-85d861bd-b50c-4b55-9ffd-23e4e1b7e9f8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:07.212667 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-85d861bd-b50c-4b55-9ffd-23e4e1b7e9f8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:07.276362 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-85d861bd-b50c-4b55-9ffd-23e4e1b7e9f8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:07.284127 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-85d861bd-b50c-4b55-9ffd-23e4e1b7e9f8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.083894 Mar 03 03:00:07.284705 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1591/3409] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:07 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:08.300751 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-66558da0-fb84-4b9b-b7a8-458738d0fd37 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:08.301360 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-66558da0-fb84-4b9b-b7a8-458738d0fd37 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:08.307649 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-66558da0-fb84-4b9b-b7a8-458738d0fd37 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:08.308034 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-66558da0-fb84-4b9b-b7a8-458738d0fd37 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:08.308805 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-66558da0-fb84-4b9b-b7a8-458738d0fd37 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:08.309242 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-66558da0-fb84-4b9b-b7a8-458738d0fd37 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:08.370985 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-66558da0-fb84-4b9b-b7a8-458738d0fd37 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:08.379565 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-66558da0-fb84-4b9b-b7a8-458738d0fd37 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.082659 Mar 03 03:00:08.380154 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1819/3410] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:08 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:09.397997 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e995eb5d-c629-4579-bece-4e593115afed tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:09.398605 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e995eb5d-c629-4579-bece-4e593115afed tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:09.404957 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e995eb5d-c629-4579-bece-4e593115afed tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:09.405399 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e995eb5d-c629-4579-bece-4e593115afed tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:09.406165 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e995eb5d-c629-4579-bece-4e593115afed tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:09.406596 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e995eb5d-c629-4579-bece-4e593115afed tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:09.466299 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e995eb5d-c629-4579-bece-4e593115afed tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:09.474218 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e995eb5d-c629-4579-bece-4e593115afed tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080150 Mar 03 03:00:09.474775 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1592/3411] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:09 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:10.360785 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-769c7e36-5ed3-43f5-9cc0-8376df54054c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:10.361357 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-769c7e36-5ed3-43f5-9cc0-8376df54054c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: 9a54383b-d874-4fb8-8c4d-e19c004d8d04] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:10.367465 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-769c7e36-5ed3-43f5-9cc0-8376df54054c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:10.367951 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-769c7e36-5ed3-43f5-9cc0-8376df54054c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:10.368753 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-769c7e36-5ed3-43f5-9cc0-8376df54054c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:10.369180 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-769c7e36-5ed3-43f5-9cc0-8376df54054c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:10.392815 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-769c7e36-5ed3-43f5-9cc0-8376df54054c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: 9a54383b-d874-4fb8-8c4d-e19c004d8d04] Going to try to terminate instance {{(pid=116858) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 03 03:00:10.466090 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-769c7e36-5ed3-43f5-9cc0-8376df54054c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04" status: 204 len: 0 microversion: 2.1 time: 0.109488 Mar 03 03:00:10.467250 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1820/3412] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Mar 3 03:00:10 2022] DELETE /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 03 03:00:10.476594 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-daf6577a-e824-40c6-9adb-9b4b3156e320 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:10.477210 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-daf6577a-e824-40c6-9adb-9b4b3156e320 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: 9a54383b-d874-4fb8-8c4d-e19c004d8d04] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:10.484435 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-daf6577a-e824-40c6-9adb-9b4b3156e320 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:10.484889 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-daf6577a-e824-40c6-9adb-9b4b3156e320 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:10.485674 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-daf6577a-e824-40c6-9adb-9b4b3156e320 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:10.486126 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-daf6577a-e824-40c6-9adb-9b4b3156e320 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:10.491845 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d2425975-e1fb-4d8c-ada1-319d830988dc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:10.492544 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d2425975-e1fb-4d8c-ada1-319d830988dc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:10.499016 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d2425975-e1fb-4d8c-ada1-319d830988dc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:10.499447 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d2425975-e1fb-4d8c-ada1-319d830988dc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:10.500252 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d2425975-e1fb-4d8c-ada1-319d830988dc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:10.500694 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d2425975-e1fb-4d8c-ada1-319d830988dc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:10.560642 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d2425975-e1fb-4d8c-ada1-319d830988dc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:10.568440 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d2425975-e1fb-4d8c-ada1-319d830988dc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080761 Mar 03 03:00:10.569285 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1821/3413] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:10 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 03:00:10.618050 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-daf6577a-e824-40c6-9adb-9b4b3156e320 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:10.625520 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-daf6577a-e824-40c6-9adb-9b4b3156e320 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04" status: 200 len: 1673 microversion: 2.1 time: 0.153171 Mar 03 03:00:10.626123 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1593/3414] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:10 2022] GET /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:11.584251 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7fb832eb-cb98-46bf-aef4-e22435522e70 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:11.584860 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7fb832eb-cb98-46bf-aef4-e22435522e70 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:11.591065 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7fb832eb-cb98-46bf-aef4-e22435522e70 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:11.591614 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7fb832eb-cb98-46bf-aef4-e22435522e70 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:11.592405 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7fb832eb-cb98-46bf-aef4-e22435522e70 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:11.592842 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7fb832eb-cb98-46bf-aef4-e22435522e70 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:11.642828 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d192a237-542d-413e-9fa8-e8864b6ef246 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:11.643445 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d192a237-542d-413e-9fa8-e8864b6ef246 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: 9a54383b-d874-4fb8-8c4d-e19c004d8d04] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:11.649854 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d192a237-542d-413e-9fa8-e8864b6ef246 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:11.650304 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d192a237-542d-413e-9fa8-e8864b6ef246 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:11.651088 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d192a237-542d-413e-9fa8-e8864b6ef246 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:11.651520 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d192a237-542d-413e-9fa8-e8864b6ef246 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:11.653274 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-7fb832eb-cb98-46bf-aef4-e22435522e70 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:11.661170 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7fb832eb-cb98-46bf-aef4-e22435522e70 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080825 Mar 03 03:00:11.661742 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1822/3415] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:11 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:11.785687 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d192a237-542d-413e-9fa8-e8864b6ef246 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:11.792974 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d192a237-542d-413e-9fa8-e8864b6ef246 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04" status: 200 len: 1673 microversion: 2.1 time: 0.154505 Mar 03 03:00:11.793546 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1594/3416] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:11 2022] GET /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 03:00:12.646941 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [req-96d4a607-0ab8-4d72-9146-af85be7cf3b2 req-91c6db21-d86e-4836-b1e4-750e19e6d382 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a54383b-d874-4fb8-8c4d-e19c004d8d04", "name": "network-vif-deleted", "tag": "9d5e352d-f477-4613-ae47-22be2e1ca382"}]} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 03:00:12.659504 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-96d4a607-0ab8-4d72-9146-af85be7cf3b2 req-91c6db21-d86e-4836-b1e4-750e19e6d382 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:12.660107 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-96d4a607-0ab8-4d72-9146-af85be7cf3b2 req-91c6db21-d86e-4836-b1e4-750e19e6d382 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:12.673969 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.compute.server_external_events [req-96d4a607-0ab8-4d72-9146-af85be7cf3b2 req-91c6db21-d86e-4836-b1e4-750e19e6d382 service nova] Creating event network-vif-deleted:9d5e352d-f477-4613-ae47-22be2e1ca382 for instance 9a54383b-d874-4fb8-8c4d-e19c004d8d04 on hv-cinder-81977 Mar 03 03:00:12.678897 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a47589ae-09b4-4842-a89c-170e2be262fe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:12.679447 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [req-96d4a607-0ab8-4d72-9146-af85be7cf3b2 req-91c6db21-d86e-4836-b1e4-750e19e6d382 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036545 Mar 03 03:00:12.679644 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a47589ae-09b4-4842-a89c-170e2be262fe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:12.681610 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1823/3417] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 03:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 03:00:12.697407 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a47589ae-09b4-4842-a89c-170e2be262fe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:12.697407 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a47589ae-09b4-4842-a89c-170e2be262fe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:12.703995 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a47589ae-09b4-4842-a89c-170e2be262fe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:12.704495 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a47589ae-09b4-4842-a89c-170e2be262fe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:12.782592 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a47589ae-09b4-4842-a89c-170e2be262fe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:12.792191 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a47589ae-09b4-4842-a89c-170e2be262fe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.117504 Mar 03 03:00:12.793183 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1595/3418] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:12 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 03:00:12.812368 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f67c82c0-7a9e-41d9-aaf7-8889fe26e156 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:12.813076 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f67c82c0-7a9e-41d9-aaf7-8889fe26e156 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: 9a54383b-d874-4fb8-8c4d-e19c004d8d04] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:12.820268 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f67c82c0-7a9e-41d9-aaf7-8889fe26e156 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:12.820842 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f67c82c0-7a9e-41d9-aaf7-8889fe26e156 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:12.821695 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f67c82c0-7a9e-41d9-aaf7-8889fe26e156 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:12.822200 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f67c82c0-7a9e-41d9-aaf7-8889fe26e156 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:12.855644 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f67c82c0-7a9e-41d9-aaf7-8889fe26e156 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:12.856111 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f67c82c0-7a9e-41d9-aaf7-8889fe26e156 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:12.856594 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.objects.instance [None req-f67c82c0-7a9e-41d9-aaf7-8889fe26e156 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lazy-loading 'fault' on Instance uuid 9a54383b-d874-4fb8-8c4d-e19c004d8d04 {{(pid=116858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 03 03:00:12.902771 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f67c82c0-7a9e-41d9-aaf7-8889fe26e156 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211640f2c9e54914a33b7cf26ebf4a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204a19c418b44e9fa1c46a1fd0a0294b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:12.910467 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f67c82c0-7a9e-41d9-aaf7-8889fe26e156 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04" status: 200 len: 1327 microversion: 2.1 time: 0.103804 Mar 03 03:00:12.911045 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1824/3419] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:12 2022] GET /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04 => generated 1327 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:13.810513 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-624eb750-d4d1-45a0-bd88-7fe7d78d0e53 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:13.811243 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-624eb750-d4d1-45a0-bd88-7fe7d78d0e53 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:13.818172 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-624eb750-d4d1-45a0-bd88-7fe7d78d0e53 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:13.818629 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-624eb750-d4d1-45a0-bd88-7fe7d78d0e53 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:13.819421 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-624eb750-d4d1-45a0-bd88-7fe7d78d0e53 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:13.820149 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-624eb750-d4d1-45a0-bd88-7fe7d78d0e53 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:13.880294 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-624eb750-d4d1-45a0-bd88-7fe7d78d0e53 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:13.888738 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-624eb750-d4d1-45a0-bd88-7fe7d78d0e53 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.082072 Mar 03 03:00:13.889312 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1596/3420] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:13 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:13.928767 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-72ef2088-7ba3-4c87-bbde-c060a6c3ac45 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:13.929348 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-72ef2088-7ba3-4c87-bbde-c060a6c3ac45 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: 9a54383b-d874-4fb8-8c4d-e19c004d8d04] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:13.936484 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-72ef2088-7ba3-4c87-bbde-c060a6c3ac45 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:13.936932 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-72ef2088-7ba3-4c87-bbde-c060a6c3ac45 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:13.937705 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-72ef2088-7ba3-4c87-bbde-c060a6c3ac45 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:13.938140 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-72ef2088-7ba3-4c87-bbde-c060a6c3ac45 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:13.952396 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.wsgi [None req-72ef2088-7ba3-4c87-bbde-c060a6c3ac45 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] HTTP exception thrown: Instance 9a54383b-d874-4fb8-8c4d-e19c004d8d04 could not be found. Mar 03 03:00:13.953009 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-72ef2088-7ba3-4c87-bbde-c060a6c3ac45 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Returning 404 to user: Instance 9a54383b-d874-4fb8-8c4d-e19c004d8d04 could not be found. {{(pid=116858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 03:00:13.953832 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-72ef2088-7ba3-4c87-bbde-c060a6c3ac45 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04" status: 404 len: 111 microversion: 2.1 time: 0.029631 Mar 03 03:00:13.954367 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1825/3421] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:13 2022] GET /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 03 03:00:13.962535 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-701881e5-d602-4d4d-9ecd-54c76205a1e5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '.version_select at 0x7fb3c8242ee0>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:13.979885 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-701881e5-d602-4d4d-9ecd-54c76205a1e5 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1603100855" status: 202 len: 0 microversion: 2.1 time: 0.020989 Mar 03 03:00:13.980440 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1597/3422] 10.222.0.30 () {58 vars in 1220 bytes} [Thu Mar 3 03:00:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1603100855 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 03 03:00:14.593938 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2a2ba451-0eb3-43a9-be07-a9921e207640 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:14.594437 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2a2ba451-0eb3-43a9-be07-a9921e207640 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: 9a54383b-d874-4fb8-8c4d-e19c004d8d04] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:14.601304 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2a2ba451-0eb3-43a9-be07-a9921e207640 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:14.601762 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2a2ba451-0eb3-43a9-be07-a9921e207640 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:14.602551 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2a2ba451-0eb3-43a9-be07-a9921e207640 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:14.602991 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2a2ba451-0eb3-43a9-be07-a9921e207640 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:14.616653 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.wsgi [None req-2a2ba451-0eb3-43a9-be07-a9921e207640 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] HTTP exception thrown: Instance 9a54383b-d874-4fb8-8c4d-e19c004d8d04 could not be found. Mar 03 03:00:14.617243 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2a2ba451-0eb3-43a9-be07-a9921e207640 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Returning 404 to user: Instance 9a54383b-d874-4fb8-8c4d-e19c004d8d04 could not be found. {{(pid=116858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 03:00:14.618186 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2a2ba451-0eb3-43a9-be07-a9921e207640 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04" status: 404 len: 111 microversion: 2.1 time: 0.029118 Mar 03 03:00:14.618723 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1826/3423] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Mar 3 03:00:14 2022] DELETE /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 03 03:00:14.627318 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c9ac3b9c-0f54-414f-8f54-4d123903e47c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:14.628054 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c9ac3b9c-0f54-414f-8f54-4d123903e47c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: 9a54383b-d874-4fb8-8c4d-e19c004d8d04] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:14.633912 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c9ac3b9c-0f54-414f-8f54-4d123903e47c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:14.634372 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c9ac3b9c-0f54-414f-8f54-4d123903e47c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:14.635154 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c9ac3b9c-0f54-414f-8f54-4d123903e47c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:14.635596 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c9ac3b9c-0f54-414f-8f54-4d123903e47c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:14.649539 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.wsgi [None req-c9ac3b9c-0f54-414f-8f54-4d123903e47c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] HTTP exception thrown: Instance 9a54383b-d874-4fb8-8c4d-e19c004d8d04 could not be found. Mar 03 03:00:14.650165 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c9ac3b9c-0f54-414f-8f54-4d123903e47c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Returning 404 to user: Instance 9a54383b-d874-4fb8-8c4d-e19c004d8d04 could not be found. {{(pid=116859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 03:00:14.650993 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c9ac3b9c-0f54-414f-8f54-4d123903e47c tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04" status: 404 len: 111 microversion: 2.1 time: 0.027642 Mar 03 03:00:14.651527 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1598/3424] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:14 2022] GET /compute/v2.1/servers/9a54383b-d874-4fb8-8c4d-e19c004d8d04 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 03 03:00:14.906320 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a4f4fae5-74d1-4c32-9405-2279d7ac6ad0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:14.906951 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a4f4fae5-74d1-4c32-9405-2279d7ac6ad0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:14.912820 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a4f4fae5-74d1-4c32-9405-2279d7ac6ad0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:14.913269 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a4f4fae5-74d1-4c32-9405-2279d7ac6ad0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:14.914040 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a4f4fae5-74d1-4c32-9405-2279d7ac6ad0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:14.914477 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a4f4fae5-74d1-4c32-9405-2279d7ac6ad0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:14.973167 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a4f4fae5-74d1-4c32-9405-2279d7ac6ad0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:14.981145 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a4f4fae5-74d1-4c32-9405-2279d7ac6ad0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079494 Mar 03 03:00:14.981748 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1827/3425] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:14 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:15.998342 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-517af3c3-90f2-4e44-896b-76405aeb4af7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:15.998974 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-517af3c3-90f2-4e44-896b-76405aeb4af7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:16.005253 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-517af3c3-90f2-4e44-896b-76405aeb4af7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:16.005703 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-517af3c3-90f2-4e44-896b-76405aeb4af7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:16.006476 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-517af3c3-90f2-4e44-896b-76405aeb4af7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:16.006913 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-517af3c3-90f2-4e44-896b-76405aeb4af7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:16.071890 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-517af3c3-90f2-4e44-896b-76405aeb4af7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:16.079715 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-517af3c3-90f2-4e44-896b-76405aeb4af7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.085678 Mar 03 03:00:16.080266 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1599/3426] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:15 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:17.096357 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ab189920-2985-4da5-80ac-a2ea54cf7970 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:17.096943 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ab189920-2985-4da5-80ac-a2ea54cf7970 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:17.103140 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ab189920-2985-4da5-80ac-a2ea54cf7970 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:17.103866 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ab189920-2985-4da5-80ac-a2ea54cf7970 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:17.104639 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ab189920-2985-4da5-80ac-a2ea54cf7970 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:17.105074 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ab189920-2985-4da5-80ac-a2ea54cf7970 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:17.162330 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ab189920-2985-4da5-80ac-a2ea54cf7970 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:17.170445 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ab189920-2985-4da5-80ac-a2ea54cf7970 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.077901 Mar 03 03:00:17.170995 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1828/3427] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:17 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:18.187763 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2b3e6b6f-4f69-4aea-b14c-0793f1d6d74b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:18.188368 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2b3e6b6f-4f69-4aea-b14c-0793f1d6d74b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:18.194624 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2b3e6b6f-4f69-4aea-b14c-0793f1d6d74b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:18.195075 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2b3e6b6f-4f69-4aea-b14c-0793f1d6d74b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:18.195888 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2b3e6b6f-4f69-4aea-b14c-0793f1d6d74b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:18.196328 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2b3e6b6f-4f69-4aea-b14c-0793f1d6d74b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:18.253993 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2b3e6b6f-4f69-4aea-b14c-0793f1d6d74b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:18.261517 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2b3e6b6f-4f69-4aea-b14c-0793f1d6d74b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078163 Mar 03 03:00:18.262082 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1600/3428] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:18 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:19.279421 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-fd7d0723-8860-4876-8176-be0297196b44 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:19.280068 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-fd7d0723-8860-4876-8176-be0297196b44 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:19.286458 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fd7d0723-8860-4876-8176-be0297196b44 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:19.287042 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fd7d0723-8860-4876-8176-be0297196b44 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:19.287965 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fd7d0723-8860-4876-8176-be0297196b44 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:19.288544 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-fd7d0723-8860-4876-8176-be0297196b44 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:19.350870 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-fd7d0723-8860-4876-8176-be0297196b44 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:19.358832 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-fd7d0723-8860-4876-8176-be0297196b44 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.083961 Mar 03 03:00:19.359402 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1829/3429] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:19 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:20.375465 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0963d0b3-6f40-437c-b17e-8b718f5be7dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:20.376104 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0963d0b3-6f40-437c-b17e-8b718f5be7dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:20.382338 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0963d0b3-6f40-437c-b17e-8b718f5be7dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:20.382794 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0963d0b3-6f40-437c-b17e-8b718f5be7dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:20.383575 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0963d0b3-6f40-437c-b17e-8b718f5be7dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:20.384038 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0963d0b3-6f40-437c-b17e-8b718f5be7dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:20.443461 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0963d0b3-6f40-437c-b17e-8b718f5be7dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:20.451389 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0963d0b3-6f40-437c-b17e-8b718f5be7dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079848 Mar 03 03:00:20.451986 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1601/3430] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:20 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:21.468236 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ab42d334-5792-4394-a6bd-fe523984d0e2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:21.468844 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ab42d334-5792-4394-a6bd-fe523984d0e2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:21.475020 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ab42d334-5792-4394-a6bd-fe523984d0e2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:21.475471 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ab42d334-5792-4394-a6bd-fe523984d0e2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:21.476281 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ab42d334-5792-4394-a6bd-fe523984d0e2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:21.476726 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ab42d334-5792-4394-a6bd-fe523984d0e2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:21.535403 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ab42d334-5792-4394-a6bd-fe523984d0e2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:21.543047 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ab42d334-5792-4394-a6bd-fe523984d0e2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079544 Mar 03 03:00:21.543632 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1830/3431] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:21 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:22.559151 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2bfa7d27-235b-406e-9f86-8be621018288 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:22.560465 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2bfa7d27-235b-406e-9f86-8be621018288 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:22.566829 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2bfa7d27-235b-406e-9f86-8be621018288 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:22.567288 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2bfa7d27-235b-406e-9f86-8be621018288 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:22.568108 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2bfa7d27-235b-406e-9f86-8be621018288 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:22.568555 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2bfa7d27-235b-406e-9f86-8be621018288 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:22.627377 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2bfa7d27-235b-406e-9f86-8be621018288 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:22.635090 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2bfa7d27-235b-406e-9f86-8be621018288 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079802 Mar 03 03:00:22.635678 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1602/3432] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:22 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:23.651939 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-cf8b689b-e13b-40bd-bb19-7e47e828eb68 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:23.652535 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-cf8b689b-e13b-40bd-bb19-7e47e828eb68 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:23.659279 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cf8b689b-e13b-40bd-bb19-7e47e828eb68 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:23.659771 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cf8b689b-e13b-40bd-bb19-7e47e828eb68 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:23.660546 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cf8b689b-e13b-40bd-bb19-7e47e828eb68 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:23.660983 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cf8b689b-e13b-40bd-bb19-7e47e828eb68 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:23.720098 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-cf8b689b-e13b-40bd-bb19-7e47e828eb68 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:23.727823 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-cf8b689b-e13b-40bd-bb19-7e47e828eb68 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079764 Mar 03 03:00:23.728377 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1831/3433] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:23 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:24.745951 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3e4079d3-475c-427a-8e93-1ae0d9328171 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:24.746556 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3e4079d3-475c-427a-8e93-1ae0d9328171 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:24.753449 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3e4079d3-475c-427a-8e93-1ae0d9328171 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:24.753894 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3e4079d3-475c-427a-8e93-1ae0d9328171 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:24.754662 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3e4079d3-475c-427a-8e93-1ae0d9328171 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:24.755098 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3e4079d3-475c-427a-8e93-1ae0d9328171 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:24.814326 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3e4079d3-475c-427a-8e93-1ae0d9328171 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:24.821911 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3e4079d3-475c-427a-8e93-1ae0d9328171 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079922 Mar 03 03:00:24.822474 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1603/3434] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:24 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:25.838424 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1f7f9921-fa74-4bc9-820b-63cc129922c0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:25.839039 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1f7f9921-fa74-4bc9-820b-63cc129922c0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:25.845422 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1f7f9921-fa74-4bc9-820b-63cc129922c0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:25.845877 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1f7f9921-fa74-4bc9-820b-63cc129922c0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:25.846656 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1f7f9921-fa74-4bc9-820b-63cc129922c0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:25.847100 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1f7f9921-fa74-4bc9-820b-63cc129922c0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:25.905235 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1f7f9921-fa74-4bc9-820b-63cc129922c0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:25.912885 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1f7f9921-fa74-4bc9-820b-63cc129922c0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078329 Mar 03 03:00:25.913446 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1832/3435] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:25 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:26.930760 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6f0292d6-a635-4772-b6de-1643f43c29e8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:26.931356 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6f0292d6-a635-4772-b6de-1643f43c29e8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:26.938301 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6f0292d6-a635-4772-b6de-1643f43c29e8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:26.938759 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6f0292d6-a635-4772-b6de-1643f43c29e8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:26.939535 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6f0292d6-a635-4772-b6de-1643f43c29e8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:26.940028 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6f0292d6-a635-4772-b6de-1643f43c29e8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:26.997677 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-6f0292d6-a635-4772-b6de-1643f43c29e8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:27.006091 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6f0292d6-a635-4772-b6de-1643f43c29e8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079331 Mar 03 03:00:27.006656 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1604/3436] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:26 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:28.022439 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-729066f8-1780-4f4d-ac90-67cb03b61d1c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:28.023052 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-729066f8-1780-4f4d-ac90-67cb03b61d1c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:28.029502 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-729066f8-1780-4f4d-ac90-67cb03b61d1c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:28.029962 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-729066f8-1780-4f4d-ac90-67cb03b61d1c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:28.030743 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-729066f8-1780-4f4d-ac90-67cb03b61d1c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:28.031185 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-729066f8-1780-4f4d-ac90-67cb03b61d1c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:28.090639 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-729066f8-1780-4f4d-ac90-67cb03b61d1c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:28.098415 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-729066f8-1780-4f4d-ac90-67cb03b61d1c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079883 Mar 03 03:00:28.099127 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1833/3437] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:28 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:29.115970 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-03e1aa71-6e98-428e-9463-373f5b5de618 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:29.116574 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-03e1aa71-6e98-428e-9463-373f5b5de618 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:29.122874 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-03e1aa71-6e98-428e-9463-373f5b5de618 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:29.124018 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-03e1aa71-6e98-428e-9463-373f5b5de618 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:29.124832 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-03e1aa71-6e98-428e-9463-373f5b5de618 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:29.125267 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-03e1aa71-6e98-428e-9463-373f5b5de618 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:29.185415 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-03e1aa71-6e98-428e-9463-373f5b5de618 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:29.193909 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-03e1aa71-6e98-428e-9463-373f5b5de618 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.081757 Mar 03 03:00:29.194465 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1605/3438] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:29 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:30.209907 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c1d46d0d-adb6-4d27-913c-a72e37296a5e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:30.210538 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c1d46d0d-adb6-4d27-913c-a72e37296a5e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:30.217396 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c1d46d0d-adb6-4d27-913c-a72e37296a5e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:30.217857 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c1d46d0d-adb6-4d27-913c-a72e37296a5e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:30.218638 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c1d46d0d-adb6-4d27-913c-a72e37296a5e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:30.219076 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c1d46d0d-adb6-4d27-913c-a72e37296a5e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:30.280429 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c1d46d0d-adb6-4d27-913c-a72e37296a5e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:30.288044 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c1d46d0d-adb6-4d27-913c-a72e37296a5e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.081993 Mar 03 03:00:30.288616 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1834/3439] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:30 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:31.305120 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-43822b6c-59a1-478e-956b-1a684d2984b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:31.305723 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-43822b6c-59a1-478e-956b-1a684d2984b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:31.312638 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-43822b6c-59a1-478e-956b-1a684d2984b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:31.313085 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-43822b6c-59a1-478e-956b-1a684d2984b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:31.313852 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-43822b6c-59a1-478e-956b-1a684d2984b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:31.314284 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-43822b6c-59a1-478e-956b-1a684d2984b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:31.374690 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-43822b6c-59a1-478e-956b-1a684d2984b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:31.382258 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-43822b6c-59a1-478e-956b-1a684d2984b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.081025 Mar 03 03:00:31.382817 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1606/3440] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:31 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:32.398873 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-aafa60a0-8700-43d3-aecf-8920742fa38e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:32.399480 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-aafa60a0-8700-43d3-aecf-8920742fa38e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:32.406293 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aafa60a0-8700-43d3-aecf-8920742fa38e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:32.406750 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aafa60a0-8700-43d3-aecf-8920742fa38e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:32.407556 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aafa60a0-8700-43d3-aecf-8920742fa38e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:32.408027 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aafa60a0-8700-43d3-aecf-8920742fa38e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:32.469712 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-aafa60a0-8700-43d3-aecf-8920742fa38e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:32.477441 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-aafa60a0-8700-43d3-aecf-8920742fa38e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.082469 Mar 03 03:00:32.478005 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1835/3441] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:32 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:33.495923 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0f871791-2f4b-41ac-903c-d5d66f00c343 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:33.496526 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0f871791-2f4b-41ac-903c-d5d66f00c343 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:33.503390 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0f871791-2f4b-41ac-903c-d5d66f00c343 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:33.503872 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0f871791-2f4b-41ac-903c-d5d66f00c343 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:33.504660 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0f871791-2f4b-41ac-903c-d5d66f00c343 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:33.505100 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0f871791-2f4b-41ac-903c-d5d66f00c343 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:33.566072 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0f871791-2f4b-41ac-903c-d5d66f00c343 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:33.574130 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0f871791-2f4b-41ac-903c-d5d66f00c343 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.082170 Mar 03 03:00:33.574710 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1607/3442] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:33 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:34.590816 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ba828112-51f9-4f9a-8fb9-5777dd66aff3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:34.591444 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ba828112-51f9-4f9a-8fb9-5777dd66aff3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:34.597634 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ba828112-51f9-4f9a-8fb9-5777dd66aff3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:34.598078 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ba828112-51f9-4f9a-8fb9-5777dd66aff3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:34.598846 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ba828112-51f9-4f9a-8fb9-5777dd66aff3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:34.599282 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ba828112-51f9-4f9a-8fb9-5777dd66aff3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:34.657623 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ba828112-51f9-4f9a-8fb9-5777dd66aff3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:34.665110 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ba828112-51f9-4f9a-8fb9-5777dd66aff3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078146 Mar 03 03:00:34.665668 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1836/3443] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:34 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:35.682058 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-df5b7143-1e88-4e4e-8278-027686a412e7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:35.682693 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-df5b7143-1e88-4e4e-8278-027686a412e7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:35.688839 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-df5b7143-1e88-4e4e-8278-027686a412e7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:35.689288 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-df5b7143-1e88-4e4e-8278-027686a412e7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:35.690061 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-df5b7143-1e88-4e4e-8278-027686a412e7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:35.690494 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-df5b7143-1e88-4e4e-8278-027686a412e7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:35.748274 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-df5b7143-1e88-4e4e-8278-027686a412e7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:35.755893 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-df5b7143-1e88-4e4e-8278-027686a412e7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.077854 Mar 03 03:00:35.756451 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1608/3444] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:35 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:36.773495 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0eb86d24-081e-4181-87a2-5be8f076ba55 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:36.774060 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0eb86d24-081e-4181-87a2-5be8f076ba55 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:36.780291 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0eb86d24-081e-4181-87a2-5be8f076ba55 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:36.780746 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0eb86d24-081e-4181-87a2-5be8f076ba55 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:36.781526 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0eb86d24-081e-4181-87a2-5be8f076ba55 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:36.781964 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0eb86d24-081e-4181-87a2-5be8f076ba55 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:36.840471 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0eb86d24-081e-4181-87a2-5be8f076ba55 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:36.848582 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0eb86d24-081e-4181-87a2-5be8f076ba55 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079041 Mar 03 03:00:36.849163 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1837/3445] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:36 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:37.864722 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-17c9d665-7b7d-4f21-ac77-59aacbab8ccc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:37.865332 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-17c9d665-7b7d-4f21-ac77-59aacbab8ccc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:37.871650 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-17c9d665-7b7d-4f21-ac77-59aacbab8ccc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:37.872111 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-17c9d665-7b7d-4f21-ac77-59aacbab8ccc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:37.873428 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-17c9d665-7b7d-4f21-ac77-59aacbab8ccc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:37.873877 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-17c9d665-7b7d-4f21-ac77-59aacbab8ccc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:37.933364 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-17c9d665-7b7d-4f21-ac77-59aacbab8ccc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:37.942279 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-17c9d665-7b7d-4f21-ac77-59aacbab8ccc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.081342 Mar 03 03:00:37.942848 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1609/3446] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:37 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:38.959406 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-bd6d1082-299d-485f-b024-4040bd6729c3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:38.960029 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-bd6d1082-299d-485f-b024-4040bd6729c3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:38.966307 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bd6d1082-299d-485f-b024-4040bd6729c3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:38.966903 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bd6d1082-299d-485f-b024-4040bd6729c3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:38.967732 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bd6d1082-299d-485f-b024-4040bd6729c3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:38.968166 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bd6d1082-299d-485f-b024-4040bd6729c3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:39.026243 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-bd6d1082-299d-485f-b024-4040bd6729c3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:39.034438 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-bd6d1082-299d-485f-b024-4040bd6729c3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078889 Mar 03 03:00:39.034992 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1838/3447] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:38 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:40.051129 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a2d55692-ad7b-4d12-9426-c6681904964c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:40.051797 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a2d55692-ad7b-4d12-9426-c6681904964c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:40.058078 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a2d55692-ad7b-4d12-9426-c6681904964c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:40.058534 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a2d55692-ad7b-4d12-9426-c6681904964c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:40.059321 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a2d55692-ad7b-4d12-9426-c6681904964c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:40.059794 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a2d55692-ad7b-4d12-9426-c6681904964c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:40.118498 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a2d55692-ad7b-4d12-9426-c6681904964c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:40.126720 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a2d55692-ad7b-4d12-9426-c6681904964c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079587 Mar 03 03:00:40.127332 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1610/3448] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:40 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:41.143801 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6fda1e15-8eb8-4b8b-abb2-013188635050 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:41.144404 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6fda1e15-8eb8-4b8b-abb2-013188635050 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:41.150584 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6fda1e15-8eb8-4b8b-abb2-013188635050 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:41.151029 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6fda1e15-8eb8-4b8b-abb2-013188635050 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:41.151823 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6fda1e15-8eb8-4b8b-abb2-013188635050 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:41.152254 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6fda1e15-8eb8-4b8b-abb2-013188635050 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:41.210131 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6fda1e15-8eb8-4b8b-abb2-013188635050 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:41.217773 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6fda1e15-8eb8-4b8b-abb2-013188635050 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.077857 Mar 03 03:00:41.218338 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1839/3449] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:41 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:42.235303 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6f1524a3-75be-4c40-9a68-cc60dd24a450 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:42.235937 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6f1524a3-75be-4c40-9a68-cc60dd24a450 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:42.242189 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6f1524a3-75be-4c40-9a68-cc60dd24a450 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:42.242635 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6f1524a3-75be-4c40-9a68-cc60dd24a450 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:42.243406 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6f1524a3-75be-4c40-9a68-cc60dd24a450 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:42.243880 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6f1524a3-75be-4c40-9a68-cc60dd24a450 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:42.307172 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-6f1524a3-75be-4c40-9a68-cc60dd24a450 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:42.314830 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6f1524a3-75be-4c40-9a68-cc60dd24a450 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.084066 Mar 03 03:00:42.315429 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1611/3450] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:42 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:43.332029 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d44318d2-45a7-4cbd-9564-064337118849 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:43.332723 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d44318d2-45a7-4cbd-9564-064337118849 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:43.338929 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d44318d2-45a7-4cbd-9564-064337118849 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:43.339369 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d44318d2-45a7-4cbd-9564-064337118849 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:43.340179 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d44318d2-45a7-4cbd-9564-064337118849 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:43.340639 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d44318d2-45a7-4cbd-9564-064337118849 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:43.399725 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d44318d2-45a7-4cbd-9564-064337118849 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:43.407999 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d44318d2-45a7-4cbd-9564-064337118849 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079772 Mar 03 03:00:43.408557 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1840/3451] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:43 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:44.182237 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 03:00:44.182712 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: Thu Mar 3 03:00:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 03 03:00:44.425204 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d25d295e-0501-425d-9c16-f735ed1fa03d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:44.425815 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d25d295e-0501-425d-9c16-f735ed1fa03d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:44.432147 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d25d295e-0501-425d-9c16-f735ed1fa03d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:44.432605 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d25d295e-0501-425d-9c16-f735ed1fa03d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:44.433382 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d25d295e-0501-425d-9c16-f735ed1fa03d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:44.433824 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d25d295e-0501-425d-9c16-f735ed1fa03d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:44.492480 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d25d295e-0501-425d-9c16-f735ed1fa03d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:44.500220 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d25d295e-0501-425d-9c16-f735ed1fa03d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078859 Mar 03 03:00:44.500786 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1612/3452] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:44 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:45.516942 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-96f09a8a-d097-4eca-a3bb-f98435ce5579 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:45.517577 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-96f09a8a-d097-4eca-a3bb-f98435ce5579 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:45.523824 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-96f09a8a-d097-4eca-a3bb-f98435ce5579 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:45.524270 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-96f09a8a-d097-4eca-a3bb-f98435ce5579 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:45.525034 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-96f09a8a-d097-4eca-a3bb-f98435ce5579 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:45.525463 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-96f09a8a-d097-4eca-a3bb-f98435ce5579 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:45.586586 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-96f09a8a-d097-4eca-a3bb-f98435ce5579 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:45.594408 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-96f09a8a-d097-4eca-a3bb-f98435ce5579 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.081418 Mar 03 03:00:45.594962 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1841/3453] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:45 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:46.612006 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a0918e9a-0575-4349-806d-5f5c784497a6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:46.612716 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a0918e9a-0575-4349-806d-5f5c784497a6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:46.618936 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a0918e9a-0575-4349-806d-5f5c784497a6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:46.619386 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a0918e9a-0575-4349-806d-5f5c784497a6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:46.620182 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a0918e9a-0575-4349-806d-5f5c784497a6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:46.620618 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a0918e9a-0575-4349-806d-5f5c784497a6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:46.680186 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a0918e9a-0575-4349-806d-5f5c784497a6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:46.687774 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a0918e9a-0575-4349-806d-5f5c784497a6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079542 Mar 03 03:00:46.688334 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1613/3454] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:46 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:47.705568 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-68c1e64c-44ae-4071-a232-d2a1b691e4d3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:47.706203 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-68c1e64c-44ae-4071-a232-d2a1b691e4d3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:47.712431 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-68c1e64c-44ae-4071-a232-d2a1b691e4d3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:47.712887 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-68c1e64c-44ae-4071-a232-d2a1b691e4d3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:47.713668 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-68c1e64c-44ae-4071-a232-d2a1b691e4d3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:47.714111 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-68c1e64c-44ae-4071-a232-d2a1b691e4d3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:47.772770 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-68c1e64c-44ae-4071-a232-d2a1b691e4d3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:47.780365 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-68c1e64c-44ae-4071-a232-d2a1b691e4d3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079265 Mar 03 03:00:47.780929 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1842/3455] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:47 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:48.797299 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8ecf56cf-4ab1-47fc-a63b-f3acb3f29661 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:48.797950 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8ecf56cf-4ab1-47fc-a63b-f3acb3f29661 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:48.804292 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8ecf56cf-4ab1-47fc-a63b-f3acb3f29661 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:48.804746 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8ecf56cf-4ab1-47fc-a63b-f3acb3f29661 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:48.805529 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8ecf56cf-4ab1-47fc-a63b-f3acb3f29661 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:48.805975 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8ecf56cf-4ab1-47fc-a63b-f3acb3f29661 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:48.865810 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8ecf56cf-4ab1-47fc-a63b-f3acb3f29661 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:48.874177 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8ecf56cf-4ab1-47fc-a63b-f3acb3f29661 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080947 Mar 03 03:00:48.874743 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1614/3456] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:48 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:49.890934 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-da17d2fe-4042-4229-84da-67fcf17a0080 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:49.891542 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-da17d2fe-4042-4229-84da-67fcf17a0080 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:49.897670 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-da17d2fe-4042-4229-84da-67fcf17a0080 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:49.898114 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-da17d2fe-4042-4229-84da-67fcf17a0080 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:49.898878 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-da17d2fe-4042-4229-84da-67fcf17a0080 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:49.899311 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-da17d2fe-4042-4229-84da-67fcf17a0080 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:49.957742 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-da17d2fe-4042-4229-84da-67fcf17a0080 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:49.965426 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-da17d2fe-4042-4229-84da-67fcf17a0080 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079107 Mar 03 03:00:49.965984 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1843/3457] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:49 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:50.983701 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e39dc9b5-5414-4f0f-8e2d-a2deed07cdb1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:50.984327 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e39dc9b5-5414-4f0f-8e2d-a2deed07cdb1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:50.990614 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e39dc9b5-5414-4f0f-8e2d-a2deed07cdb1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:50.991067 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e39dc9b5-5414-4f0f-8e2d-a2deed07cdb1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:50.991867 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e39dc9b5-5414-4f0f-8e2d-a2deed07cdb1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:50.992305 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e39dc9b5-5414-4f0f-8e2d-a2deed07cdb1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:51.051289 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e39dc9b5-5414-4f0f-8e2d-a2deed07cdb1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:51.059120 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e39dc9b5-5414-4f0f-8e2d-a2deed07cdb1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079794 Mar 03 03:00:51.059739 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1615/3458] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:50 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:52.077177 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c4813b62-f25c-4961-bcdc-d201f41197b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:52.077788 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c4813b62-f25c-4961-bcdc-d201f41197b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:52.084317 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c4813b62-f25c-4961-bcdc-d201f41197b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:52.084776 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c4813b62-f25c-4961-bcdc-d201f41197b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:52.085575 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c4813b62-f25c-4961-bcdc-d201f41197b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:52.086009 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c4813b62-f25c-4961-bcdc-d201f41197b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:52.144371 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c4813b62-f25c-4961-bcdc-d201f41197b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:52.152153 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c4813b62-f25c-4961-bcdc-d201f41197b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080537 Mar 03 03:00:52.152714 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1844/3459] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:52 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:53.168981 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-def8fd4c-6c9b-43d7-8413-e36b6877d16a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:53.170110 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-def8fd4c-6c9b-43d7-8413-e36b6877d16a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:53.176444 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-def8fd4c-6c9b-43d7-8413-e36b6877d16a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:53.176898 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-def8fd4c-6c9b-43d7-8413-e36b6877d16a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:53.177681 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-def8fd4c-6c9b-43d7-8413-e36b6877d16a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:53.178121 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-def8fd4c-6c9b-43d7-8413-e36b6877d16a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:53.236593 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-def8fd4c-6c9b-43d7-8413-e36b6877d16a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:53.244136 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-def8fd4c-6c9b-43d7-8413-e36b6877d16a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079009 Mar 03 03:00:53.244703 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1616/3460] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:53 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 03:00:54.260782 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-525e9a68-8144-47e0-99d3-b8b973d3ec27 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:54.261392 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-525e9a68-8144-47e0-99d3-b8b973d3ec27 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:54.268215 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-525e9a68-8144-47e0-99d3-b8b973d3ec27 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:54.268701 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-525e9a68-8144-47e0-99d3-b8b973d3ec27 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:54.269479 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-525e9a68-8144-47e0-99d3-b8b973d3ec27 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:54.269923 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-525e9a68-8144-47e0-99d3-b8b973d3ec27 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:54.328812 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-525e9a68-8144-47e0-99d3-b8b973d3ec27 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:54.336435 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-525e9a68-8144-47e0-99d3-b8b973d3ec27 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079527 Mar 03 03:00:54.337004 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1845/3461] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:54 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:55.353558 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f79d96f2-f7ad-4e7b-ab99-18f259d34ff3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:55.354169 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f79d96f2-f7ad-4e7b-ab99-18f259d34ff3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:55.361099 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f79d96f2-f7ad-4e7b-ab99-18f259d34ff3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:55.361558 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f79d96f2-f7ad-4e7b-ab99-18f259d34ff3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:55.362338 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f79d96f2-f7ad-4e7b-ab99-18f259d34ff3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:55.362775 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f79d96f2-f7ad-4e7b-ab99-18f259d34ff3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:55.424654 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f79d96f2-f7ad-4e7b-ab99-18f259d34ff3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:55.432298 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f79d96f2-f7ad-4e7b-ab99-18f259d34ff3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.082987 Mar 03 03:00:55.432855 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1617/3462] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:55 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:56.448618 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-378d35c9-bb60-49e4-8f58-0322dac0dfb3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:56.449220 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-378d35c9-bb60-49e4-8f58-0322dac0dfb3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:56.456224 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-378d35c9-bb60-49e4-8f58-0322dac0dfb3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:56.456667 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-378d35c9-bb60-49e4-8f58-0322dac0dfb3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:56.457430 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-378d35c9-bb60-49e4-8f58-0322dac0dfb3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:56.457861 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-378d35c9-bb60-49e4-8f58-0322dac0dfb3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:56.517852 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-378d35c9-bb60-49e4-8f58-0322dac0dfb3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:56.525505 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-378d35c9-bb60-49e4-8f58-0322dac0dfb3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080710 Mar 03 03:00:56.526082 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1846/3463] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:56 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:57.542033 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b6baef66-84ee-42af-b93d-0f2738a825aa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:57.542672 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b6baef66-84ee-42af-b93d-0f2738a825aa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:57.548947 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b6baef66-84ee-42af-b93d-0f2738a825aa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:57.549403 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b6baef66-84ee-42af-b93d-0f2738a825aa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:57.550176 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b6baef66-84ee-42af-b93d-0f2738a825aa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:57.550618 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b6baef66-84ee-42af-b93d-0f2738a825aa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:57.609693 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b6baef66-84ee-42af-b93d-0f2738a825aa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:57.617371 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b6baef66-84ee-42af-b93d-0f2738a825aa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079263 Mar 03 03:00:57.617943 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1618/3464] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:57 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:58.634015 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5c3be37c-3d51-42ab-8c63-441dd98bd420 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:58.634622 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5c3be37c-3d51-42ab-8c63-441dd98bd420 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:58.641066 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5c3be37c-3d51-42ab-8c63-441dd98bd420 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:58.641518 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5c3be37c-3d51-42ab-8c63-441dd98bd420 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:58.642290 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5c3be37c-3d51-42ab-8c63-441dd98bd420 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:58.642730 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5c3be37c-3d51-42ab-8c63-441dd98bd420 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:58.703450 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5c3be37c-3d51-42ab-8c63-441dd98bd420 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:58.711116 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5c3be37c-3d51-42ab-8c63-441dd98bd420 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080908 Mar 03 03:00:58.711696 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1847/3465] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:58 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:00:59.728673 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0147441c-4853-4dae-b53e-e92c11223c67 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:00:59.729317 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0147441c-4853-4dae-b53e-e92c11223c67 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:00:59.735435 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0147441c-4853-4dae-b53e-e92c11223c67 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:59.735913 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0147441c-4853-4dae-b53e-e92c11223c67 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:59.736691 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0147441c-4853-4dae-b53e-e92c11223c67 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:00:59.737131 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0147441c-4853-4dae-b53e-e92c11223c67 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:00:59.798251 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0147441c-4853-4dae-b53e-e92c11223c67 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:00:59.806068 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0147441c-4853-4dae-b53e-e92c11223c67 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.081535 Mar 03 03:00:59.806640 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1619/3466] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:00:59 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:00.822185 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3af97284-d28e-4805-abcf-8f8b15531dd1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:00.822777 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3af97284-d28e-4805-abcf-8f8b15531dd1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:00.829644 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3af97284-d28e-4805-abcf-8f8b15531dd1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:00.830090 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3af97284-d28e-4805-abcf-8f8b15531dd1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:00.830864 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3af97284-d28e-4805-abcf-8f8b15531dd1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:00.831297 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3af97284-d28e-4805-abcf-8f8b15531dd1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:00.890612 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-3af97284-d28e-4805-abcf-8f8b15531dd1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:00.898211 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3af97284-d28e-4805-abcf-8f8b15531dd1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079897 Mar 03 03:01:00.898770 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1848/3467] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:00 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:01.915642 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-83c7c260-65a8-4b43-8d8f-e375f5599b63 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:01.916241 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-83c7c260-65a8-4b43-8d8f-e375f5599b63 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:01.922854 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-83c7c260-65a8-4b43-8d8f-e375f5599b63 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:01.923301 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-83c7c260-65a8-4b43-8d8f-e375f5599b63 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:01.924108 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-83c7c260-65a8-4b43-8d8f-e375f5599b63 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:01.924539 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-83c7c260-65a8-4b43-8d8f-e375f5599b63 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:01.986180 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-83c7c260-65a8-4b43-8d8f-e375f5599b63 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:01.993757 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-83c7c260-65a8-4b43-8d8f-e375f5599b63 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.082022 Mar 03 03:01:01.994313 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1620/3468] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:01 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:03.010972 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9fef60f2-0a18-4237-9f71-bfaaefb0b4ba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:03.011617 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9fef60f2-0a18-4237-9f71-bfaaefb0b4ba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:03.018531 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9fef60f2-0a18-4237-9f71-bfaaefb0b4ba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:03.018975 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9fef60f2-0a18-4237-9f71-bfaaefb0b4ba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:03.019779 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9fef60f2-0a18-4237-9f71-bfaaefb0b4ba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:03.020213 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9fef60f2-0a18-4237-9f71-bfaaefb0b4ba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:03.080955 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9fef60f2-0a18-4237-9f71-bfaaefb0b4ba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:03.088638 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9fef60f2-0a18-4237-9f71-bfaaefb0b4ba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.081540 Mar 03 03:01:03.089193 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1849/3469] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:03 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:04.105977 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f4d7b3c7-e78c-423a-a4f4-c564b64d45bb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:04.106627 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f4d7b3c7-e78c-423a-a4f4-c564b64d45bb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:04.112861 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f4d7b3c7-e78c-423a-a4f4-c564b64d45bb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:04.113311 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f4d7b3c7-e78c-423a-a4f4-c564b64d45bb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:04.114085 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f4d7b3c7-e78c-423a-a4f4-c564b64d45bb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:04.114519 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f4d7b3c7-e78c-423a-a4f4-c564b64d45bb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:04.174631 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f4d7b3c7-e78c-423a-a4f4-c564b64d45bb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:04.182529 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f4d7b3c7-e78c-423a-a4f4-c564b64d45bb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080667 Mar 03 03:01:04.183094 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1621/3470] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:04 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:05.200684 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-aa664207-09e3-4499-9d28-20996dcd3750 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:05.201312 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-aa664207-09e3-4499-9d28-20996dcd3750 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:05.207217 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aa664207-09e3-4499-9d28-20996dcd3750 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:05.207704 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aa664207-09e3-4499-9d28-20996dcd3750 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:05.208487 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aa664207-09e3-4499-9d28-20996dcd3750 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:05.208928 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aa664207-09e3-4499-9d28-20996dcd3750 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:05.268934 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-aa664207-09e3-4499-9d28-20996dcd3750 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:05.276649 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-aa664207-09e3-4499-9d28-20996dcd3750 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080405 Mar 03 03:01:05.277211 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1850/3471] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:05 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:06.294429 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b2d153c9-afb9-4160-80e6-d06d8deafe76 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:06.295035 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b2d153c9-afb9-4160-80e6-d06d8deafe76 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:06.300910 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b2d153c9-afb9-4160-80e6-d06d8deafe76 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:06.301369 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b2d153c9-afb9-4160-80e6-d06d8deafe76 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:06.302117 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b2d153c9-afb9-4160-80e6-d06d8deafe76 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:06.302594 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b2d153c9-afb9-4160-80e6-d06d8deafe76 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:06.360644 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b2d153c9-afb9-4160-80e6-d06d8deafe76 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:06.368173 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b2d153c9-afb9-4160-80e6-d06d8deafe76 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.077928 Mar 03 03:01:06.368742 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1622/3472] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:06 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:07.385536 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f52b280a-68ab-47be-b3db-9a80e9868281 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:07.386143 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f52b280a-68ab-47be-b3db-9a80e9868281 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:07.392394 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f52b280a-68ab-47be-b3db-9a80e9868281 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:07.392845 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f52b280a-68ab-47be-b3db-9a80e9868281 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:07.393617 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f52b280a-68ab-47be-b3db-9a80e9868281 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:07.394056 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f52b280a-68ab-47be-b3db-9a80e9868281 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:07.452088 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f52b280a-68ab-47be-b3db-9a80e9868281 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:07.459642 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f52b280a-68ab-47be-b3db-9a80e9868281 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078039 Mar 03 03:01:07.460204 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1851/3473] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:07 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:08.476369 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4cc0c3ce-b2cb-4dee-80cf-e2c970f705d1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:08.476921 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4cc0c3ce-b2cb-4dee-80cf-e2c970f705d1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:08.483751 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4cc0c3ce-b2cb-4dee-80cf-e2c970f705d1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:08.484212 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4cc0c3ce-b2cb-4dee-80cf-e2c970f705d1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:08.484996 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4cc0c3ce-b2cb-4dee-80cf-e2c970f705d1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:08.485437 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4cc0c3ce-b2cb-4dee-80cf-e2c970f705d1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:08.548836 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4cc0c3ce-b2cb-4dee-80cf-e2c970f705d1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:08.556779 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4cc0c3ce-b2cb-4dee-80cf-e2c970f705d1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.084334 Mar 03 03:01:08.557547 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1623/3474] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:08 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:09.573940 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6298555e-085c-4320-9b53-4cf6209f4895 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:09.574539 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6298555e-085c-4320-9b53-4cf6209f4895 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:09.581317 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6298555e-085c-4320-9b53-4cf6209f4895 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:09.581767 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6298555e-085c-4320-9b53-4cf6209f4895 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:09.582541 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6298555e-085c-4320-9b53-4cf6209f4895 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:09.582980 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6298555e-085c-4320-9b53-4cf6209f4895 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:09.641166 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6298555e-085c-4320-9b53-4cf6209f4895 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:09.648737 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6298555e-085c-4320-9b53-4cf6209f4895 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078651 Mar 03 03:01:09.649289 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1852/3475] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:09 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:10.666218 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-09beab4f-68d4-4a5e-bc7a-b60d8f8bebd0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:10.666826 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-09beab4f-68d4-4a5e-bc7a-b60d8f8bebd0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:10.673682 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-09beab4f-68d4-4a5e-bc7a-b60d8f8bebd0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:10.674136 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-09beab4f-68d4-4a5e-bc7a-b60d8f8bebd0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:10.674907 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-09beab4f-68d4-4a5e-bc7a-b60d8f8bebd0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:10.675348 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-09beab4f-68d4-4a5e-bc7a-b60d8f8bebd0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:10.736175 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-09beab4f-68d4-4a5e-bc7a-b60d8f8bebd0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:10.743888 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-09beab4f-68d4-4a5e-bc7a-b60d8f8bebd0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.081507 Mar 03 03:01:10.744446 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1624/3476] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:10 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 03:01:11.760688 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-84864816-2b2c-4817-a2e6-f86645f5b1ce tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:11.761288 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-84864816-2b2c-4817-a2e6-f86645f5b1ce tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:11.768486 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-84864816-2b2c-4817-a2e6-f86645f5b1ce tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:11.768939 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-84864816-2b2c-4817-a2e6-f86645f5b1ce tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:11.769717 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-84864816-2b2c-4817-a2e6-f86645f5b1ce tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:11.770155 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-84864816-2b2c-4817-a2e6-f86645f5b1ce tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:11.834430 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-84864816-2b2c-4817-a2e6-f86645f5b1ce tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:11.842762 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-84864816-2b2c-4817-a2e6-f86645f5b1ce tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.085268 Mar 03 03:01:11.843378 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1853/3477] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:11 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:12.860354 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-58a8e0a5-10f8-4581-9259-491639b247a6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:12.860955 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-58a8e0a5-10f8-4581-9259-491639b247a6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:12.867134 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-58a8e0a5-10f8-4581-9259-491639b247a6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:12.867582 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-58a8e0a5-10f8-4581-9259-491639b247a6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:12.868374 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-58a8e0a5-10f8-4581-9259-491639b247a6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:12.868807 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-58a8e0a5-10f8-4581-9259-491639b247a6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:12.927492 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-58a8e0a5-10f8-4581-9259-491639b247a6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:12.935380 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-58a8e0a5-10f8-4581-9259-491639b247a6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079585 Mar 03 03:01:12.936006 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1625/3478] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:12 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:13.953017 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-58c8a348-5a6b-46ce-a65a-4bdffe7a14f6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:13.953616 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-58c8a348-5a6b-46ce-a65a-4bdffe7a14f6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:13.959732 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-58c8a348-5a6b-46ce-a65a-4bdffe7a14f6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:13.960177 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-58c8a348-5a6b-46ce-a65a-4bdffe7a14f6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:13.960945 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-58c8a348-5a6b-46ce-a65a-4bdffe7a14f6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:13.961376 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-58c8a348-5a6b-46ce-a65a-4bdffe7a14f6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:14.020697 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-58c8a348-5a6b-46ce-a65a-4bdffe7a14f6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:14.028443 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-58c8a348-5a6b-46ce-a65a-4bdffe7a14f6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080018 Mar 03 03:01:14.029006 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1854/3479] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:13 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:15.045801 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-019cebc8-3d72-4704-8e4e-79fe017203f5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:15.046348 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-019cebc8-3d72-4704-8e4e-79fe017203f5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:15.052791 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-019cebc8-3d72-4704-8e4e-79fe017203f5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:15.053047 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-019cebc8-3d72-4704-8e4e-79fe017203f5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:15.053819 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-019cebc8-3d72-4704-8e4e-79fe017203f5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:15.054251 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-019cebc8-3d72-4704-8e4e-79fe017203f5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:15.114296 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-019cebc8-3d72-4704-8e4e-79fe017203f5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:15.121850 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-019cebc8-3d72-4704-8e4e-79fe017203f5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080052 Mar 03 03:01:15.122405 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1626/3480] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:15 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:16.139998 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-60199b9c-af3a-493e-bbe9-9d059af4d391 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:16.140644 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-60199b9c-af3a-493e-bbe9-9d059af4d391 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:16.146908 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-60199b9c-af3a-493e-bbe9-9d059af4d391 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:16.147361 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-60199b9c-af3a-493e-bbe9-9d059af4d391 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:16.148169 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-60199b9c-af3a-493e-bbe9-9d059af4d391 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:16.148615 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-60199b9c-af3a-493e-bbe9-9d059af4d391 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:16.208017 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-60199b9c-af3a-493e-bbe9-9d059af4d391 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:16.215653 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-60199b9c-af3a-493e-bbe9-9d059af4d391 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080492 Mar 03 03:01:16.216211 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1855/3481] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:16 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:17.233189 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d71cdbe5-c63c-42ab-ae95-c65c8536bc92 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:17.233787 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d71cdbe5-c63c-42ab-ae95-c65c8536bc92 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:17.240031 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d71cdbe5-c63c-42ab-ae95-c65c8536bc92 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:17.240478 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d71cdbe5-c63c-42ab-ae95-c65c8536bc92 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:17.241242 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d71cdbe5-c63c-42ab-ae95-c65c8536bc92 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:17.241687 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d71cdbe5-c63c-42ab-ae95-c65c8536bc92 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:17.298737 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d71cdbe5-c63c-42ab-ae95-c65c8536bc92 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:17.306322 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d71cdbe5-c63c-42ab-ae95-c65c8536bc92 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.076953 Mar 03 03:01:17.306818 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1627/3482] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:17 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:18.323245 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9745a618-a67c-42ee-a174-04ffa86d3f61 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:18.323872 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9745a618-a67c-42ee-a174-04ffa86d3f61 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:18.330851 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9745a618-a67c-42ee-a174-04ffa86d3f61 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:18.331301 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9745a618-a67c-42ee-a174-04ffa86d3f61 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:18.332105 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9745a618-a67c-42ee-a174-04ffa86d3f61 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:18.332537 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9745a618-a67c-42ee-a174-04ffa86d3f61 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:18.390517 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9745a618-a67c-42ee-a174-04ffa86d3f61 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:18.398048 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9745a618-a67c-42ee-a174-04ffa86d3f61 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078618 Mar 03 03:01:18.398611 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1856/3483] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:18 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:19.414489 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-be03b64d-0582-41fa-bf81-ca79bb9951be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:19.415082 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-be03b64d-0582-41fa-bf81-ca79bb9951be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:19.421331 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-be03b64d-0582-41fa-bf81-ca79bb9951be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:19.421779 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-be03b64d-0582-41fa-bf81-ca79bb9951be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:19.422551 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-be03b64d-0582-41fa-bf81-ca79bb9951be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:19.423019 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-be03b64d-0582-41fa-bf81-ca79bb9951be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:19.481374 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-be03b64d-0582-41fa-bf81-ca79bb9951be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:19.489371 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-be03b64d-0582-41fa-bf81-ca79bb9951be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078827 Mar 03 03:01:19.489935 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1628/3484] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:19 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:20.507132 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d7eb29d3-a9c9-499d-a81f-c4fc70a269f9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:20.507765 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d7eb29d3-a9c9-499d-a81f-c4fc70a269f9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:20.514110 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d7eb29d3-a9c9-499d-a81f-c4fc70a269f9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:20.514642 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d7eb29d3-a9c9-499d-a81f-c4fc70a269f9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:20.515551 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d7eb29d3-a9c9-499d-a81f-c4fc70a269f9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:20.516012 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d7eb29d3-a9c9-499d-a81f-c4fc70a269f9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:20.573648 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d7eb29d3-a9c9-499d-a81f-c4fc70a269f9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:20.581174 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d7eb29d3-a9c9-499d-a81f-c4fc70a269f9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.077842 Mar 03 03:01:20.581739 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1857/3485] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:20 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:21.597248 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-026305c6-f5b4-4d24-bd6a-2ea05cc394c3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:21.597915 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-026305c6-f5b4-4d24-bd6a-2ea05cc394c3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:21.604354 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-026305c6-f5b4-4d24-bd6a-2ea05cc394c3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:21.604811 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-026305c6-f5b4-4d24-bd6a-2ea05cc394c3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:21.605584 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-026305c6-f5b4-4d24-bd6a-2ea05cc394c3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:21.606023 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-026305c6-f5b4-4d24-bd6a-2ea05cc394c3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:21.667489 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-026305c6-f5b4-4d24-bd6a-2ea05cc394c3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:21.675777 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-026305c6-f5b4-4d24-bd6a-2ea05cc394c3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.082373 Mar 03 03:01:21.676342 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1629/3486] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:21 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:22.692595 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6ea78ad6-cbd7-4c06-b260-0e8fdf38cde5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:22.693209 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6ea78ad6-cbd7-4c06-b260-0e8fdf38cde5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:22.699446 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6ea78ad6-cbd7-4c06-b260-0e8fdf38cde5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:22.699931 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6ea78ad6-cbd7-4c06-b260-0e8fdf38cde5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:22.700710 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6ea78ad6-cbd7-4c06-b260-0e8fdf38cde5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:22.701167 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6ea78ad6-cbd7-4c06-b260-0e8fdf38cde5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:22.759162 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6ea78ad6-cbd7-4c06-b260-0e8fdf38cde5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:22.766903 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6ea78ad6-cbd7-4c06-b260-0e8fdf38cde5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078247 Mar 03 03:01:22.767470 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1858/3487] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:22 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:23.782702 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7a412ccc-f95c-4ab3-9e38-d567761b11fe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:23.783319 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7a412ccc-f95c-4ab3-9e38-d567761b11fe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:23.789578 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7a412ccc-f95c-4ab3-9e38-d567761b11fe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:23.790030 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7a412ccc-f95c-4ab3-9e38-d567761b11fe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:23.790807 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7a412ccc-f95c-4ab3-9e38-d567761b11fe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:23.791281 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7a412ccc-f95c-4ab3-9e38-d567761b11fe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:23.850311 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-7a412ccc-f95c-4ab3-9e38-d567761b11fe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:23.859124 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7a412ccc-f95c-4ab3-9e38-d567761b11fe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080224 Mar 03 03:01:23.859739 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1630/3488] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:23 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:24.876653 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-bbf13ed1-ad9f-4f90-9846-a539f50c87d8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:24.877322 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-bbf13ed1-ad9f-4f90-9846-a539f50c87d8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:24.883527 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bbf13ed1-ad9f-4f90-9846-a539f50c87d8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:24.884007 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bbf13ed1-ad9f-4f90-9846-a539f50c87d8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:24.884782 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bbf13ed1-ad9f-4f90-9846-a539f50c87d8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:24.885222 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bbf13ed1-ad9f-4f90-9846-a539f50c87d8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:24.945776 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-bbf13ed1-ad9f-4f90-9846-a539f50c87d8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:24.954022 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-bbf13ed1-ad9f-4f90-9846-a539f50c87d8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.081712 Mar 03 03:01:24.954585 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1859/3489] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:24 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:25.970836 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c476ba58-af24-42e6-9e52-41d4e7d7c2e8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:25.971443 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c476ba58-af24-42e6-9e52-41d4e7d7c2e8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:25.977629 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c476ba58-af24-42e6-9e52-41d4e7d7c2e8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:25.978330 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c476ba58-af24-42e6-9e52-41d4e7d7c2e8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:25.979103 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c476ba58-af24-42e6-9e52-41d4e7d7c2e8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:25.979536 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c476ba58-af24-42e6-9e52-41d4e7d7c2e8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:26.039863 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c476ba58-af24-42e6-9e52-41d4e7d7c2e8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:26.047927 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c476ba58-af24-42e6-9e52-41d4e7d7c2e8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.081499 Mar 03 03:01:26.048499 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1631/3490] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:25 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:27.064920 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-397fc96e-a01b-4751-9cbb-cefbceeeae04 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:27.065529 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-397fc96e-a01b-4751-9cbb-cefbceeeae04 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:27.071773 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-397fc96e-a01b-4751-9cbb-cefbceeeae04 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:27.072225 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-397fc96e-a01b-4751-9cbb-cefbceeeae04 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:27.072994 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-397fc96e-a01b-4751-9cbb-cefbceeeae04 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:27.073430 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-397fc96e-a01b-4751-9cbb-cefbceeeae04 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:27.133676 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-397fc96e-a01b-4751-9cbb-cefbceeeae04 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:27.142082 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-397fc96e-a01b-4751-9cbb-cefbceeeae04 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.081472 Mar 03 03:01:27.142645 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1860/3491] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:27 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:28.159801 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4bfe1537-bc3f-47f7-9372-bf43e204f2f9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:28.160442 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4bfe1537-bc3f-47f7-9372-bf43e204f2f9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:28.166734 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4bfe1537-bc3f-47f7-9372-bf43e204f2f9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:28.167186 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4bfe1537-bc3f-47f7-9372-bf43e204f2f9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:28.168022 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4bfe1537-bc3f-47f7-9372-bf43e204f2f9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:28.168460 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4bfe1537-bc3f-47f7-9372-bf43e204f2f9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:28.227374 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4bfe1537-bc3f-47f7-9372-bf43e204f2f9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:28.235830 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4bfe1537-bc3f-47f7-9372-bf43e204f2f9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079947 Mar 03 03:01:28.236402 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1632/3492] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:28 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:29.252896 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a0f2d3af-2413-4f84-868c-e249c25e2332 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:29.253505 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a0f2d3af-2413-4f84-868c-e249c25e2332 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:29.259813 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a0f2d3af-2413-4f84-868c-e249c25e2332 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:29.260273 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a0f2d3af-2413-4f84-868c-e249c25e2332 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:29.261053 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a0f2d3af-2413-4f84-868c-e249c25e2332 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:29.261492 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a0f2d3af-2413-4f84-868c-e249c25e2332 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:29.319639 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a0f2d3af-2413-4f84-868c-e249c25e2332 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:29.328042 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a0f2d3af-2413-4f84-868c-e249c25e2332 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078981 Mar 03 03:01:29.328611 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1861/3493] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:29 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:30.345327 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6b407ac1-fcbb-482b-be6e-eda628ab335d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:30.345945 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6b407ac1-fcbb-482b-be6e-eda628ab335d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:30.352214 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6b407ac1-fcbb-482b-be6e-eda628ab335d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:30.352670 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6b407ac1-fcbb-482b-be6e-eda628ab335d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:30.353707 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6b407ac1-fcbb-482b-be6e-eda628ab335d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:30.354149 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6b407ac1-fcbb-482b-be6e-eda628ab335d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:30.414108 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-6b407ac1-fcbb-482b-be6e-eda628ab335d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:30.421829 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6b407ac1-fcbb-482b-be6e-eda628ab335d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080876 Mar 03 03:01:30.422403 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1633/3494] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:30 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:31.437957 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4f7efc11-b29c-4a81-948a-39048838d8ac tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:31.438561 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4f7efc11-b29c-4a81-948a-39048838d8ac tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:31.444816 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4f7efc11-b29c-4a81-948a-39048838d8ac tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:31.445258 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4f7efc11-b29c-4a81-948a-39048838d8ac tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:31.446034 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4f7efc11-b29c-4a81-948a-39048838d8ac tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:31.446467 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4f7efc11-b29c-4a81-948a-39048838d8ac tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:31.512663 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4f7efc11-b29c-4a81-948a-39048838d8ac tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:31.521274 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4f7efc11-b29c-4a81-948a-39048838d8ac tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.087280 Mar 03 03:01:31.521836 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1862/3495] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:31 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:32.538340 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f792a8a0-474e-472d-bc37-a7d961b4aa3b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:32.538952 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f792a8a0-474e-472d-bc37-a7d961b4aa3b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:32.546271 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f792a8a0-474e-472d-bc37-a7d961b4aa3b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:32.546724 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f792a8a0-474e-472d-bc37-a7d961b4aa3b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:32.547511 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f792a8a0-474e-472d-bc37-a7d961b4aa3b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:32.547974 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f792a8a0-474e-472d-bc37-a7d961b4aa3b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:32.605901 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f792a8a0-474e-472d-bc37-a7d961b4aa3b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:32.614342 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f792a8a0-474e-472d-bc37-a7d961b4aa3b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079868 Mar 03 03:01:32.614945 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1634/3496] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:32 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:33.630628 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-74f2abee-c646-4306-9527-903f8f58923a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:33.631043 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-74f2abee-c646-4306-9527-903f8f58923a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:33.637285 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-74f2abee-c646-4306-9527-903f8f58923a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:33.637737 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-74f2abee-c646-4306-9527-903f8f58923a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:33.638581 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-74f2abee-c646-4306-9527-903f8f58923a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:33.639282 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-74f2abee-c646-4306-9527-903f8f58923a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:33.697644 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-74f2abee-c646-4306-9527-903f8f58923a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:33.705723 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-74f2abee-c646-4306-9527-903f8f58923a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079132 Mar 03 03:01:33.706293 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1863/3497] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:33 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 03:01:34.722474 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a1fe76a2-3a6f-4095-9cc4-3cd6711fb16b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:34.723115 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a1fe76a2-3a6f-4095-9cc4-3cd6711fb16b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:34.729581 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a1fe76a2-3a6f-4095-9cc4-3cd6711fb16b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:34.730035 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a1fe76a2-3a6f-4095-9cc4-3cd6711fb16b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:34.730805 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a1fe76a2-3a6f-4095-9cc4-3cd6711fb16b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:34.731241 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a1fe76a2-3a6f-4095-9cc4-3cd6711fb16b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:34.795437 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a1fe76a2-3a6f-4095-9cc4-3cd6711fb16b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:34.803313 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a1fe76a2-3a6f-4095-9cc4-3cd6711fb16b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.084666 Mar 03 03:01:34.803904 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1635/3498] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:34 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:35.821036 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-08265d13-3432-413c-9391-a25bf00d768d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:35.821657 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-08265d13-3432-413c-9391-a25bf00d768d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:35.827592 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-08265d13-3432-413c-9391-a25bf00d768d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:35.828067 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-08265d13-3432-413c-9391-a25bf00d768d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:35.828841 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-08265d13-3432-413c-9391-a25bf00d768d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:35.829280 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-08265d13-3432-413c-9391-a25bf00d768d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:35.886801 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-08265d13-3432-413c-9391-a25bf00d768d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:35.894729 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-08265d13-3432-413c-9391-a25bf00d768d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.077544 Mar 03 03:01:35.895301 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1864/3499] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:35 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:36.912300 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-596113d1-b259-4dfe-ac88-6f1a86ef8bd2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:36.912927 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-596113d1-b259-4dfe-ac88-6f1a86ef8bd2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:36.918772 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-596113d1-b259-4dfe-ac88-6f1a86ef8bd2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:36.919240 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-596113d1-b259-4dfe-ac88-6f1a86ef8bd2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:36.920026 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-596113d1-b259-4dfe-ac88-6f1a86ef8bd2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:36.920469 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-596113d1-b259-4dfe-ac88-6f1a86ef8bd2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:36.981448 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-596113d1-b259-4dfe-ac88-6f1a86ef8bd2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:36.989729 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-596113d1-b259-4dfe-ac88-6f1a86ef8bd2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.081241 Mar 03 03:01:36.990302 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1636/3500] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:36 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:38.008731 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0d0258aa-a2db-4fdb-9b72-0f0e8e365d48 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:38.009338 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0d0258aa-a2db-4fdb-9b72-0f0e8e365d48 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:38.016329 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0d0258aa-a2db-4fdb-9b72-0f0e8e365d48 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:38.016778 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0d0258aa-a2db-4fdb-9b72-0f0e8e365d48 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:38.017550 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0d0258aa-a2db-4fdb-9b72-0f0e8e365d48 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:38.017985 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0d0258aa-a2db-4fdb-9b72-0f0e8e365d48 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:38.079179 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0d0258aa-a2db-4fdb-9b72-0f0e8e365d48 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:38.086861 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0d0258aa-a2db-4fdb-9b72-0f0e8e365d48 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.082079 Mar 03 03:01:38.087418 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1865/3501] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:38 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:39.104666 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e6d91cf4-ac22-4b9e-96d6-689e32d66027 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:39.105274 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e6d91cf4-ac22-4b9e-96d6-689e32d66027 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:39.112429 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e6d91cf4-ac22-4b9e-96d6-689e32d66027 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:39.112880 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e6d91cf4-ac22-4b9e-96d6-689e32d66027 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:39.113682 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e6d91cf4-ac22-4b9e-96d6-689e32d66027 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:39.114118 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e6d91cf4-ac22-4b9e-96d6-689e32d66027 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:39.173249 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e6d91cf4-ac22-4b9e-96d6-689e32d66027 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:39.180954 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e6d91cf4-ac22-4b9e-96d6-689e32d66027 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080353 Mar 03 03:01:39.181554 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1637/3502] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:39 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:40.197643 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ca3e4650-8970-452d-867d-9d84e5fbf391 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:40.198243 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ca3e4650-8970-452d-867d-9d84e5fbf391 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:40.205058 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ca3e4650-8970-452d-867d-9d84e5fbf391 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:40.205505 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ca3e4650-8970-452d-867d-9d84e5fbf391 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:40.206267 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ca3e4650-8970-452d-867d-9d84e5fbf391 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:40.206698 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ca3e4650-8970-452d-867d-9d84e5fbf391 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:40.264558 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ca3e4650-8970-452d-867d-9d84e5fbf391 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:40.272125 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ca3e4650-8970-452d-867d-9d84e5fbf391 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078281 Mar 03 03:01:40.272691 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1866/3503] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:40 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:41.289362 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3c9291d6-2216-4e17-ac26-36e39170db11 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:41.289969 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3c9291d6-2216-4e17-ac26-36e39170db11 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:41.297097 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3c9291d6-2216-4e17-ac26-36e39170db11 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:41.297550 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3c9291d6-2216-4e17-ac26-36e39170db11 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:41.298327 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3c9291d6-2216-4e17-ac26-36e39170db11 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:41.298762 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3c9291d6-2216-4e17-ac26-36e39170db11 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:41.356610 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3c9291d6-2216-4e17-ac26-36e39170db11 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:41.365363 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3c9291d6-2216-4e17-ac26-36e39170db11 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079822 Mar 03 03:01:41.365929 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1638/3504] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:41 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:42.382479 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e206bda3-eae2-4af9-aa34-4236c9176c40 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:42.383075 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e206bda3-eae2-4af9-aa34-4236c9176c40 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:42.389280 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e206bda3-eae2-4af9-aa34-4236c9176c40 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:42.389726 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e206bda3-eae2-4af9-aa34-4236c9176c40 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:42.390495 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e206bda3-eae2-4af9-aa34-4236c9176c40 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:42.390926 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e206bda3-eae2-4af9-aa34-4236c9176c40 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:42.449901 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e206bda3-eae2-4af9-aa34-4236c9176c40 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:42.457980 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e206bda3-eae2-4af9-aa34-4236c9176c40 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079298 Mar 03 03:01:42.458532 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1867/3505] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:42 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:43.475156 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-aba6163c-f90d-4d5e-abf9-d9f987e93a33 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:43.475807 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-aba6163c-f90d-4d5e-abf9-d9f987e93a33 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:43.482958 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aba6163c-f90d-4d5e-abf9-d9f987e93a33 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:43.483407 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aba6163c-f90d-4d5e-abf9-d9f987e93a33 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:43.484205 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aba6163c-f90d-4d5e-abf9-d9f987e93a33 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:43.484640 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aba6163c-f90d-4d5e-abf9-d9f987e93a33 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:43.542432 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-aba6163c-f90d-4d5e-abf9-d9f987e93a33 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:43.550679 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-aba6163c-f90d-4d5e-abf9-d9f987e93a33 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079370 Mar 03 03:01:43.551235 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1639/3506] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:43 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:44.567272 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-64a6ed85-791a-48b4-86ad-57f4d6af2775 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:44.567916 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-64a6ed85-791a-48b4-86ad-57f4d6af2775 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:44.574046 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-64a6ed85-791a-48b4-86ad-57f4d6af2775 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:44.574492 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-64a6ed85-791a-48b4-86ad-57f4d6af2775 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:44.575259 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-64a6ed85-791a-48b4-86ad-57f4d6af2775 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:44.575819 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-64a6ed85-791a-48b4-86ad-57f4d6af2775 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:44.634395 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-64a6ed85-791a-48b4-86ad-57f4d6af2775 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:44.642235 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-64a6ed85-791a-48b4-86ad-57f4d6af2775 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078776 Mar 03 03:01:44.642796 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1868/3507] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:44 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:45.659551 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-762c9728-a351-4851-a82e-a0c7699974e1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:45.660179 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-762c9728-a351-4851-a82e-a0c7699974e1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:45.666320 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-762c9728-a351-4851-a82e-a0c7699974e1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:45.666766 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-762c9728-a351-4851-a82e-a0c7699974e1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:45.667535 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-762c9728-a351-4851-a82e-a0c7699974e1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:45.667995 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-762c9728-a351-4851-a82e-a0c7699974e1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:45.727806 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-762c9728-a351-4851-a82e-a0c7699974e1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:45.735586 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-762c9728-a351-4851-a82e-a0c7699974e1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079857 Mar 03 03:01:45.736162 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1640/3508] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:45 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 03:01:46.752774 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3cb0d0f9-4676-4172-b8e2-4f47f5be8276 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:46.753371 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3cb0d0f9-4676-4172-b8e2-4f47f5be8276 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:46.759624 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3cb0d0f9-4676-4172-b8e2-4f47f5be8276 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:46.760089 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3cb0d0f9-4676-4172-b8e2-4f47f5be8276 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:46.760866 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3cb0d0f9-4676-4172-b8e2-4f47f5be8276 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:46.761304 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3cb0d0f9-4676-4172-b8e2-4f47f5be8276 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:46.820599 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-3cb0d0f9-4676-4172-b8e2-4f47f5be8276 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:46.828727 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3cb0d0f9-4676-4172-b8e2-4f47f5be8276 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079877 Mar 03 03:01:46.829303 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1869/3509] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:46 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:47.846047 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d48ef675-6359-4ab8-ba21-3b5bfb854611 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:47.846670 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d48ef675-6359-4ab8-ba21-3b5bfb854611 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:47.853094 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d48ef675-6359-4ab8-ba21-3b5bfb854611 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:47.853543 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d48ef675-6359-4ab8-ba21-3b5bfb854611 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:47.854306 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d48ef675-6359-4ab8-ba21-3b5bfb854611 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:47.854739 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d48ef675-6359-4ab8-ba21-3b5bfb854611 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:47.917171 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d48ef675-6359-4ab8-ba21-3b5bfb854611 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:47.925158 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d48ef675-6359-4ab8-ba21-3b5bfb854611 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.083637 Mar 03 03:01:47.925731 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1641/3510] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:47 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:48.941917 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-20f04518-f38b-4102-9cea-7fbaf932565f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:48.942508 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-20f04518-f38b-4102-9cea-7fbaf932565f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:48.948768 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-20f04518-f38b-4102-9cea-7fbaf932565f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:48.949220 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-20f04518-f38b-4102-9cea-7fbaf932565f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:48.950000 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-20f04518-f38b-4102-9cea-7fbaf932565f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:48.950438 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-20f04518-f38b-4102-9cea-7fbaf932565f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:49.009949 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-20f04518-f38b-4102-9cea-7fbaf932565f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:49.018088 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-20f04518-f38b-4102-9cea-7fbaf932565f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080066 Mar 03 03:01:49.018655 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1870/3511] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:48 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:50.034987 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-dee50dcb-914e-4f3c-a401-9c4b743d28bc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:50.035619 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-dee50dcb-914e-4f3c-a401-9c4b743d28bc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:50.042046 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dee50dcb-914e-4f3c-a401-9c4b743d28bc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:50.042498 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dee50dcb-914e-4f3c-a401-9c4b743d28bc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:50.043276 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dee50dcb-914e-4f3c-a401-9c4b743d28bc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:50.043744 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dee50dcb-914e-4f3c-a401-9c4b743d28bc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:50.103921 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-dee50dcb-914e-4f3c-a401-9c4b743d28bc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:50.111714 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-dee50dcb-914e-4f3c-a401-9c4b743d28bc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080641 Mar 03 03:01:50.112275 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1642/3512] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:50 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:51.128246 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7c6b3c86-7fda-4aca-a45c-f74a4d89580c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:51.128847 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7c6b3c86-7fda-4aca-a45c-f74a4d89580c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:51.135011 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c6b3c86-7fda-4aca-a45c-f74a4d89580c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:51.135459 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c6b3c86-7fda-4aca-a45c-f74a4d89580c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:51.136267 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c6b3c86-7fda-4aca-a45c-f74a4d89580c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:51.136703 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7c6b3c86-7fda-4aca-a45c-f74a4d89580c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:51.198782 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-7c6b3c86-7fda-4aca-a45c-f74a4d89580c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:51.207584 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7c6b3c86-7fda-4aca-a45c-f74a4d89580c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.083119 Mar 03 03:01:51.208189 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1871/3513] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:51 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:52.224148 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b529d17f-b2a6-4f5b-9d57-8764e444a23b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:52.224761 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b529d17f-b2a6-4f5b-9d57-8764e444a23b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:52.231335 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b529d17f-b2a6-4f5b-9d57-8764e444a23b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:52.231861 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b529d17f-b2a6-4f5b-9d57-8764e444a23b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:52.232663 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b529d17f-b2a6-4f5b-9d57-8764e444a23b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:52.233090 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b529d17f-b2a6-4f5b-9d57-8764e444a23b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:52.295883 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b529d17f-b2a6-4f5b-9d57-8764e444a23b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:52.303673 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b529d17f-b2a6-4f5b-9d57-8764e444a23b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.083350 Mar 03 03:01:52.304187 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1643/3514] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:52 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:53.320338 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-105599dc-ab9a-42ca-a7cb-c947b232dbc7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:53.320885 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-105599dc-ab9a-42ca-a7cb-c947b232dbc7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:53.327090 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-105599dc-ab9a-42ca-a7cb-c947b232dbc7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:53.327542 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-105599dc-ab9a-42ca-a7cb-c947b232dbc7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:53.328352 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-105599dc-ab9a-42ca-a7cb-c947b232dbc7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:53.328793 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-105599dc-ab9a-42ca-a7cb-c947b232dbc7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:53.386989 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-105599dc-ab9a-42ca-a7cb-c947b232dbc7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:53.394838 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-105599dc-ab9a-42ca-a7cb-c947b232dbc7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078368 Mar 03 03:01:53.395409 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1872/3515] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:53 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:54.412306 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-aa2cb9d1-b614-4f8d-aac5-535e0b17172f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:54.412917 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-aa2cb9d1-b614-4f8d-aac5-535e0b17172f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:54.419823 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aa2cb9d1-b614-4f8d-aac5-535e0b17172f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:54.420619 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aa2cb9d1-b614-4f8d-aac5-535e0b17172f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:54.421400 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aa2cb9d1-b614-4f8d-aac5-535e0b17172f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:54.421840 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-aa2cb9d1-b614-4f8d-aac5-535e0b17172f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:54.480276 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-aa2cb9d1-b614-4f8d-aac5-535e0b17172f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:54.489097 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-aa2cb9d1-b614-4f8d-aac5-535e0b17172f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080662 Mar 03 03:01:54.489662 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1644/3516] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:54 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:55.506951 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a913d0ad-5e7c-4881-a4f3-e67066405c20 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:55.507573 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a913d0ad-5e7c-4881-a4f3-e67066405c20 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:55.514422 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a913d0ad-5e7c-4881-a4f3-e67066405c20 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:55.514865 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a913d0ad-5e7c-4881-a4f3-e67066405c20 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:55.515651 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a913d0ad-5e7c-4881-a4f3-e67066405c20 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:55.516084 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a913d0ad-5e7c-4881-a4f3-e67066405c20 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:55.573492 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a913d0ad-5e7c-4881-a4f3-e67066405c20 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:55.582003 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a913d0ad-5e7c-4881-a4f3-e67066405c20 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078756 Mar 03 03:01:55.582569 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1873/3517] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:55 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:56.598669 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f06f1fbc-2037-414d-bc36-3f5134d62641 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:56.599279 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f06f1fbc-2037-414d-bc36-3f5134d62641 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:56.605821 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f06f1fbc-2037-414d-bc36-3f5134d62641 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:56.606280 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f06f1fbc-2037-414d-bc36-3f5134d62641 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:56.607690 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f06f1fbc-2037-414d-bc36-3f5134d62641 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:56.608133 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f06f1fbc-2037-414d-bc36-3f5134d62641 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:56.666562 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f06f1fbc-2037-414d-bc36-3f5134d62641 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:56.674474 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f06f1fbc-2037-414d-bc36-3f5134d62641 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079692 Mar 03 03:01:56.675040 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1645/3518] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:56 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:57.691855 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0e81e3e4-95fd-4893-b8ed-5f4899302002 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:57.692501 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0e81e3e4-95fd-4893-b8ed-5f4899302002 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:57.698611 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0e81e3e4-95fd-4893-b8ed-5f4899302002 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:57.699061 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0e81e3e4-95fd-4893-b8ed-5f4899302002 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:57.699866 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0e81e3e4-95fd-4893-b8ed-5f4899302002 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:57.700303 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0e81e3e4-95fd-4893-b8ed-5f4899302002 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:57.760580 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0e81e3e4-95fd-4893-b8ed-5f4899302002 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:57.768262 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0e81e3e4-95fd-4893-b8ed-5f4899302002 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080386 Mar 03 03:01:57.768831 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1874/3519] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:57 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:58.785606 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-57df49e0-24ea-403e-bfde-70ab91878673 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:58.786193 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-57df49e0-24ea-403e-bfde-70ab91878673 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:58.792522 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-57df49e0-24ea-403e-bfde-70ab91878673 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:58.792981 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-57df49e0-24ea-403e-bfde-70ab91878673 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:58.793761 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-57df49e0-24ea-403e-bfde-70ab91878673 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:58.794809 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-57df49e0-24ea-403e-bfde-70ab91878673 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:58.853952 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-57df49e0-24ea-403e-bfde-70ab91878673 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:58.862387 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-57df49e0-24ea-403e-bfde-70ab91878673 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080693 Mar 03 03:01:58.862960 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1646/3520] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:58 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:01:59.879183 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-aa703178-14b8-468e-afac-b67a90787ef8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:01:59.879831 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-aa703178-14b8-468e-afac-b67a90787ef8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:01:59.886070 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aa703178-14b8-468e-afac-b67a90787ef8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:59.886522 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aa703178-14b8-468e-afac-b67a90787ef8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:59.887294 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aa703178-14b8-468e-afac-b67a90787ef8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:01:59.887767 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-aa703178-14b8-468e-afac-b67a90787ef8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:01:59.947770 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-aa703178-14b8-468e-afac-b67a90787ef8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:01:59.955903 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-aa703178-14b8-468e-afac-b67a90787ef8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080562 Mar 03 03:01:59.956465 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1875/3521] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:01:59 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:00.973509 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c1f17ab2-3f92-47cb-8824-cc661100da2a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:00.974119 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c1f17ab2-3f92-47cb-8824-cc661100da2a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:00.980609 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c1f17ab2-3f92-47cb-8824-cc661100da2a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:00.981069 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c1f17ab2-3f92-47cb-8824-cc661100da2a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:00.982986 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c1f17ab2-3f92-47cb-8824-cc661100da2a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:00.983430 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c1f17ab2-3f92-47cb-8824-cc661100da2a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:01.046557 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c1f17ab2-3f92-47cb-8824-cc661100da2a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:01.054329 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c1f17ab2-3f92-47cb-8824-cc661100da2a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.084671 Mar 03 03:02:01.054898 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1647/3522] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:00 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:02.071588 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0bd1bb95-b776-44d8-9b1f-d8f6fb763ec7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:02.072271 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0bd1bb95-b776-44d8-9b1f-d8f6fb763ec7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:02.078699 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0bd1bb95-b776-44d8-9b1f-d8f6fb763ec7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:02.079151 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0bd1bb95-b776-44d8-9b1f-d8f6fb763ec7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:02.079946 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0bd1bb95-b776-44d8-9b1f-d8f6fb763ec7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:02.080384 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0bd1bb95-b776-44d8-9b1f-d8f6fb763ec7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:02.138972 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0bd1bb95-b776-44d8-9b1f-d8f6fb763ec7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:02.146696 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0bd1bb95-b776-44d8-9b1f-d8f6fb763ec7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079032 Mar 03 03:02:02.147267 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1876/3523] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:02 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:03.163513 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-30483b87-d4c2-427a-8c1f-816a4ffccabb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:03.164173 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-30483b87-d4c2-427a-8c1f-816a4ffccabb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:03.171283 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-30483b87-d4c2-427a-8c1f-816a4ffccabb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:03.171775 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-30483b87-d4c2-427a-8c1f-816a4ffccabb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:03.172558 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-30483b87-d4c2-427a-8c1f-816a4ffccabb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:03.172995 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-30483b87-d4c2-427a-8c1f-816a4ffccabb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:03.232271 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-30483b87-d4c2-427a-8c1f-816a4ffccabb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:03.239897 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-30483b87-d4c2-427a-8c1f-816a4ffccabb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080222 Mar 03 03:02:03.240466 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1648/3524] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:03 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:04.257614 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e5828447-c492-43b0-8824-aabf8fb7e0ef tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:04.258224 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e5828447-c492-43b0-8824-aabf8fb7e0ef tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:04.264587 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e5828447-c492-43b0-8824-aabf8fb7e0ef tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:04.265042 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e5828447-c492-43b0-8824-aabf8fb7e0ef tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:04.265852 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e5828447-c492-43b0-8824-aabf8fb7e0ef tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:04.266294 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e5828447-c492-43b0-8824-aabf8fb7e0ef tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:04.329775 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e5828447-c492-43b0-8824-aabf8fb7e0ef tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:04.337518 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e5828447-c492-43b0-8824-aabf8fb7e0ef tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.084154 Mar 03 03:02:04.338083 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1877/3525] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:04 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:05.354727 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6fedf0c0-580b-4288-aaa4-7fc92a9b9370 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:05.355340 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6fedf0c0-580b-4288-aaa4-7fc92a9b9370 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:05.362470 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6fedf0c0-580b-4288-aaa4-7fc92a9b9370 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:05.362928 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6fedf0c0-580b-4288-aaa4-7fc92a9b9370 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:05.363738 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6fedf0c0-580b-4288-aaa4-7fc92a9b9370 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:05.364182 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6fedf0c0-580b-4288-aaa4-7fc92a9b9370 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:05.422911 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-6fedf0c0-580b-4288-aaa4-7fc92a9b9370 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:05.430534 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6fedf0c0-580b-4288-aaa4-7fc92a9b9370 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080082 Mar 03 03:02:05.431099 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1649/3526] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:05 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:06.448251 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-69d274a8-45c9-45d2-9bbc-71213675a128 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:06.448845 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-69d274a8-45c9-45d2-9bbc-71213675a128 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:06.454681 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-69d274a8-45c9-45d2-9bbc-71213675a128 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:06.455137 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-69d274a8-45c9-45d2-9bbc-71213675a128 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:06.456191 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-69d274a8-45c9-45d2-9bbc-71213675a128 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:06.456640 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-69d274a8-45c9-45d2-9bbc-71213675a128 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:06.517224 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-69d274a8-45c9-45d2-9bbc-71213675a128 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:06.525360 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-69d274a8-45c9-45d2-9bbc-71213675a128 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.081451 Mar 03 03:02:06.525937 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1878/3527] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:06 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:07.541773 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-dfe59f9e-1305-451e-bff1-22376c95d63a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:07.542411 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-dfe59f9e-1305-451e-bff1-22376c95d63a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:07.548688 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dfe59f9e-1305-451e-bff1-22376c95d63a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:07.549132 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dfe59f9e-1305-451e-bff1-22376c95d63a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:07.549898 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dfe59f9e-1305-451e-bff1-22376c95d63a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:07.550331 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dfe59f9e-1305-451e-bff1-22376c95d63a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:07.608932 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-dfe59f9e-1305-451e-bff1-22376c95d63a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:07.616638 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-dfe59f9e-1305-451e-bff1-22376c95d63a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078724 Mar 03 03:02:07.617206 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1650/3528] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:07 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:08.634491 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-edfb6f91-5647-48e0-9c6f-cb302e0c1c8c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:08.635093 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-edfb6f91-5647-48e0-9c6f-cb302e0c1c8c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:08.641413 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-edfb6f91-5647-48e0-9c6f-cb302e0c1c8c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:08.641862 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-edfb6f91-5647-48e0-9c6f-cb302e0c1c8c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:08.642627 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-edfb6f91-5647-48e0-9c6f-cb302e0c1c8c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:08.643059 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-edfb6f91-5647-48e0-9c6f-cb302e0c1c8c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:08.700502 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-edfb6f91-5647-48e0-9c6f-cb302e0c1c8c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:08.708136 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-edfb6f91-5647-48e0-9c6f-cb302e0c1c8c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.077925 Mar 03 03:02:08.708699 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1879/3529] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:08 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:09.724595 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c5770f79-c29e-4b07-9f42-3416c2c1dba8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:09.725203 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c5770f79-c29e-4b07-9f42-3416c2c1dba8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:09.731927 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c5770f79-c29e-4b07-9f42-3416c2c1dba8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:09.732389 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c5770f79-c29e-4b07-9f42-3416c2c1dba8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:09.733169 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c5770f79-c29e-4b07-9f42-3416c2c1dba8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:09.733608 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c5770f79-c29e-4b07-9f42-3416c2c1dba8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:09.792593 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c5770f79-c29e-4b07-9f42-3416c2c1dba8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:09.800171 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c5770f79-c29e-4b07-9f42-3416c2c1dba8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079454 Mar 03 03:02:09.800737 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1651/3530] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:09 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:10.816885 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b51e0b35-b3aa-4ba2-b792-c1ce3cbfe8aa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:10.817408 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b51e0b35-b3aa-4ba2-b792-c1ce3cbfe8aa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:10.823711 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b51e0b35-b3aa-4ba2-b792-c1ce3cbfe8aa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:10.824164 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b51e0b35-b3aa-4ba2-b792-c1ce3cbfe8aa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:10.824944 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b51e0b35-b3aa-4ba2-b792-c1ce3cbfe8aa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:10.825483 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b51e0b35-b3aa-4ba2-b792-c1ce3cbfe8aa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:10.886586 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b51e0b35-b3aa-4ba2-b792-c1ce3cbfe8aa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:10.894880 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b51e0b35-b3aa-4ba2-b792-c1ce3cbfe8aa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.081913 Mar 03 03:02:10.895467 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1880/3531] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:10 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:11.912289 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4ce860e9-b933-4a96-acc0-937436499788 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:11.912924 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4ce860e9-b933-4a96-acc0-937436499788 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:11.919797 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4ce860e9-b933-4a96-acc0-937436499788 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:11.920272 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4ce860e9-b933-4a96-acc0-937436499788 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:11.921088 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4ce860e9-b933-4a96-acc0-937436499788 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:11.921530 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4ce860e9-b933-4a96-acc0-937436499788 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:11.979390 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4ce860e9-b933-4a96-acc0-937436499788 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:11.987571 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4ce860e9-b933-4a96-acc0-937436499788 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079192 Mar 03 03:02:11.988162 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1652/3532] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:11 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:13.004135 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-bd6dd689-946c-454f-a25a-d5c01692f8be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:13.004750 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-bd6dd689-946c-454f-a25a-d5c01692f8be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:13.010884 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bd6dd689-946c-454f-a25a-d5c01692f8be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:13.011333 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bd6dd689-946c-454f-a25a-d5c01692f8be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:13.012132 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bd6dd689-946c-454f-a25a-d5c01692f8be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:13.012599 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bd6dd689-946c-454f-a25a-d5c01692f8be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:13.071664 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-bd6dd689-946c-454f-a25a-d5c01692f8be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:13.080077 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-bd6dd689-946c-454f-a25a-d5c01692f8be tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079754 Mar 03 03:02:13.080643 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1881/3533] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:12 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:14.096889 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-074e4721-8471-49a9-b518-afe1ff571e31 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:14.097492 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-074e4721-8471-49a9-b518-afe1ff571e31 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:14.104057 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-074e4721-8471-49a9-b518-afe1ff571e31 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:14.104507 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-074e4721-8471-49a9-b518-afe1ff571e31 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:14.105277 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-074e4721-8471-49a9-b518-afe1ff571e31 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:14.105710 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-074e4721-8471-49a9-b518-afe1ff571e31 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:14.169652 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-074e4721-8471-49a9-b518-afe1ff571e31 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:14.177372 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-074e4721-8471-49a9-b518-afe1ff571e31 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.084395 Mar 03 03:02:14.177931 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1653/3534] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:14 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:15.194211 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9fc273ac-2bee-46d0-aada-6c43508278ed tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:15.194820 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9fc273ac-2bee-46d0-aada-6c43508278ed tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:15.201661 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9fc273ac-2bee-46d0-aada-6c43508278ed tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:15.202112 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9fc273ac-2bee-46d0-aada-6c43508278ed tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:15.202890 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9fc273ac-2bee-46d0-aada-6c43508278ed tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:15.203331 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9fc273ac-2bee-46d0-aada-6c43508278ed tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:15.263566 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9fc273ac-2bee-46d0-aada-6c43508278ed tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:15.271267 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9fc273ac-2bee-46d0-aada-6c43508278ed tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080944 Mar 03 03:02:15.271873 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1882/3535] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:15 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:16.288111 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-47a95d52-18fd-4f54-8ad8-855bf735946c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:16.288700 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-47a95d52-18fd-4f54-8ad8-855bf735946c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:16.295425 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-47a95d52-18fd-4f54-8ad8-855bf735946c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:16.296158 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-47a95d52-18fd-4f54-8ad8-855bf735946c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:16.296930 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-47a95d52-18fd-4f54-8ad8-855bf735946c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:16.297365 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-47a95d52-18fd-4f54-8ad8-855bf735946c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:16.356938 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-47a95d52-18fd-4f54-8ad8-855bf735946c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:16.364712 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-47a95d52-18fd-4f54-8ad8-855bf735946c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080416 Mar 03 03:02:16.365274 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1654/3536] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:16 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:17.382286 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-26e55fa2-6cb8-416f-985c-f0092870704b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:17.382886 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-26e55fa2-6cb8-416f-985c-f0092870704b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:17.389710 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-26e55fa2-6cb8-416f-985c-f0092870704b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:17.390151 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-26e55fa2-6cb8-416f-985c-f0092870704b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:17.390917 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-26e55fa2-6cb8-416f-985c-f0092870704b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:17.391354 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-26e55fa2-6cb8-416f-985c-f0092870704b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:17.453552 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-26e55fa2-6cb8-416f-985c-f0092870704b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:17.461196 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-26e55fa2-6cb8-416f-985c-f0092870704b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.082751 Mar 03 03:02:17.461759 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1883/3537] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:17 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:18.478683 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-292dd4d9-2abb-4b67-8da6-547eaf5b2298 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:18.479281 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-292dd4d9-2abb-4b67-8da6-547eaf5b2298 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:18.485574 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-292dd4d9-2abb-4b67-8da6-547eaf5b2298 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:18.486035 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-292dd4d9-2abb-4b67-8da6-547eaf5b2298 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:18.486816 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-292dd4d9-2abb-4b67-8da6-547eaf5b2298 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:18.487259 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-292dd4d9-2abb-4b67-8da6-547eaf5b2298 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:18.546175 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-292dd4d9-2abb-4b67-8da6-547eaf5b2298 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:18.553861 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-292dd4d9-2abb-4b67-8da6-547eaf5b2298 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079299 Mar 03 03:02:18.554435 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1655/3538] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:18 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:19.570709 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9da158be-b2ba-4a40-86dc-b6aa3ad6cfb1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:19.571321 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9da158be-b2ba-4a40-86dc-b6aa3ad6cfb1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:19.577657 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9da158be-b2ba-4a40-86dc-b6aa3ad6cfb1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:19.578110 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9da158be-b2ba-4a40-86dc-b6aa3ad6cfb1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:19.578885 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9da158be-b2ba-4a40-86dc-b6aa3ad6cfb1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:19.579322 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9da158be-b2ba-4a40-86dc-b6aa3ad6cfb1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:19.637091 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9da158be-b2ba-4a40-86dc-b6aa3ad6cfb1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:19.644850 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9da158be-b2ba-4a40-86dc-b6aa3ad6cfb1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078027 Mar 03 03:02:19.645408 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1884/3539] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:19 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:20.662614 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6aa65ce4-dc37-491d-a140-25e5e5ad80c2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:20.663204 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6aa65ce4-dc37-491d-a140-25e5e5ad80c2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:20.670145 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6aa65ce4-dc37-491d-a140-25e5e5ad80c2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:20.670592 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6aa65ce4-dc37-491d-a140-25e5e5ad80c2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:20.671393 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6aa65ce4-dc37-491d-a140-25e5e5ad80c2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:20.671851 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6aa65ce4-dc37-491d-a140-25e5e5ad80c2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:20.729853 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-6aa65ce4-dc37-491d-a140-25e5e5ad80c2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:20.737955 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6aa65ce4-dc37-491d-a140-25e5e5ad80c2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079217 Mar 03 03:02:20.738512 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1656/3540] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:20 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:21.754084 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-09b10016-1fa4-44d0-b6fb-fd1042021e02 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:21.754676 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-09b10016-1fa4-44d0-b6fb-fd1042021e02 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:21.761031 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-09b10016-1fa4-44d0-b6fb-fd1042021e02 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:21.761508 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-09b10016-1fa4-44d0-b6fb-fd1042021e02 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:21.762305 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-09b10016-1fa4-44d0-b6fb-fd1042021e02 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:21.763109 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-09b10016-1fa4-44d0-b6fb-fd1042021e02 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:21.821325 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-09b10016-1fa4-44d0-b6fb-fd1042021e02 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:21.829320 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-09b10016-1fa4-44d0-b6fb-fd1042021e02 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079065 Mar 03 03:02:21.829887 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1885/3541] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:21 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:22.846029 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f7cf5c07-691d-41da-b969-5b418f32eec3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:22.846629 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f7cf5c07-691d-41da-b969-5b418f32eec3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:22.853169 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f7cf5c07-691d-41da-b969-5b418f32eec3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:22.853621 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f7cf5c07-691d-41da-b969-5b418f32eec3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:22.854392 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f7cf5c07-691d-41da-b969-5b418f32eec3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:22.854830 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f7cf5c07-691d-41da-b969-5b418f32eec3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:22.913493 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f7cf5c07-691d-41da-b969-5b418f32eec3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:22.921621 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f7cf5c07-691d-41da-b969-5b418f32eec3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079510 Mar 03 03:02:22.922191 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1657/3542] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:22 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:23.938507 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-06372195-396b-4325-87e2-97b8921d8267 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:23.939117 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-06372195-396b-4325-87e2-97b8921d8267 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:23.945344 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-06372195-396b-4325-87e2-97b8921d8267 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:23.945791 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-06372195-396b-4325-87e2-97b8921d8267 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:23.946571 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-06372195-396b-4325-87e2-97b8921d8267 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:23.947011 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-06372195-396b-4325-87e2-97b8921d8267 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:24.005324 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-06372195-396b-4325-87e2-97b8921d8267 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:24.013858 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-06372195-396b-4325-87e2-97b8921d8267 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079250 Mar 03 03:02:24.017196 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1886/3543] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:23 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:25.030703 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e288a370-65e6-43ff-a396-b338090fe5fc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:25.031312 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e288a370-65e6-43ff-a396-b338090fe5fc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:25.037596 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e288a370-65e6-43ff-a396-b338090fe5fc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:25.038051 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e288a370-65e6-43ff-a396-b338090fe5fc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:25.038835 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e288a370-65e6-43ff-a396-b338090fe5fc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:25.039276 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e288a370-65e6-43ff-a396-b338090fe5fc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:25.098627 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e288a370-65e6-43ff-a396-b338090fe5fc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:25.107165 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e288a370-65e6-43ff-a396-b338090fe5fc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080161 Mar 03 03:02:25.107748 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1658/3544] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:25 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:26.124409 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-28a1cc48-168c-4e91-a74f-9928f8f209ea tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:26.125018 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-28a1cc48-168c-4e91-a74f-9928f8f209ea tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:26.131249 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-28a1cc48-168c-4e91-a74f-9928f8f209ea tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:26.131743 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-28a1cc48-168c-4e91-a74f-9928f8f209ea tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:26.132519 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-28a1cc48-168c-4e91-a74f-9928f8f209ea tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:26.132956 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-28a1cc48-168c-4e91-a74f-9928f8f209ea tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:26.192677 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-28a1cc48-168c-4e91-a74f-9928f8f209ea tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:26.200588 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-28a1cc48-168c-4e91-a74f-9928f8f209ea tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.081161 Mar 03 03:02:26.201140 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1887/3545] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:26 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:27.217979 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b75fee45-29c7-4c26-a684-60c8bf957674 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:27.218581 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b75fee45-29c7-4c26-a684-60c8bf957674 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:27.224809 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b75fee45-29c7-4c26-a684-60c8bf957674 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:27.225258 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b75fee45-29c7-4c26-a684-60c8bf957674 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:27.226027 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b75fee45-29c7-4c26-a684-60c8bf957674 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:27.226461 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b75fee45-29c7-4c26-a684-60c8bf957674 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:27.289227 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b75fee45-29c7-4c26-a684-60c8bf957674 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:27.297540 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b75fee45-29c7-4c26-a684-60c8bf957674 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.084077 Mar 03 03:02:27.298101 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1659/3546] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:27 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:28.314860 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-671c40fe-efb4-4803-88d2-391d3913090a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:28.315391 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-671c40fe-efb4-4803-88d2-391d3913090a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:28.321574 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-671c40fe-efb4-4803-88d2-391d3913090a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:28.322024 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-671c40fe-efb4-4803-88d2-391d3913090a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:28.322796 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-671c40fe-efb4-4803-88d2-391d3913090a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:28.323233 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-671c40fe-efb4-4803-88d2-391d3913090a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:28.380674 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-671c40fe-efb4-4803-88d2-391d3913090a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:28.388500 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-671c40fe-efb4-4803-88d2-391d3913090a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.077579 Mar 03 03:02:28.389065 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1888/3547] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:28 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:29.405637 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a4aa8185-29a9-43c1-85a4-5a6b3a62a923 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:29.406242 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a4aa8185-29a9-43c1-85a4-5a6b3a62a923 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:29.412453 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a4aa8185-29a9-43c1-85a4-5a6b3a62a923 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:29.412915 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a4aa8185-29a9-43c1-85a4-5a6b3a62a923 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:29.413690 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a4aa8185-29a9-43c1-85a4-5a6b3a62a923 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:29.414243 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a4aa8185-29a9-43c1-85a4-5a6b3a62a923 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:29.473827 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a4aa8185-29a9-43c1-85a4-5a6b3a62a923 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:29.482392 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a4aa8185-29a9-43c1-85a4-5a6b3a62a923 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.081522 Mar 03 03:02:29.482952 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1660/3548] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:29 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:30.499206 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7cbd2fea-47e4-4e8d-bc92-a87f8d73ae43 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:30.499839 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7cbd2fea-47e4-4e8d-bc92-a87f8d73ae43 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:30.506074 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7cbd2fea-47e4-4e8d-bc92-a87f8d73ae43 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:30.506524 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7cbd2fea-47e4-4e8d-bc92-a87f8d73ae43 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:30.507294 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7cbd2fea-47e4-4e8d-bc92-a87f8d73ae43 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:30.507761 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7cbd2fea-47e4-4e8d-bc92-a87f8d73ae43 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:30.569052 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-7cbd2fea-47e4-4e8d-bc92-a87f8d73ae43 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:30.577268 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7cbd2fea-47e4-4e8d-bc92-a87f8d73ae43 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.082191 Mar 03 03:02:30.577819 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1889/3549] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:30 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:31.593857 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-0eea3182-8c42-4d12-936a-7a58d1911959 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:31.594466 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-0eea3182-8c42-4d12-936a-7a58d1911959 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:31.600692 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0eea3182-8c42-4d12-936a-7a58d1911959 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:31.601145 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0eea3182-8c42-4d12-936a-7a58d1911959 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:31.602227 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0eea3182-8c42-4d12-936a-7a58d1911959 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:31.603195 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-0eea3182-8c42-4d12-936a-7a58d1911959 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:31.663146 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-0eea3182-8c42-4d12-936a-7a58d1911959 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:31.670899 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-0eea3182-8c42-4d12-936a-7a58d1911959 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080961 Mar 03 03:02:31.671472 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1661/3550] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:31 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:32.688181 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-371656f8-9525-447f-b04f-a1504cde5d0b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:32.688791 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-371656f8-9525-447f-b04f-a1504cde5d0b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:32.694795 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 03:02:32.695278 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: Thu Mar 3 03:02:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 03 03:02:32.696765 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-371656f8-9525-447f-b04f-a1504cde5d0b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:32.697229 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-371656f8-9525-447f-b04f-a1504cde5d0b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:32.698022 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-371656f8-9525-447f-b04f-a1504cde5d0b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:32.698463 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-371656f8-9525-447f-b04f-a1504cde5d0b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:32.758132 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-371656f8-9525-447f-b04f-a1504cde5d0b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:32.766220 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-371656f8-9525-447f-b04f-a1504cde5d0b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.082479 Mar 03 03:02:32.766782 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1890/3551] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:32 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:33.783854 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e48c2a77-1ff5-434d-9e89-28d3eb1d4088 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:33.784462 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e48c2a77-1ff5-434d-9e89-28d3eb1d4088 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:33.791240 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e48c2a77-1ff5-434d-9e89-28d3eb1d4088 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:33.791792 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e48c2a77-1ff5-434d-9e89-28d3eb1d4088 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:33.792636 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e48c2a77-1ff5-434d-9e89-28d3eb1d4088 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:33.793069 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e48c2a77-1ff5-434d-9e89-28d3eb1d4088 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:33.858444 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e48c2a77-1ff5-434d-9e89-28d3eb1d4088 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:33.866247 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e48c2a77-1ff5-434d-9e89-28d3eb1d4088 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.086319 Mar 03 03:02:33.866802 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1662/3552] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:33 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:34.884175 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-24def320-0708-4fab-90c8-18c2459cdbd4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:34.884778 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-24def320-0708-4fab-90c8-18c2459cdbd4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:34.891671 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-24def320-0708-4fab-90c8-18c2459cdbd4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:34.892118 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-24def320-0708-4fab-90c8-18c2459cdbd4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:34.892900 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-24def320-0708-4fab-90c8-18c2459cdbd4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:34.893328 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-24def320-0708-4fab-90c8-18c2459cdbd4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:34.952605 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-24def320-0708-4fab-90c8-18c2459cdbd4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:34.960267 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-24def320-0708-4fab-90c8-18c2459cdbd4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080244 Mar 03 03:02:34.960829 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1891/3553] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:34 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:35.978155 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a3923319-8cbb-429b-aaa9-2274387d911f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:35.978754 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a3923319-8cbb-429b-aaa9-2274387d911f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:35.984677 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a3923319-8cbb-429b-aaa9-2274387d911f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:35.985127 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a3923319-8cbb-429b-aaa9-2274387d911f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:35.985894 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a3923319-8cbb-429b-aaa9-2274387d911f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:35.986328 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a3923319-8cbb-429b-aaa9-2274387d911f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:36.089811 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a3923319-8cbb-429b-aaa9-2274387d911f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:36.098002 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a3923319-8cbb-429b-aaa9-2274387d911f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.124199 Mar 03 03:02:36.098558 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1663/3554] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:35 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:37.114252 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-54305f6d-5d53-4144-9acc-077cec49a339 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:37.114861 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-54305f6d-5d53-4144-9acc-077cec49a339 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:37.120822 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-54305f6d-5d53-4144-9acc-077cec49a339 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:37.121275 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-54305f6d-5d53-4144-9acc-077cec49a339 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:37.122136 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-54305f6d-5d53-4144-9acc-077cec49a339 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:37.122596 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-54305f6d-5d53-4144-9acc-077cec49a339 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:37.222580 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-54305f6d-5d53-4144-9acc-077cec49a339 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:37.230463 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-54305f6d-5d53-4144-9acc-077cec49a339 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.120088 Mar 03 03:02:37.231698 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1892/3555] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:37 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 03:02:38.248395 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ccad734c-84f4-4477-b184-22e43a14f041 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:38.249010 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ccad734c-84f4-4477-b184-22e43a14f041 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:38.255227 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ccad734c-84f4-4477-b184-22e43a14f041 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:38.255709 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ccad734c-84f4-4477-b184-22e43a14f041 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:38.256499 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ccad734c-84f4-4477-b184-22e43a14f041 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:38.256944 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ccad734c-84f4-4477-b184-22e43a14f041 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:38.315811 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ccad734c-84f4-4477-b184-22e43a14f041 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:38.323444 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ccad734c-84f4-4477-b184-22e43a14f041 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079520 Mar 03 03:02:38.324043 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1664/3556] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:38 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:39.341354 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4cc38cac-aff2-47f7-9b44-e8df53e6c2e4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:39.341997 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4cc38cac-aff2-47f7-9b44-e8df53e6c2e4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:39.348203 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4cc38cac-aff2-47f7-9b44-e8df53e6c2e4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:39.348683 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4cc38cac-aff2-47f7-9b44-e8df53e6c2e4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:39.349615 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4cc38cac-aff2-47f7-9b44-e8df53e6c2e4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:39.350065 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4cc38cac-aff2-47f7-9b44-e8df53e6c2e4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:39.409317 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4cc38cac-aff2-47f7-9b44-e8df53e6c2e4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:39.416906 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4cc38cac-aff2-47f7-9b44-e8df53e6c2e4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079572 Mar 03 03:02:39.417460 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1893/3557] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:39 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:40.433985 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-551cb363-e1ac-43c0-9688-f22cf0ed0722 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:40.435919 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-551cb363-e1ac-43c0-9688-f22cf0ed0722 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:40.442233 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-551cb363-e1ac-43c0-9688-f22cf0ed0722 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:40.442689 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-551cb363-e1ac-43c0-9688-f22cf0ed0722 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:40.443493 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-551cb363-e1ac-43c0-9688-f22cf0ed0722 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:40.443962 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-551cb363-e1ac-43c0-9688-f22cf0ed0722 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:40.506739 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-551cb363-e1ac-43c0-9688-f22cf0ed0722 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:40.514676 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-551cb363-e1ac-43c0-9688-f22cf0ed0722 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.084601 Mar 03 03:02:40.515250 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1665/3558] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:40 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:41.531949 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ce60c2a1-f596-434c-9dfb-c8e58b71c917 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:41.532551 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ce60c2a1-f596-434c-9dfb-c8e58b71c917 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:41.538752 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ce60c2a1-f596-434c-9dfb-c8e58b71c917 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:41.539198 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ce60c2a1-f596-434c-9dfb-c8e58b71c917 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:41.539990 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ce60c2a1-f596-434c-9dfb-c8e58b71c917 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:41.540424 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ce60c2a1-f596-434c-9dfb-c8e58b71c917 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:41.599492 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ce60c2a1-f596-434c-9dfb-c8e58b71c917 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:41.608267 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ce60c2a1-f596-434c-9dfb-c8e58b71c917 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080852 Mar 03 03:02:41.608829 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1894/3559] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:41 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:42.625660 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ff7ff13f-ad0c-4e66-9536-2da529142fd6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:42.626252 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ff7ff13f-ad0c-4e66-9536-2da529142fd6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:42.632446 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ff7ff13f-ad0c-4e66-9536-2da529142fd6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:42.632903 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ff7ff13f-ad0c-4e66-9536-2da529142fd6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:42.633673 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ff7ff13f-ad0c-4e66-9536-2da529142fd6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:42.634103 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ff7ff13f-ad0c-4e66-9536-2da529142fd6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:42.692266 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ff7ff13f-ad0c-4e66-9536-2da529142fd6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:42.700001 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ff7ff13f-ad0c-4e66-9536-2da529142fd6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078663 Mar 03 03:02:42.700545 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1666/3560] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:42 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:43.716712 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2c07a688-9e28-4d33-81b7-3f2a098aed12 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:43.717328 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2c07a688-9e28-4d33-81b7-3f2a098aed12 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:43.723488 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2c07a688-9e28-4d33-81b7-3f2a098aed12 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:43.723974 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2c07a688-9e28-4d33-81b7-3f2a098aed12 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:43.724748 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2c07a688-9e28-4d33-81b7-3f2a098aed12 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:43.725197 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2c07a688-9e28-4d33-81b7-3f2a098aed12 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:43.787862 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2c07a688-9e28-4d33-81b7-3f2a098aed12 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:43.796555 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2c07a688-9e28-4d33-81b7-3f2a098aed12 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.083898 Mar 03 03:02:43.797117 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1895/3561] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:43 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:44.813280 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-49a8a206-ac2a-4d73-b77b-a89fe1053be3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:44.813879 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-49a8a206-ac2a-4d73-b77b-a89fe1053be3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:44.820052 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-49a8a206-ac2a-4d73-b77b-a89fe1053be3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:44.820506 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-49a8a206-ac2a-4d73-b77b-a89fe1053be3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:44.821280 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-49a8a206-ac2a-4d73-b77b-a89fe1053be3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:44.821712 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-49a8a206-ac2a-4d73-b77b-a89fe1053be3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:44.881890 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-49a8a206-ac2a-4d73-b77b-a89fe1053be3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:44.890342 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-49a8a206-ac2a-4d73-b77b-a89fe1053be3 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.081085 Mar 03 03:02:44.890911 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1667/3562] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:44 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:45.908025 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5d9e188f-8ede-4934-8e2d-dfbd8f3a7df4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:45.908638 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5d9e188f-8ede-4934-8e2d-dfbd8f3a7df4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:45.914878 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5d9e188f-8ede-4934-8e2d-dfbd8f3a7df4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:45.915327 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5d9e188f-8ede-4934-8e2d-dfbd8f3a7df4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:45.916134 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5d9e188f-8ede-4934-8e2d-dfbd8f3a7df4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:45.916572 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5d9e188f-8ede-4934-8e2d-dfbd8f3a7df4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:45.975361 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5d9e188f-8ede-4934-8e2d-dfbd8f3a7df4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:45.984145 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5d9e188f-8ede-4934-8e2d-dfbd8f3a7df4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080503 Mar 03 03:02:45.984701 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1896/3563] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:45 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:47.001988 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-697f05df-306e-4a21-a4b3-fed2913ff9cc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:47.002594 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-697f05df-306e-4a21-a4b3-fed2913ff9cc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:47.008429 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-697f05df-306e-4a21-a4b3-fed2913ff9cc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:47.008877 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-697f05df-306e-4a21-a4b3-fed2913ff9cc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:47.009644 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-697f05df-306e-4a21-a4b3-fed2913ff9cc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:47.010073 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-697f05df-306e-4a21-a4b3-fed2913ff9cc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:47.069248 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-697f05df-306e-4a21-a4b3-fed2913ff9cc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:47.076957 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-697f05df-306e-4a21-a4b3-fed2913ff9cc tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079975 Mar 03 03:02:47.077522 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1668/3564] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:46 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:48.093956 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ac1b96d5-355d-40fa-b197-593e1eef6707 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:48.094564 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ac1b96d5-355d-40fa-b197-593e1eef6707 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:48.100783 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ac1b96d5-355d-40fa-b197-593e1eef6707 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:48.101233 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ac1b96d5-355d-40fa-b197-593e1eef6707 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:48.102004 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ac1b96d5-355d-40fa-b197-593e1eef6707 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:48.102691 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ac1b96d5-355d-40fa-b197-593e1eef6707 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:48.161144 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ac1b96d5-355d-40fa-b197-593e1eef6707 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:48.169903 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ac1b96d5-355d-40fa-b197-593e1eef6707 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080821 Mar 03 03:02:48.170465 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1897/3565] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:48 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:49.188598 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-768b0d37-14fe-4e12-9596-821c790185dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:49.189208 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-768b0d37-14fe-4e12-9596-821c790185dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:49.195464 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-768b0d37-14fe-4e12-9596-821c790185dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:49.195950 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-768b0d37-14fe-4e12-9596-821c790185dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:49.196725 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-768b0d37-14fe-4e12-9596-821c790185dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:49.197166 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-768b0d37-14fe-4e12-9596-821c790185dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:49.256007 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-768b0d37-14fe-4e12-9596-821c790185dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:49.264295 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-768b0d37-14fe-4e12-9596-821c790185dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.081148 Mar 03 03:02:49.264862 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1669/3566] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:49 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:50.281125 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-36478372-7de1-46f7-8363-e8fcad9225ba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:50.281736 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-36478372-7de1-46f7-8363-e8fcad9225ba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:50.287988 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-36478372-7de1-46f7-8363-e8fcad9225ba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:50.288439 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-36478372-7de1-46f7-8363-e8fcad9225ba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:50.289215 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-36478372-7de1-46f7-8363-e8fcad9225ba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:50.289651 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-36478372-7de1-46f7-8363-e8fcad9225ba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:50.347906 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-36478372-7de1-46f7-8363-e8fcad9225ba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:50.356711 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-36478372-7de1-46f7-8363-e8fcad9225ba tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079149 Mar 03 03:02:50.357272 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1898/3567] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:50 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:51.373490 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-77492308-d8e4-48dd-9542-a07663a482ca tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:51.374090 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-77492308-d8e4-48dd-9542-a07663a482ca tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:51.380369 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-77492308-d8e4-48dd-9542-a07663a482ca tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:51.380820 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-77492308-d8e4-48dd-9542-a07663a482ca tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:51.381590 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-77492308-d8e4-48dd-9542-a07663a482ca tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:51.382026 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-77492308-d8e4-48dd-9542-a07663a482ca tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:51.440810 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-77492308-d8e4-48dd-9542-a07663a482ca tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:51.448497 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-77492308-d8e4-48dd-9542-a07663a482ca tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079541 Mar 03 03:02:51.449056 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1670/3568] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:51 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 03:02:52.044965 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d565e82c-17d9-4353-ae7f-85b90664a6ad tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:52.046665 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d565e82c-17d9-4353-ae7f-85b90664a6ad tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:52.054587 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d565e82c-17d9-4353-ae7f-85b90664a6ad tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:52.055047 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d565e82c-17d9-4353-ae7f-85b90664a6ad tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:52.055937 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d565e82c-17d9-4353-ae7f-85b90664a6ad tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:52.056667 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d565e82c-17d9-4353-ae7f-85b90664a6ad tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:52.070458 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.wsgi [None req-d565e82c-17d9-4353-ae7f-85b90664a6ad tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] HTTP exception thrown: Instance f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 could not be found. Mar 03 03:02:52.071055 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d565e82c-17d9-4353-ae7f-85b90664a6ad tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Returning 404 to user: Instance f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 could not be found. {{(pid=116858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 03:02:52.071947 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d565e82c-17d9-4353-ae7f-85b90664a6ad tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 404 len: 111 microversion: 2.20 time: 0.031630 Mar 03 03:02:52.072497 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1899/3569] 10.222.0.30 () {60 vars in 1279 bytes} [Thu Mar 3 03:02:52 2022] DELETE /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 03 03:02:52.080738 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-35bc61b7-73fd-4c42-a294-418fae1b7281 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:52.081345 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-35bc61b7-73fd-4c42-a294-418fae1b7281 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] [instance: f7a0db60-ea15-44e4-a1ca-41531a1aa5c3] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:52.087243 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-35bc61b7-73fd-4c42-a294-418fae1b7281 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:52.087817 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-35bc61b7-73fd-4c42-a294-418fae1b7281 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:52.088601 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-35bc61b7-73fd-4c42-a294-418fae1b7281 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:52.089037 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-35bc61b7-73fd-4c42-a294-418fae1b7281 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:52.102325 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.wsgi [None req-35bc61b7-73fd-4c42-a294-418fae1b7281 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] HTTP exception thrown: Instance f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 could not be found. Mar 03 03:02:52.103183 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-35bc61b7-73fd-4c42-a294-418fae1b7281 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] Returning 404 to user: Instance f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 could not be found. {{(pid=116859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 03:02:52.104030 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-35bc61b7-73fd-4c42-a294-418fae1b7281 tempest-AttachVolumeShelveTestJSON-1024078724 tempest-AttachVolumeShelveTestJSON-1024078724-project] 10.222.0.30 "GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3" status: 404 len: 111 microversion: 2.20 time: 0.027245 Mar 03 03:02:52.104554 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1671/3570] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Mar 3 03:02:52 2022] GET /compute/v2.1/servers/f7a0db60-ea15-44e4-a1ca-41531a1aa5c3 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 03 03:02:52.466098 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d386f967-c7eb-488d-8033-b5af64cf727b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:52.466740 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d386f967-c7eb-488d-8033-b5af64cf727b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:52.472751 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d386f967-c7eb-488d-8033-b5af64cf727b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:52.473199 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d386f967-c7eb-488d-8033-b5af64cf727b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:52.473992 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d386f967-c7eb-488d-8033-b5af64cf727b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:52.474428 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d386f967-c7eb-488d-8033-b5af64cf727b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:52.551014 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d386f967-c7eb-488d-8033-b5af64cf727b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:52.559411 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d386f967-c7eb-488d-8033-b5af64cf727b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.097288 Mar 03 03:02:52.560572 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1900/3571] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:52 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:53.575882 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-cb2de04d-d590-4c6c-9455-a2fbb48b08db tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:53.576500 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-cb2de04d-d590-4c6c-9455-a2fbb48b08db tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:53.583298 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cb2de04d-d590-4c6c-9455-a2fbb48b08db tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:53.584057 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cb2de04d-d590-4c6c-9455-a2fbb48b08db tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:53.584866 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cb2de04d-d590-4c6c-9455-a2fbb48b08db tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:53.585899 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cb2de04d-d590-4c6c-9455-a2fbb48b08db tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:53.650911 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-cb2de04d-d590-4c6c-9455-a2fbb48b08db tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:53.659056 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-cb2de04d-d590-4c6c-9455-a2fbb48b08db tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.087138 Mar 03 03:02:53.659725 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1672/3572] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:53 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:54.676598 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a5e456ad-dff1-4d0f-a3bf-c59e074655ad tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:54.677381 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a5e456ad-dff1-4d0f-a3bf-c59e074655ad tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:54.683538 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a5e456ad-dff1-4d0f-a3bf-c59e074655ad tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:54.684204 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a5e456ad-dff1-4d0f-a3bf-c59e074655ad tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:54.685030 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a5e456ad-dff1-4d0f-a3bf-c59e074655ad tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:54.685488 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a5e456ad-dff1-4d0f-a3bf-c59e074655ad tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:54.760221 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a5e456ad-dff1-4d0f-a3bf-c59e074655ad tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:54.769311 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a5e456ad-dff1-4d0f-a3bf-c59e074655ad tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.096584 Mar 03 03:02:54.778919 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1901/3573] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:54 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:55.787407 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-5b39eb05-f2ab-442f-a638-c1e8cf7c7b67 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:55.788113 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-5b39eb05-f2ab-442f-a638-c1e8cf7c7b67 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:55.795203 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5b39eb05-f2ab-442f-a638-c1e8cf7c7b67 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:55.795626 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5b39eb05-f2ab-442f-a638-c1e8cf7c7b67 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:55.796417 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5b39eb05-f2ab-442f-a638-c1e8cf7c7b67 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:55.796859 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-5b39eb05-f2ab-442f-a638-c1e8cf7c7b67 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:55.857925 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-5b39eb05-f2ab-442f-a638-c1e8cf7c7b67 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:55.865946 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-5b39eb05-f2ab-442f-a638-c1e8cf7c7b67 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.083380 Mar 03 03:02:55.866572 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1673/3574] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:55 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:56.882247 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a9dd61cc-ddb3-4881-ae31-730b57f638e1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:56.882852 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a9dd61cc-ddb3-4881-ae31-730b57f638e1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:56.891166 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a9dd61cc-ddb3-4881-ae31-730b57f638e1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:56.891671 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a9dd61cc-ddb3-4881-ae31-730b57f638e1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:56.892458 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a9dd61cc-ddb3-4881-ae31-730b57f638e1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:56.892899 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a9dd61cc-ddb3-4881-ae31-730b57f638e1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:56.953836 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a9dd61cc-ddb3-4881-ae31-730b57f638e1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:56.961464 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a9dd61cc-ddb3-4881-ae31-730b57f638e1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.083133 Mar 03 03:02:56.962021 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1902/3575] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:56 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:57.978503 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ab6b194c-4d08-46e6-b43d-e3ea22108dd1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:57.979100 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ab6b194c-4d08-46e6-b43d-e3ea22108dd1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:57.985734 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ab6b194c-4d08-46e6-b43d-e3ea22108dd1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:57.986185 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ab6b194c-4d08-46e6-b43d-e3ea22108dd1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:57.986958 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ab6b194c-4d08-46e6-b43d-e3ea22108dd1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:57.987397 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ab6b194c-4d08-46e6-b43d-e3ea22108dd1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:58.048516 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ab6b194c-4d08-46e6-b43d-e3ea22108dd1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:58.056470 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ab6b194c-4d08-46e6-b43d-e3ea22108dd1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.082101 Mar 03 03:02:58.057039 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1674/3576] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:57 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:02:59.074093 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ff08d65c-71b5-41fe-a604-16cee3ecccab tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:02:59.075328 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ff08d65c-71b5-41fe-a604-16cee3ecccab tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:02:59.081666 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ff08d65c-71b5-41fe-a604-16cee3ecccab tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:59.082122 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ff08d65c-71b5-41fe-a604-16cee3ecccab tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:59.082891 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ff08d65c-71b5-41fe-a604-16cee3ecccab tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:02:59.083326 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ff08d65c-71b5-41fe-a604-16cee3ecccab tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:02:59.141492 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ff08d65c-71b5-41fe-a604-16cee3ecccab tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:02:59.149120 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ff08d65c-71b5-41fe-a604-16cee3ecccab tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078841 Mar 03 03:02:59.149680 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1903/3577] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:02:59 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:00.166886 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9a41c7a9-6262-46e4-ab00-33593b9bdcaa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:00.167496 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9a41c7a9-6262-46e4-ab00-33593b9bdcaa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:00.174737 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9a41c7a9-6262-46e4-ab00-33593b9bdcaa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:00.175206 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9a41c7a9-6262-46e4-ab00-33593b9bdcaa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:00.176014 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9a41c7a9-6262-46e4-ab00-33593b9bdcaa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:00.176452 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9a41c7a9-6262-46e4-ab00-33593b9bdcaa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:00.235265 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9a41c7a9-6262-46e4-ab00-33593b9bdcaa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:00.242896 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9a41c7a9-6262-46e4-ab00-33593b9bdcaa tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079893 Mar 03 03:03:00.243457 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1675/3578] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:00 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:01.259360 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-175593d5-2ddb-49ab-aa03-dabb19bb134e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:01.259994 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-175593d5-2ddb-49ab-aa03-dabb19bb134e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:01.266822 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-175593d5-2ddb-49ab-aa03-dabb19bb134e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:01.267280 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-175593d5-2ddb-49ab-aa03-dabb19bb134e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:01.268131 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-175593d5-2ddb-49ab-aa03-dabb19bb134e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:01.268579 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-175593d5-2ddb-49ab-aa03-dabb19bb134e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:01.329313 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-175593d5-2ddb-49ab-aa03-dabb19bb134e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:01.336958 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-175593d5-2ddb-49ab-aa03-dabb19bb134e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.081462 Mar 03 03:03:01.337524 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1904/3579] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:01 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:02.355204 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ce25b4d9-e8eb-4340-a4f2-1edbd314fb99 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:02.356202 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ce25b4d9-e8eb-4340-a4f2-1edbd314fb99 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:02.362393 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ce25b4d9-e8eb-4340-a4f2-1edbd314fb99 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:02.362840 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ce25b4d9-e8eb-4340-a4f2-1edbd314fb99 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:02.363703 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ce25b4d9-e8eb-4340-a4f2-1edbd314fb99 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:02.364137 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ce25b4d9-e8eb-4340-a4f2-1edbd314fb99 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:02.424823 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ce25b4d9-e8eb-4340-a4f2-1edbd314fb99 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:02.432421 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ce25b4d9-e8eb-4340-a4f2-1edbd314fb99 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.081710 Mar 03 03:03:02.432994 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1676/3580] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:02 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:03.450124 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c43dace6-ed4d-4b80-a1e6-8911ad10ddbe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:03.450721 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c43dace6-ed4d-4b80-a1e6-8911ad10ddbe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:03.456848 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c43dace6-ed4d-4b80-a1e6-8911ad10ddbe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:03.457296 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c43dace6-ed4d-4b80-a1e6-8911ad10ddbe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:03.458061 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c43dace6-ed4d-4b80-a1e6-8911ad10ddbe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:03.458493 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c43dace6-ed4d-4b80-a1e6-8911ad10ddbe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:03.517705 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c43dace6-ed4d-4b80-a1e6-8911ad10ddbe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:03.525320 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c43dace6-ed4d-4b80-a1e6-8911ad10ddbe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079312 Mar 03 03:03:03.525878 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1905/3581] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:03 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 03:03:04.542073 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-708d7803-25bd-4852-a849-2038579901b0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:04.542662 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-708d7803-25bd-4852-a849-2038579901b0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:04.549993 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-708d7803-25bd-4852-a849-2038579901b0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:04.550444 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-708d7803-25bd-4852-a849-2038579901b0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:04.551218 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-708d7803-25bd-4852-a849-2038579901b0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:04.551680 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-708d7803-25bd-4852-a849-2038579901b0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:04.610739 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-708d7803-25bd-4852-a849-2038579901b0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:04.618365 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-708d7803-25bd-4852-a849-2038579901b0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080196 Mar 03 03:03:04.618926 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1677/3582] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:04 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:05.635191 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-22adca96-6cf5-4cd1-ab11-a717c9b26753 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:05.635819 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-22adca96-6cf5-4cd1-ab11-a717c9b26753 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:05.641714 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-22adca96-6cf5-4cd1-ab11-a717c9b26753 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:05.642160 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-22adca96-6cf5-4cd1-ab11-a717c9b26753 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:05.642923 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-22adca96-6cf5-4cd1-ab11-a717c9b26753 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:05.643358 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-22adca96-6cf5-4cd1-ab11-a717c9b26753 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:05.700502 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-22adca96-6cf5-4cd1-ab11-a717c9b26753 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:05.708033 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-22adca96-6cf5-4cd1-ab11-a717c9b26753 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.076827 Mar 03 03:03:05.708591 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1906/3583] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:05 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:06.725043 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-bfdb7b43-32e0-4bd5-abba-147646485346 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:06.725615 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-bfdb7b43-32e0-4bd5-abba-147646485346 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:06.732152 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bfdb7b43-32e0-4bd5-abba-147646485346 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:06.732600 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bfdb7b43-32e0-4bd5-abba-147646485346 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:06.733365 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bfdb7b43-32e0-4bd5-abba-147646485346 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:06.733796 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bfdb7b43-32e0-4bd5-abba-147646485346 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:06.795921 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-bfdb7b43-32e0-4bd5-abba-147646485346 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:06.803571 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-bfdb7b43-32e0-4bd5-abba-147646485346 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.082604 Mar 03 03:03:06.804147 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1678/3584] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:06 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:07.821637 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b04c2e4c-9dfa-473b-9f2a-f74d91e52db0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:07.822052 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b04c2e4c-9dfa-473b-9f2a-f74d91e52db0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:07.829969 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b04c2e4c-9dfa-473b-9f2a-f74d91e52db0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:07.830421 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b04c2e4c-9dfa-473b-9f2a-f74d91e52db0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:07.831241 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b04c2e4c-9dfa-473b-9f2a-f74d91e52db0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:07.831777 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b04c2e4c-9dfa-473b-9f2a-f74d91e52db0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:07.891373 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b04c2e4c-9dfa-473b-9f2a-f74d91e52db0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:07.899168 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b04c2e4c-9dfa-473b-9f2a-f74d91e52db0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.082514 Mar 03 03:03:07.899755 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1907/3585] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:07 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:08.915461 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d9fe84c9-c685-4601-9c94-2b500f3f92d9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:08.916105 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d9fe84c9-c685-4601-9c94-2b500f3f92d9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:08.922974 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d9fe84c9-c685-4601-9c94-2b500f3f92d9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:08.923425 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d9fe84c9-c685-4601-9c94-2b500f3f92d9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:08.924234 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d9fe84c9-c685-4601-9c94-2b500f3f92d9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:08.924667 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d9fe84c9-c685-4601-9c94-2b500f3f92d9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:08.984884 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d9fe84c9-c685-4601-9c94-2b500f3f92d9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:08.992434 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d9fe84c9-c685-4601-9c94-2b500f3f92d9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080780 Mar 03 03:03:08.992998 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1679/3586] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:08 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:10.009564 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e6262eab-a7fe-44a0-ab76-3cea1fe3aa7d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:10.010163 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e6262eab-a7fe-44a0-ab76-3cea1fe3aa7d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:10.017079 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e6262eab-a7fe-44a0-ab76-3cea1fe3aa7d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:10.017533 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e6262eab-a7fe-44a0-ab76-3cea1fe3aa7d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:10.018302 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e6262eab-a7fe-44a0-ab76-3cea1fe3aa7d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:10.018742 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e6262eab-a7fe-44a0-ab76-3cea1fe3aa7d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:10.079763 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e6262eab-a7fe-44a0-ab76-3cea1fe3aa7d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:10.087352 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e6262eab-a7fe-44a0-ab76-3cea1fe3aa7d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.081680 Mar 03 03:03:10.087947 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1908/3587] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:10 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 03:03:11.104586 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4febf82e-c3e3-4368-8e93-e39fd4ba2981 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:11.105191 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4febf82e-c3e3-4368-8e93-e39fd4ba2981 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:11.111716 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4febf82e-c3e3-4368-8e93-e39fd4ba2981 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:11.112162 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4febf82e-c3e3-4368-8e93-e39fd4ba2981 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:11.112932 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4febf82e-c3e3-4368-8e93-e39fd4ba2981 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:11.113365 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4febf82e-c3e3-4368-8e93-e39fd4ba2981 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:11.172522 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4febf82e-c3e3-4368-8e93-e39fd4ba2981 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:11.180213 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4febf82e-c3e3-4368-8e93-e39fd4ba2981 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079740 Mar 03 03:03:11.180804 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1680/3588] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:11 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:12.196928 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-099a55be-f392-4679-9e95-1cce48915d1c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:12.197542 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-099a55be-f392-4679-9e95-1cce48915d1c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:12.203895 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-099a55be-f392-4679-9e95-1cce48915d1c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:12.204349 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-099a55be-f392-4679-9e95-1cce48915d1c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:12.205117 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-099a55be-f392-4679-9e95-1cce48915d1c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:12.205560 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-099a55be-f392-4679-9e95-1cce48915d1c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:12.263374 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-099a55be-f392-4679-9e95-1cce48915d1c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:12.270932 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-099a55be-f392-4679-9e95-1cce48915d1c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.077965 Mar 03 03:03:12.271487 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1909/3589] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:12 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:13.288190 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4cb29423-33b0-466c-812e-8c1e3ce8b093 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:13.288784 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4cb29423-33b0-466c-812e-8c1e3ce8b093 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:13.296033 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4cb29423-33b0-466c-812e-8c1e3ce8b093 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:13.296481 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4cb29423-33b0-466c-812e-8c1e3ce8b093 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:13.297248 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4cb29423-33b0-466c-812e-8c1e3ce8b093 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:13.297678 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4cb29423-33b0-466c-812e-8c1e3ce8b093 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:13.357057 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4cb29423-33b0-466c-812e-8c1e3ce8b093 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:13.365067 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4cb29423-33b0-466c-812e-8c1e3ce8b093 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080677 Mar 03 03:03:13.365629 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1681/3590] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:13 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:14.382254 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-72bd08ed-a3e4-4bd2-8d63-29a637e56430 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:14.382864 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-72bd08ed-a3e4-4bd2-8d63-29a637e56430 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:14.389964 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-72bd08ed-a3e4-4bd2-8d63-29a637e56430 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:14.390418 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-72bd08ed-a3e4-4bd2-8d63-29a637e56430 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:14.391190 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-72bd08ed-a3e4-4bd2-8d63-29a637e56430 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:14.391653 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-72bd08ed-a3e4-4bd2-8d63-29a637e56430 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:14.453276 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-72bd08ed-a3e4-4bd2-8d63-29a637e56430 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:14.460885 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-72bd08ed-a3e4-4bd2-8d63-29a637e56430 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.082641 Mar 03 03:03:14.461445 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1910/3591] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:14 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:15.478061 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b1346015-39e9-40c3-849a-47076d997f4b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:15.478670 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b1346015-39e9-40c3-849a-47076d997f4b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:15.484954 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b1346015-39e9-40c3-849a-47076d997f4b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:15.485407 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b1346015-39e9-40c3-849a-47076d997f4b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:15.486181 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b1346015-39e9-40c3-849a-47076d997f4b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:15.486621 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b1346015-39e9-40c3-849a-47076d997f4b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:15.544698 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b1346015-39e9-40c3-849a-47076d997f4b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:15.552279 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b1346015-39e9-40c3-849a-47076d997f4b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078351 Mar 03 03:03:15.552835 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1682/3592] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:15 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 03:03:16.569175 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-dfc6ab50-1029-49a0-a0e5-759de3d5ccfd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:16.569807 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-dfc6ab50-1029-49a0-a0e5-759de3d5ccfd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:16.578006 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dfc6ab50-1029-49a0-a0e5-759de3d5ccfd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:16.578601 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dfc6ab50-1029-49a0-a0e5-759de3d5ccfd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:16.579475 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dfc6ab50-1029-49a0-a0e5-759de3d5ccfd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:16.579941 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dfc6ab50-1029-49a0-a0e5-759de3d5ccfd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:16.639861 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-dfc6ab50-1029-49a0-a0e5-759de3d5ccfd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:16.647624 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-dfc6ab50-1029-49a0-a0e5-759de3d5ccfd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.082662 Mar 03 03:03:16.648214 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1911/3593] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:16 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:17.664880 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-85388764-80f2-4ef8-9b72-c6bf63d671f6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:17.665475 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-85388764-80f2-4ef8-9b72-c6bf63d671f6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:17.672264 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-85388764-80f2-4ef8-9b72-c6bf63d671f6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:17.672712 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-85388764-80f2-4ef8-9b72-c6bf63d671f6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:17.673480 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-85388764-80f2-4ef8-9b72-c6bf63d671f6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:17.673915 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-85388764-80f2-4ef8-9b72-c6bf63d671f6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:17.732282 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-85388764-80f2-4ef8-9b72-c6bf63d671f6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:17.739779 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-85388764-80f2-4ef8-9b72-c6bf63d671f6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078778 Mar 03 03:03:17.740334 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1683/3594] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:17 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 03:03:18.756623 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ff69bd6d-6e69-417a-9e5b-1951cec5e54f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:18.757217 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ff69bd6d-6e69-417a-9e5b-1951cec5e54f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:18.764140 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ff69bd6d-6e69-417a-9e5b-1951cec5e54f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:18.764590 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ff69bd6d-6e69-417a-9e5b-1951cec5e54f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:18.765355 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ff69bd6d-6e69-417a-9e5b-1951cec5e54f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:18.765785 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ff69bd6d-6e69-417a-9e5b-1951cec5e54f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:18.823451 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ff69bd6d-6e69-417a-9e5b-1951cec5e54f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:18.831913 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ff69bd6d-6e69-417a-9e5b-1951cec5e54f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079157 Mar 03 03:03:18.832473 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1912/3595] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:18 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:19.848710 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3474d46c-a810-4884-9245-d2123d2dc776 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:19.849324 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3474d46c-a810-4884-9245-d2123d2dc776 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:19.856475 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3474d46c-a810-4884-9245-d2123d2dc776 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:19.856932 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3474d46c-a810-4884-9245-d2123d2dc776 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:19.857713 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3474d46c-a810-4884-9245-d2123d2dc776 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:19.858151 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3474d46c-a810-4884-9245-d2123d2dc776 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:19.920479 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3474d46c-a810-4884-9245-d2123d2dc776 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:19.928119 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3474d46c-a810-4884-9245-d2123d2dc776 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.083121 Mar 03 03:03:19.928684 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1684/3596] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:19 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:20.945728 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0852b8d6-6054-4535-93ac-398486b840f0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:20.946320 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0852b8d6-6054-4535-93ac-398486b840f0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:20.953241 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0852b8d6-6054-4535-93ac-398486b840f0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:20.953687 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0852b8d6-6054-4535-93ac-398486b840f0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:20.954450 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0852b8d6-6054-4535-93ac-398486b840f0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:20.954884 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0852b8d6-6054-4535-93ac-398486b840f0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:21.014284 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0852b8d6-6054-4535-93ac-398486b840f0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:21.021975 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0852b8d6-6054-4535-93ac-398486b840f0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080164 Mar 03 03:03:21.022526 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1913/3597] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:20 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:22.038790 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d768b3f7-f32d-4978-9ebe-3e224135b240 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:22.039434 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d768b3f7-f32d-4978-9ebe-3e224135b240 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:22.046369 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d768b3f7-f32d-4978-9ebe-3e224135b240 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:22.046828 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d768b3f7-f32d-4978-9ebe-3e224135b240 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:22.047631 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d768b3f7-f32d-4978-9ebe-3e224135b240 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:22.048084 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d768b3f7-f32d-4978-9ebe-3e224135b240 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:22.106870 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d768b3f7-f32d-4978-9ebe-3e224135b240 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:22.114462 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d768b3f7-f32d-4978-9ebe-3e224135b240 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079558 Mar 03 03:03:22.115017 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1685/3598] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:22 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:23.130244 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7b73f497-879e-4545-a0c5-2eeb2731e155 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:23.130853 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7b73f497-879e-4545-a0c5-2eeb2731e155 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:23.137208 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7b73f497-879e-4545-a0c5-2eeb2731e155 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:23.137656 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7b73f497-879e-4545-a0c5-2eeb2731e155 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:23.138437 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7b73f497-879e-4545-a0c5-2eeb2731e155 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:23.138909 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7b73f497-879e-4545-a0c5-2eeb2731e155 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:23.197485 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-7b73f497-879e-4545-a0c5-2eeb2731e155 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:23.205442 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7b73f497-879e-4545-a0c5-2eeb2731e155 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079063 Mar 03 03:03:23.206006 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1914/3599] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:23 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:24.222482 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-559b2067-bed9-409b-bca3-ef26b74ecaeb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:24.223522 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-559b2067-bed9-409b-bca3-ef26b74ecaeb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:24.229575 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-559b2067-bed9-409b-bca3-ef26b74ecaeb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:24.230985 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-559b2067-bed9-409b-bca3-ef26b74ecaeb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:24.231801 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-559b2067-bed9-409b-bca3-ef26b74ecaeb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:24.232240 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-559b2067-bed9-409b-bca3-ef26b74ecaeb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:24.289676 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-559b2067-bed9-409b-bca3-ef26b74ecaeb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:24.297848 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-559b2067-bed9-409b-bca3-ef26b74ecaeb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079573 Mar 03 03:03:24.298411 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1686/3600] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:24 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:25.316551 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-62da0c2e-d837-4f4f-bb79-3f353b5d8ff4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:25.317117 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-62da0c2e-d837-4f4f-bb79-3f353b5d8ff4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:25.323180 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-62da0c2e-d837-4f4f-bb79-3f353b5d8ff4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:25.324228 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-62da0c2e-d837-4f4f-bb79-3f353b5d8ff4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:25.325043 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-62da0c2e-d837-4f4f-bb79-3f353b5d8ff4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:25.325478 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-62da0c2e-d837-4f4f-bb79-3f353b5d8ff4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:25.384024 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-62da0c2e-d837-4f4f-bb79-3f353b5d8ff4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:25.392087 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-62da0c2e-d837-4f4f-bb79-3f353b5d8ff4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.081177 Mar 03 03:03:25.392638 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1915/3601] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:25 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:26.408668 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e503604a-1778-4b92-bd16-511e1633eb38 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:26.409272 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e503604a-1778-4b92-bd16-511e1633eb38 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:26.415441 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e503604a-1778-4b92-bd16-511e1633eb38 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:26.415921 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e503604a-1778-4b92-bd16-511e1633eb38 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:26.416686 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e503604a-1778-4b92-bd16-511e1633eb38 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:26.417120 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e503604a-1778-4b92-bd16-511e1633eb38 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:26.477491 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e503604a-1778-4b92-bd16-511e1633eb38 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:26.485807 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e503604a-1778-4b92-bd16-511e1633eb38 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.081035 Mar 03 03:03:26.486374 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1687/3602] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:26 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 03:03:27.502489 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-988a2a77-4440-4416-af41-521f44c4d1a2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:27.503091 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-988a2a77-4440-4416-af41-521f44c4d1a2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:27.509241 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-988a2a77-4440-4416-af41-521f44c4d1a2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:27.509687 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-988a2a77-4440-4416-af41-521f44c4d1a2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:27.510452 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-988a2a77-4440-4416-af41-521f44c4d1a2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:27.510882 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-988a2a77-4440-4416-af41-521f44c4d1a2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:27.572077 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-988a2a77-4440-4416-af41-521f44c4d1a2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:27.580590 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-988a2a77-4440-4416-af41-521f44c4d1a2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.081949 Mar 03 03:03:27.581149 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1916/3603] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:27 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:28.597811 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9a28fb8f-d3c0-4c01-9de5-c25a3df1bb43 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:28.598418 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9a28fb8f-d3c0-4c01-9de5-c25a3df1bb43 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:28.605502 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9a28fb8f-d3c0-4c01-9de5-c25a3df1bb43 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:28.606090 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9a28fb8f-d3c0-4c01-9de5-c25a3df1bb43 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:28.606872 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9a28fb8f-d3c0-4c01-9de5-c25a3df1bb43 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:28.607310 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9a28fb8f-d3c0-4c01-9de5-c25a3df1bb43 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:28.664645 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9a28fb8f-d3c0-4c01-9de5-c25a3df1bb43 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:28.673120 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9a28fb8f-d3c0-4c01-9de5-c25a3df1bb43 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079041 Mar 03 03:03:28.673936 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1688/3604] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:28 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:29.690009 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-63bcc701-c299-4848-95d5-89196a1ba175 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:29.690620 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-63bcc701-c299-4848-95d5-89196a1ba175 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:29.696858 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-63bcc701-c299-4848-95d5-89196a1ba175 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:29.697304 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-63bcc701-c299-4848-95d5-89196a1ba175 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:29.698077 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-63bcc701-c299-4848-95d5-89196a1ba175 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:29.699008 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-63bcc701-c299-4848-95d5-89196a1ba175 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:29.756579 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-63bcc701-c299-4848-95d5-89196a1ba175 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:29.765696 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-63bcc701-c299-4848-95d5-89196a1ba175 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079476 Mar 03 03:03:29.766295 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1917/3605] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:29 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:30.782572 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3755abe7-0aa7-4550-b1ef-1a0960f870b2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:30.783204 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3755abe7-0aa7-4550-b1ef-1a0960f870b2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:30.789547 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3755abe7-0aa7-4550-b1ef-1a0960f870b2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:30.790000 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3755abe7-0aa7-4550-b1ef-1a0960f870b2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:30.790776 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3755abe7-0aa7-4550-b1ef-1a0960f870b2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:30.791217 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3755abe7-0aa7-4550-b1ef-1a0960f870b2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:30.850648 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3755abe7-0aa7-4550-b1ef-1a0960f870b2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:30.858655 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3755abe7-0aa7-4550-b1ef-1a0960f870b2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079951 Mar 03 03:03:30.859219 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1689/3606] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:30 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:31.875201 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-62a4889b-40dc-4665-8097-6511f5f4da5d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:31.875872 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-62a4889b-40dc-4665-8097-6511f5f4da5d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:31.882107 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-62a4889b-40dc-4665-8097-6511f5f4da5d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:31.882556 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-62a4889b-40dc-4665-8097-6511f5f4da5d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:31.883324 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-62a4889b-40dc-4665-8097-6511f5f4da5d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:31.883801 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-62a4889b-40dc-4665-8097-6511f5f4da5d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:31.941842 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-62a4889b-40dc-4665-8097-6511f5f4da5d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:31.950123 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-62a4889b-40dc-4665-8097-6511f5f4da5d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078773 Mar 03 03:03:31.950677 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1918/3607] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:31 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:32.967353 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-dc835c4d-c413-4c8c-a985-0ed93ed8c408 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:32.967983 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-dc835c4d-c413-4c8c-a985-0ed93ed8c408 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:32.974207 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dc835c4d-c413-4c8c-a985-0ed93ed8c408 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:32.974662 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dc835c4d-c413-4c8c-a985-0ed93ed8c408 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:32.975431 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dc835c4d-c413-4c8c-a985-0ed93ed8c408 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:32.975896 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dc835c4d-c413-4c8c-a985-0ed93ed8c408 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:33.038210 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-dc835c4d-c413-4c8c-a985-0ed93ed8c408 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:33.046193 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-dc835c4d-c413-4c8c-a985-0ed93ed8c408 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.083894 Mar 03 03:03:33.046803 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1690/3608] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:32 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:34.062658 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7908d84f-ab71-4bed-8cd0-b537f6581e7d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:34.063302 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7908d84f-ab71-4bed-8cd0-b537f6581e7d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:34.069655 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7908d84f-ab71-4bed-8cd0-b537f6581e7d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:34.070236 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7908d84f-ab71-4bed-8cd0-b537f6581e7d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:34.071120 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7908d84f-ab71-4bed-8cd0-b537f6581e7d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:34.071559 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7908d84f-ab71-4bed-8cd0-b537f6581e7d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:34.131710 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-7908d84f-ab71-4bed-8cd0-b537f6581e7d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:34.140094 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7908d84f-ab71-4bed-8cd0-b537f6581e7d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.081407 Mar 03 03:03:34.140676 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1919/3609] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:34 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:35.157716 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7a96bbab-537c-4157-9d63-82af736a76c4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:35.158313 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7a96bbab-537c-4157-9d63-82af736a76c4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:35.164228 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7a96bbab-537c-4157-9d63-82af736a76c4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:35.164680 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7a96bbab-537c-4157-9d63-82af736a76c4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:35.165446 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7a96bbab-537c-4157-9d63-82af736a76c4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:35.165882 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7a96bbab-537c-4157-9d63-82af736a76c4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:35.225331 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-7a96bbab-537c-4157-9d63-82af736a76c4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:35.234668 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7a96bbab-537c-4157-9d63-82af736a76c4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080860 Mar 03 03:03:35.235254 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1691/3610] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:35 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:36.422112 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0ef79bb3-faa4-4381-b187-bf733b290aff tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:36.422720 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0ef79bb3-faa4-4381-b187-bf733b290aff tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:36.428415 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0ef79bb3-faa4-4381-b187-bf733b290aff tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:36.428866 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0ef79bb3-faa4-4381-b187-bf733b290aff tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:36.429643 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0ef79bb3-faa4-4381-b187-bf733b290aff tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:36.430083 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0ef79bb3-faa4-4381-b187-bf733b290aff tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:36.488054 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0ef79bb3-faa4-4381-b187-bf733b290aff tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:36.497788 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0ef79bb3-faa4-4381-b187-bf733b290aff tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.249763 Mar 03 03:03:36.498362 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1920/3611] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:36 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:37.514806 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a5558236-aeb2-49e2-9f89-d144f73151c8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:37.515425 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a5558236-aeb2-49e2-9f89-d144f73151c8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:37.521604 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a5558236-aeb2-49e2-9f89-d144f73151c8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:37.522051 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a5558236-aeb2-49e2-9f89-d144f73151c8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:37.522817 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a5558236-aeb2-49e2-9f89-d144f73151c8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:37.523249 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a5558236-aeb2-49e2-9f89-d144f73151c8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:37.581927 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a5558236-aeb2-49e2-9f89-d144f73151c8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:37.589571 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a5558236-aeb2-49e2-9f89-d144f73151c8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079109 Mar 03 03:03:37.590126 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1692/3612] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:37 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:38.606540 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-22cb6a84-f908-4be7-a62a-6f9a691c45dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:38.607151 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-22cb6a84-f908-4be7-a62a-6f9a691c45dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:38.613369 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-22cb6a84-f908-4be7-a62a-6f9a691c45dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:38.613813 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-22cb6a84-f908-4be7-a62a-6f9a691c45dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:38.614577 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-22cb6a84-f908-4be7-a62a-6f9a691c45dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:38.615012 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-22cb6a84-f908-4be7-a62a-6f9a691c45dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:38.672760 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-22cb6a84-f908-4be7-a62a-6f9a691c45dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:38.680630 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-22cb6a84-f908-4be7-a62a-6f9a691c45dd tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078996 Mar 03 03:03:38.681201 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1921/3613] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:38 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:39.697070 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-eaa649bc-efb7-4c14-bc15-510ff3d396c5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:39.697656 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-eaa649bc-efb7-4c14-bc15-510ff3d396c5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:39.704569 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eaa649bc-efb7-4c14-bc15-510ff3d396c5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:39.705018 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eaa649bc-efb7-4c14-bc15-510ff3d396c5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:39.705785 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eaa649bc-efb7-4c14-bc15-510ff3d396c5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:39.706222 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-eaa649bc-efb7-4c14-bc15-510ff3d396c5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:39.766480 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-eaa649bc-efb7-4c14-bc15-510ff3d396c5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:39.774094 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-eaa649bc-efb7-4c14-bc15-510ff3d396c5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080895 Mar 03 03:03:39.774658 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1693/3614] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:39 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:40.791379 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b1af561c-a668-4404-b806-a277397c44b5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:40.792064 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b1af561c-a668-4404-b806-a277397c44b5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:40.798432 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b1af561c-a668-4404-b806-a277397c44b5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:40.798891 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b1af561c-a668-4404-b806-a277397c44b5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:40.799704 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b1af561c-a668-4404-b806-a277397c44b5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:40.800155 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b1af561c-a668-4404-b806-a277397c44b5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:40.863907 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b1af561c-a668-4404-b806-a277397c44b5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:40.872346 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b1af561c-a668-4404-b806-a277397c44b5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.084948 Mar 03 03:03:40.872914 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1922/3615] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:40 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:41.889164 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ad29e9fc-8aab-4eaf-ad23-6f53a25b4c63 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:41.889767 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ad29e9fc-8aab-4eaf-ad23-6f53a25b4c63 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:41.895974 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ad29e9fc-8aab-4eaf-ad23-6f53a25b4c63 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:41.896425 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ad29e9fc-8aab-4eaf-ad23-6f53a25b4c63 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:41.897196 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ad29e9fc-8aab-4eaf-ad23-6f53a25b4c63 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:41.897631 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ad29e9fc-8aab-4eaf-ad23-6f53a25b4c63 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:41.957360 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ad29e9fc-8aab-4eaf-ad23-6f53a25b4c63 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:41.965084 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ad29e9fc-8aab-4eaf-ad23-6f53a25b4c63 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079848 Mar 03 03:03:41.965653 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1694/3616] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:41 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:42.981014 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8647bd98-59df-4a63-89a3-9558a2f8b6c5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:42.981645 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8647bd98-59df-4a63-89a3-9558a2f8b6c5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:42.988136 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8647bd98-59df-4a63-89a3-9558a2f8b6c5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:42.988583 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8647bd98-59df-4a63-89a3-9558a2f8b6c5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:42.989364 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8647bd98-59df-4a63-89a3-9558a2f8b6c5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:42.989795 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8647bd98-59df-4a63-89a3-9558a2f8b6c5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:43.048501 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8647bd98-59df-4a63-89a3-9558a2f8b6c5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:43.056439 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8647bd98-59df-4a63-89a3-9558a2f8b6c5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079487 Mar 03 03:03:43.057005 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1923/3617] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:42 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:44.073484 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b51ebb64-a005-4801-8fa5-fbe919e9803c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:44.074119 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b51ebb64-a005-4801-8fa5-fbe919e9803c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:44.080315 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b51ebb64-a005-4801-8fa5-fbe919e9803c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:44.080771 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b51ebb64-a005-4801-8fa5-fbe919e9803c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:44.081549 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b51ebb64-a005-4801-8fa5-fbe919e9803c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:44.081991 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b51ebb64-a005-4801-8fa5-fbe919e9803c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:44.305964 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b51ebb64-a005-4801-8fa5-fbe919e9803c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:44.313744 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b51ebb64-a005-4801-8fa5-fbe919e9803c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.244151 Mar 03 03:03:44.314308 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1695/3618] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:44 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:45.330416 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1acabbd3-6443-4646-941e-03e7f5f88c8b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:45.331015 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1acabbd3-6443-4646-941e-03e7f5f88c8b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:45.337376 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1acabbd3-6443-4646-941e-03e7f5f88c8b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:45.337830 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1acabbd3-6443-4646-941e-03e7f5f88c8b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:45.338610 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1acabbd3-6443-4646-941e-03e7f5f88c8b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:45.339543 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1acabbd3-6443-4646-941e-03e7f5f88c8b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:45.398479 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1acabbd3-6443-4646-941e-03e7f5f88c8b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:45.406850 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1acabbd3-6443-4646-941e-03e7f5f88c8b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080364 Mar 03 03:03:45.407402 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1924/3619] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:45 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:46.423428 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e927e470-228f-4b75-a64f-78bd8bdbe86c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:46.424069 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e927e470-228f-4b75-a64f-78bd8bdbe86c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:46.430263 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e927e470-228f-4b75-a64f-78bd8bdbe86c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:46.430714 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e927e470-228f-4b75-a64f-78bd8bdbe86c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:46.431494 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e927e470-228f-4b75-a64f-78bd8bdbe86c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:46.431961 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e927e470-228f-4b75-a64f-78bd8bdbe86c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:46.493699 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e927e470-228f-4b75-a64f-78bd8bdbe86c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:46.501716 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e927e470-228f-4b75-a64f-78bd8bdbe86c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.082230 Mar 03 03:03:46.502265 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1696/3620] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:46 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:47.518726 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3f19bb27-5651-47b4-86db-45fd3208af82 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:47.519330 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3f19bb27-5651-47b4-86db-45fd3208af82 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:47.525561 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3f19bb27-5651-47b4-86db-45fd3208af82 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:47.526013 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3f19bb27-5651-47b4-86db-45fd3208af82 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:47.526782 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3f19bb27-5651-47b4-86db-45fd3208af82 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:47.527219 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3f19bb27-5651-47b4-86db-45fd3208af82 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:47.584955 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-3f19bb27-5651-47b4-86db-45fd3208af82 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:47.592892 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3f19bb27-5651-47b4-86db-45fd3208af82 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078033 Mar 03 03:03:47.593454 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1925/3621] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:47 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:48.609650 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3b51e73b-7b97-4f6a-a5c4-cfb13d795ddf tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:48.610251 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3b51e73b-7b97-4f6a-a5c4-cfb13d795ddf tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:48.616543 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3b51e73b-7b97-4f6a-a5c4-cfb13d795ddf tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:48.616995 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3b51e73b-7b97-4f6a-a5c4-cfb13d795ddf tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:48.617770 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3b51e73b-7b97-4f6a-a5c4-cfb13d795ddf tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:48.618209 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3b51e73b-7b97-4f6a-a5c4-cfb13d795ddf tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:48.675888 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3b51e73b-7b97-4f6a-a5c4-cfb13d795ddf tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:48.683444 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3b51e73b-7b97-4f6a-a5c4-cfb13d795ddf tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.077654 Mar 03 03:03:48.684027 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1697/3622] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:48 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:49.699545 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-98d724b4-0b6d-4876-926c-db8dc29f49a8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:49.700178 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-98d724b4-0b6d-4876-926c-db8dc29f49a8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:49.706324 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-98d724b4-0b6d-4876-926c-db8dc29f49a8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:49.706773 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-98d724b4-0b6d-4876-926c-db8dc29f49a8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:49.707540 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-98d724b4-0b6d-4876-926c-db8dc29f49a8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:49.707997 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-98d724b4-0b6d-4876-926c-db8dc29f49a8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:49.771226 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-98d724b4-0b6d-4876-926c-db8dc29f49a8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:49.779566 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-98d724b4-0b6d-4876-926c-db8dc29f49a8 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.083950 Mar 03 03:03:49.780150 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1926/3623] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:49 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:50.797309 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-58191c66-62c7-4207-bedf-5a21584acac9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:50.797923 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-58191c66-62c7-4207-bedf-5a21584acac9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:50.804136 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-58191c66-62c7-4207-bedf-5a21584acac9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:50.804592 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-58191c66-62c7-4207-bedf-5a21584acac9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:50.805367 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-58191c66-62c7-4207-bedf-5a21584acac9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:50.805803 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-58191c66-62c7-4207-bedf-5a21584acac9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:50.864506 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-58191c66-62c7-4207-bedf-5a21584acac9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:50.873347 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-58191c66-62c7-4207-bedf-5a21584acac9 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079890 Mar 03 03:03:50.873910 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1698/3624] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:50 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:51.890794 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-886d47cb-716c-45a6-804f-34c466cbf383 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:51.891424 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-886d47cb-716c-45a6-804f-34c466cbf383 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:51.899492 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-886d47cb-716c-45a6-804f-34c466cbf383 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:51.899972 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-886d47cb-716c-45a6-804f-34c466cbf383 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:51.900749 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-886d47cb-716c-45a6-804f-34c466cbf383 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:51.901221 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-886d47cb-716c-45a6-804f-34c466cbf383 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:51.960148 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-886d47cb-716c-45a6-804f-34c466cbf383 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:51.968075 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-886d47cb-716c-45a6-804f-34c466cbf383 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.081193 Mar 03 03:03:51.968634 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1927/3625] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:51 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:52.986003 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-00d1b2c0-5468-478b-b96a-aad51fe66694 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:52.986603 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-00d1b2c0-5468-478b-b96a-aad51fe66694 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:52.992845 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-00d1b2c0-5468-478b-b96a-aad51fe66694 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:52.993299 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-00d1b2c0-5468-478b-b96a-aad51fe66694 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:52.994073 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-00d1b2c0-5468-478b-b96a-aad51fe66694 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:52.994519 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-00d1b2c0-5468-478b-b96a-aad51fe66694 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:53.053971 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-00d1b2c0-5468-478b-b96a-aad51fe66694 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:53.063051 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-00d1b2c0-5468-478b-b96a-aad51fe66694 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080967 Mar 03 03:03:53.063651 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1699/3626] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:52 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:54.080106 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a76de6b9-b2bd-45e2-b4fd-9a45690bec9d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:54.080716 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a76de6b9-b2bd-45e2-b4fd-9a45690bec9d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:54.086951 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a76de6b9-b2bd-45e2-b4fd-9a45690bec9d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:54.087391 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a76de6b9-b2bd-45e2-b4fd-9a45690bec9d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:54.088185 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a76de6b9-b2bd-45e2-b4fd-9a45690bec9d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:54.089220 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a76de6b9-b2bd-45e2-b4fd-9a45690bec9d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:54.153479 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a76de6b9-b2bd-45e2-b4fd-9a45690bec9d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:54.161046 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a76de6b9-b2bd-45e2-b4fd-9a45690bec9d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.084796 Mar 03 03:03:54.161601 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1928/3627] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:54 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:55.178593 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-08466625-2e67-4986-a08d-75eca76400ed tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:55.179240 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-08466625-2e67-4986-a08d-75eca76400ed tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:55.185704 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-08466625-2e67-4986-a08d-75eca76400ed tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:55.186155 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-08466625-2e67-4986-a08d-75eca76400ed tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:55.186938 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-08466625-2e67-4986-a08d-75eca76400ed tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:55.187382 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-08466625-2e67-4986-a08d-75eca76400ed tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:55.246083 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-08466625-2e67-4986-a08d-75eca76400ed tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:55.253821 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-08466625-2e67-4986-a08d-75eca76400ed tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079172 Mar 03 03:03:55.254383 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1700/3628] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:55 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:56.270115 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f32c5c43-90d4-4c91-a293-4aaa179c2311 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:56.270729 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f32c5c43-90d4-4c91-a293-4aaa179c2311 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:56.277537 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f32c5c43-90d4-4c91-a293-4aaa179c2311 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:56.277992 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f32c5c43-90d4-4c91-a293-4aaa179c2311 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:56.278773 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f32c5c43-90d4-4c91-a293-4aaa179c2311 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:56.279215 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f32c5c43-90d4-4c91-a293-4aaa179c2311 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:56.495415 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-f32c5c43-90d4-4c91-a293-4aaa179c2311 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:56.503134 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f32c5c43-90d4-4c91-a293-4aaa179c2311 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.236872 Mar 03 03:03:56.503935 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1929/3629] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:56 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:57.519775 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-843af154-00ed-4593-b0ce-a8105b4ac2b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:57.520383 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-843af154-00ed-4593-b0ce-a8105b4ac2b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:57.526738 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-843af154-00ed-4593-b0ce-a8105b4ac2b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:57.527184 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-843af154-00ed-4593-b0ce-a8105b4ac2b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:57.528060 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-843af154-00ed-4593-b0ce-a8105b4ac2b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:57.528500 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-843af154-00ed-4593-b0ce-a8105b4ac2b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:57.592725 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-843af154-00ed-4593-b0ce-a8105b4ac2b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:57.600436 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-843af154-00ed-4593-b0ce-a8105b4ac2b7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.084624 Mar 03 03:03:57.601005 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1701/3630] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:57 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:58.618048 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a0d2f78b-0509-4f1d-894c-3cb600740702 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:58.618631 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a0d2f78b-0509-4f1d-894c-3cb600740702 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:58.624930 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a0d2f78b-0509-4f1d-894c-3cb600740702 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:58.625367 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a0d2f78b-0509-4f1d-894c-3cb600740702 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:58.626128 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a0d2f78b-0509-4f1d-894c-3cb600740702 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:58.626564 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a0d2f78b-0509-4f1d-894c-3cb600740702 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:58.683704 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a0d2f78b-0509-4f1d-894c-3cb600740702 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:58.691215 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a0d2f78b-0509-4f1d-894c-3cb600740702 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.077031 Mar 03 03:03:58.691790 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1930/3631] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:58 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:03:59.707452 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6224c8b6-7b3b-4a52-93d1-b767aec53253 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:03:59.708108 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6224c8b6-7b3b-4a52-93d1-b767aec53253 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:03:59.714592 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6224c8b6-7b3b-4a52-93d1-b767aec53253 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:59.715048 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6224c8b6-7b3b-4a52-93d1-b767aec53253 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:59.715963 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6224c8b6-7b3b-4a52-93d1-b767aec53253 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:03:59.716412 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6224c8b6-7b3b-4a52-93d1-b767aec53253 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:03:59.775038 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-6224c8b6-7b3b-4a52-93d1-b767aec53253 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:03:59.782763 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6224c8b6-7b3b-4a52-93d1-b767aec53253 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079202 Mar 03 03:03:59.783319 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1702/3632] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:03:59 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:04:00.799962 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e9cf776b-ef05-4814-86b3-8ce5bcd9be35 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:00.800589 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e9cf776b-ef05-4814-86b3-8ce5bcd9be35 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:00.806633 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e9cf776b-ef05-4814-86b3-8ce5bcd9be35 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:00.807625 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e9cf776b-ef05-4814-86b3-8ce5bcd9be35 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:00.808589 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e9cf776b-ef05-4814-86b3-8ce5bcd9be35 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:00.809018 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e9cf776b-ef05-4814-86b3-8ce5bcd9be35 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:00.866563 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e9cf776b-ef05-4814-86b3-8ce5bcd9be35 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:00.874814 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e9cf776b-ef05-4814-86b3-8ce5bcd9be35 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078727 Mar 03 03:04:00.875365 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1931/3633] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:00 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:04:01.891571 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-26a0765f-2898-4d8c-a823-2e115505082d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:01.892202 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-26a0765f-2898-4d8c-a823-2e115505082d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:01.898444 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-26a0765f-2898-4d8c-a823-2e115505082d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:01.898893 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-26a0765f-2898-4d8c-a823-2e115505082d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:01.899734 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-26a0765f-2898-4d8c-a823-2e115505082d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:01.900166 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-26a0765f-2898-4d8c-a823-2e115505082d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:01.959430 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-26a0765f-2898-4d8c-a823-2e115505082d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:01.968003 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-26a0765f-2898-4d8c-a823-2e115505082d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080261 Mar 03 03:04:01.968564 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1703/3634] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:01 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:04:02.985787 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b14fde7f-0ee0-4645-8846-7b7c9bf77341 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:02.986392 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b14fde7f-0ee0-4645-8846-7b7c9bf77341 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:02.992791 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b14fde7f-0ee0-4645-8846-7b7c9bf77341 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:02.993239 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b14fde7f-0ee0-4645-8846-7b7c9bf77341 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:02.994012 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b14fde7f-0ee0-4645-8846-7b7c9bf77341 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:02.994450 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b14fde7f-0ee0-4645-8846-7b7c9bf77341 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:03.012900 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 03:04:03.013140 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: Thu Mar 3 03:04:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb (ip 10.222.0.30) !!! Mar 03 03:04:03.059426 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b14fde7f-0ee0-4645-8846-7b7c9bf77341 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:03.067597 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b14fde7f-0ee0-4645-8846-7b7c9bf77341 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.085670 Mar 03 03:04:03.068193 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1932/3635] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:02 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:04:04.084680 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f9f6d31f-bbdd-4f6b-a6ac-45b53db9b54b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:04.085277 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f9f6d31f-bbdd-4f6b-a6ac-45b53db9b54b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:04.091477 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f9f6d31f-bbdd-4f6b-a6ac-45b53db9b54b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:04.091956 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f9f6d31f-bbdd-4f6b-a6ac-45b53db9b54b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:04.092723 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f9f6d31f-bbdd-4f6b-a6ac-45b53db9b54b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:04.093157 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f9f6d31f-bbdd-4f6b-a6ac-45b53db9b54b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:04.151849 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f9f6d31f-bbdd-4f6b-a6ac-45b53db9b54b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:04.159646 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f9f6d31f-bbdd-4f6b-a6ac-45b53db9b54b tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078780 Mar 03 03:04:04.160227 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1704/3636] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:04 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:04:04.190920 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 03:04:04.191061 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: Thu Mar 3 03:04:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 03 03:04:05.176982 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-98093e81-df2a-4b23-bf2b-30a0ed847738 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:05.177593 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-98093e81-df2a-4b23-bf2b-30a0ed847738 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:05.184648 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-98093e81-df2a-4b23-bf2b-30a0ed847738 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:05.185111 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-98093e81-df2a-4b23-bf2b-30a0ed847738 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:05.187859 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-98093e81-df2a-4b23-bf2b-30a0ed847738 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:05.187859 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-98093e81-df2a-4b23-bf2b-30a0ed847738 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:05.262370 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-98093e81-df2a-4b23-bf2b-30a0ed847738 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:05.270333 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-98093e81-df2a-4b23-bf2b-30a0ed847738 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.097076 Mar 03 03:04:05.271002 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1933/3637] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:05 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:04:06.287875 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-930efffa-a531-4c63-a9c2-4570eb6b54f1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:06.288484 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-930efffa-a531-4c63-a9c2-4570eb6b54f1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:06.294629 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-930efffa-a531-4c63-a9c2-4570eb6b54f1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:06.295107 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-930efffa-a531-4c63-a9c2-4570eb6b54f1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:06.295900 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-930efffa-a531-4c63-a9c2-4570eb6b54f1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:06.296337 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-930efffa-a531-4c63-a9c2-4570eb6b54f1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:06.355528 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-930efffa-a531-4c63-a9c2-4570eb6b54f1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:06.363183 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-930efffa-a531-4c63-a9c2-4570eb6b54f1 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079320 Mar 03 03:04:06.363755 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1705/3638] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:06 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:04:07.380609 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-47d83ca1-d621-48d4-a33f-bb5c65062de4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:07.381217 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-47d83ca1-d621-48d4-a33f-bb5c65062de4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:07.388021 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-47d83ca1-d621-48d4-a33f-bb5c65062de4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:07.388473 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-47d83ca1-d621-48d4-a33f-bb5c65062de4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:07.389247 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-47d83ca1-d621-48d4-a33f-bb5c65062de4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:07.389678 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-47d83ca1-d621-48d4-a33f-bb5c65062de4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:07.447382 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-47d83ca1-d621-48d4-a33f-bb5c65062de4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:07.455815 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-47d83ca1-d621-48d4-a33f-bb5c65062de4 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079035 Mar 03 03:04:07.456372 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1934/3639] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:07 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:04:08.473084 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-160fa24c-ef71-4974-91cd-452a2987bd49 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:08.473673 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-160fa24c-ef71-4974-91cd-452a2987bd49 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:08.480123 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-160fa24c-ef71-4974-91cd-452a2987bd49 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:08.481192 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-160fa24c-ef71-4974-91cd-452a2987bd49 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:08.481971 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-160fa24c-ef71-4974-91cd-452a2987bd49 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:08.482403 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-160fa24c-ef71-4974-91cd-452a2987bd49 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:08.540102 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-160fa24c-ef71-4974-91cd-452a2987bd49 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:08.548663 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-160fa24c-ef71-4974-91cd-452a2987bd49 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079457 Mar 03 03:04:08.549229 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1706/3640] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:08 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:04:09.565896 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-8959161f-e892-458f-9491-985b5f38d85d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:09.566496 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-8959161f-e892-458f-9491-985b5f38d85d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:09.572739 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8959161f-e892-458f-9491-985b5f38d85d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:09.573192 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8959161f-e892-458f-9491-985b5f38d85d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:09.573981 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8959161f-e892-458f-9491-985b5f38d85d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:09.574420 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-8959161f-e892-458f-9491-985b5f38d85d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:09.634035 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-8959161f-e892-458f-9491-985b5f38d85d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:09.641711 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-8959161f-e892-458f-9491-985b5f38d85d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079707 Mar 03 03:04:09.642275 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1935/3641] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:09 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:04:10.658419 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-79046ab7-2592-47be-b399-387675e0b562 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:10.659022 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-79046ab7-2592-47be-b399-387675e0b562 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:10.665237 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-79046ab7-2592-47be-b399-387675e0b562 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:10.665690 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-79046ab7-2592-47be-b399-387675e0b562 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:10.666466 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-79046ab7-2592-47be-b399-387675e0b562 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:10.666904 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-79046ab7-2592-47be-b399-387675e0b562 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:10.730434 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-79046ab7-2592-47be-b399-387675e0b562 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:10.738199 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-79046ab7-2592-47be-b399-387675e0b562 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.083663 Mar 03 03:04:10.738760 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1707/3642] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:10 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:04:11.755659 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-94abc019-2e20-4155-a38a-b1f41c32820d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:11.756307 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-94abc019-2e20-4155-a38a-b1f41c32820d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:11.763200 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-94abc019-2e20-4155-a38a-b1f41c32820d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:11.763674 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-94abc019-2e20-4155-a38a-b1f41c32820d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:11.764442 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-94abc019-2e20-4155-a38a-b1f41c32820d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:11.764876 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-94abc019-2e20-4155-a38a-b1f41c32820d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:11.822553 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-94abc019-2e20-4155-a38a-b1f41c32820d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:11.830858 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-94abc019-2e20-4155-a38a-b1f41c32820d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079036 Mar 03 03:04:11.831416 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1936/3643] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:11 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:04:12.848769 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e94a97a1-a72b-4920-9810-54552883fb9c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:12.849373 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e94a97a1-a72b-4920-9810-54552883fb9c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:12.856541 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e94a97a1-a72b-4920-9810-54552883fb9c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:12.856917 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e94a97a1-a72b-4920-9810-54552883fb9c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:12.857696 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e94a97a1-a72b-4920-9810-54552883fb9c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:12.858137 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e94a97a1-a72b-4920-9810-54552883fb9c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:12.915764 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e94a97a1-a72b-4920-9810-54552883fb9c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:12.924277 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e94a97a1-a72b-4920-9810-54552883fb9c tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079351 Mar 03 03:04:12.924848 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1708/3644] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:12 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:04:13.940279 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e94c4e56-7744-435b-91f3-b8083b4f649d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:13.940892 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e94c4e56-7744-435b-91f3-b8083b4f649d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:13.947535 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e94c4e56-7744-435b-91f3-b8083b4f649d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:13.948020 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e94c4e56-7744-435b-91f3-b8083b4f649d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:13.948804 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e94c4e56-7744-435b-91f3-b8083b4f649d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:13.949847 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e94c4e56-7744-435b-91f3-b8083b4f649d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:14.008606 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e94c4e56-7744-435b-91f3-b8083b4f649d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:14.016996 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e94c4e56-7744-435b-91f3-b8083b4f649d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080602 Mar 03 03:04:14.017548 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1937/3645] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:13 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:04:14.114872 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 03:04:14.115098 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: Thu Mar 3 03:04:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 03 03:04:15.033672 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d52fa5a3-7375-476c-95d1-1c96c9875fc7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:15.034306 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d52fa5a3-7375-476c-95d1-1c96c9875fc7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:15.040386 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d52fa5a3-7375-476c-95d1-1c96c9875fc7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:15.040841 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d52fa5a3-7375-476c-95d1-1c96c9875fc7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:15.041624 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d52fa5a3-7375-476c-95d1-1c96c9875fc7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:15.042095 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d52fa5a3-7375-476c-95d1-1c96c9875fc7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:15.101094 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d52fa5a3-7375-476c-95d1-1c96c9875fc7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:15.109144 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d52fa5a3-7375-476c-95d1-1c96c9875fc7 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079395 Mar 03 03:04:15.109703 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1709/3646] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:15 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:04:16.126580 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5ddbba4e-a637-4bd6-bf99-4d59cb22ee01 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:16.127185 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5ddbba4e-a637-4bd6-bf99-4d59cb22ee01 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:16.133404 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5ddbba4e-a637-4bd6-bf99-4d59cb22ee01 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:16.133853 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5ddbba4e-a637-4bd6-bf99-4d59cb22ee01 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:16.134629 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5ddbba4e-a637-4bd6-bf99-4d59cb22ee01 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:16.135068 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5ddbba4e-a637-4bd6-bf99-4d59cb22ee01 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:16.193566 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-5ddbba4e-a637-4bd6-bf99-4d59cb22ee01 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:16.201249 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5ddbba4e-a637-4bd6-bf99-4d59cb22ee01 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078536 Mar 03 03:04:16.201801 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1938/3647] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:16 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 03:04:17.218559 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-748a93f3-d06c-4efc-b225-11a350f88abe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:17.219166 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-748a93f3-d06c-4efc-b225-11a350f88abe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:17.225359 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-748a93f3-d06c-4efc-b225-11a350f88abe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:17.225809 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-748a93f3-d06c-4efc-b225-11a350f88abe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:17.226581 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-748a93f3-d06c-4efc-b225-11a350f88abe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:17.227268 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-748a93f3-d06c-4efc-b225-11a350f88abe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:17.285221 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-748a93f3-d06c-4efc-b225-11a350f88abe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:17.293477 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-748a93f3-d06c-4efc-b225-11a350f88abe tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078876 Mar 03 03:04:17.293981 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1710/3648] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:17 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:04:18.310821 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-889a23b9-a673-4a83-93bf-6c684e9d0ea5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:18.311407 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-889a23b9-a673-4a83-93bf-6c684e9d0ea5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:18.317516 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-889a23b9-a673-4a83-93bf-6c684e9d0ea5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:18.317967 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-889a23b9-a673-4a83-93bf-6c684e9d0ea5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:18.318734 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-889a23b9-a673-4a83-93bf-6c684e9d0ea5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:18.319169 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-889a23b9-a673-4a83-93bf-6c684e9d0ea5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:18.381047 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-889a23b9-a673-4a83-93bf-6c684e9d0ea5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:18.388712 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-889a23b9-a673-4a83-93bf-6c684e9d0ea5 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.082550 Mar 03 03:04:18.389271 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1939/3649] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:18 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:04:19.405800 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ea6affc5-0bad-4ad9-964c-4bbb95ca36e0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:19.406407 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ea6affc5-0bad-4ad9-964c-4bbb95ca36e0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:19.412709 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ea6affc5-0bad-4ad9-964c-4bbb95ca36e0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:19.413161 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ea6affc5-0bad-4ad9-964c-4bbb95ca36e0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:19.413939 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ea6affc5-0bad-4ad9-964c-4bbb95ca36e0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:19.414382 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ea6affc5-0bad-4ad9-964c-4bbb95ca36e0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:19.472257 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ea6affc5-0bad-4ad9-964c-4bbb95ca36e0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:19.480162 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ea6affc5-0bad-4ad9-964c-4bbb95ca36e0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078823 Mar 03 03:04:19.480861 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1711/3650] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:19 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:04:20.497692 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ffbd888c-9545-4af5-b921-02afd7482dc0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:20.498298 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ffbd888c-9545-4af5-b921-02afd7482dc0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:20.504629 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ffbd888c-9545-4af5-b921-02afd7482dc0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:20.505082 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ffbd888c-9545-4af5-b921-02afd7482dc0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:20.505861 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ffbd888c-9545-4af5-b921-02afd7482dc0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:20.506302 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ffbd888c-9545-4af5-b921-02afd7482dc0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:20.567511 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ffbd888c-9545-4af5-b921-02afd7482dc0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:20.576486 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ffbd888c-9545-4af5-b921-02afd7482dc0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.083298 Mar 03 03:04:20.577049 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1940/3651] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:20 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:04:21.593408 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-34039569-e187-485b-9c6b-121b6415e489 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:21.594049 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-34039569-e187-485b-9c6b-121b6415e489 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:21.600294 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-34039569-e187-485b-9c6b-121b6415e489 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:21.600748 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-34039569-e187-485b-9c6b-121b6415e489 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:21.601524 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-34039569-e187-485b-9c6b-121b6415e489 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:21.602219 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-34039569-e187-485b-9c6b-121b6415e489 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:21.660104 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-34039569-e187-485b-9c6b-121b6415e489 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:21.668406 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-34039569-e187-485b-9c6b-121b6415e489 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078257 Mar 03 03:04:21.668988 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1712/3652] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:21 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:04:22.685619 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-547f855e-d1e0-48c7-8af5-bb96efe9716e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:22.686244 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-547f855e-d1e0-48c7-8af5-bb96efe9716e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:22.692500 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-547f855e-d1e0-48c7-8af5-bb96efe9716e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:22.692959 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-547f855e-d1e0-48c7-8af5-bb96efe9716e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:22.693744 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-547f855e-d1e0-48c7-8af5-bb96efe9716e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:22.694186 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-547f855e-d1e0-48c7-8af5-bb96efe9716e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:22.754519 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-547f855e-d1e0-48c7-8af5-bb96efe9716e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:22.762727 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-547f855e-d1e0-48c7-8af5-bb96efe9716e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.081456 Mar 03 03:04:22.763287 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1941/3653] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:22 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:04:23.779665 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9aec772f-1bd1-486d-a64d-ba5f4ebce5e0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:23.780272 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9aec772f-1bd1-486d-a64d-ba5f4ebce5e0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:23.786420 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9aec772f-1bd1-486d-a64d-ba5f4ebce5e0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:23.786868 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9aec772f-1bd1-486d-a64d-ba5f4ebce5e0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:23.787663 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9aec772f-1bd1-486d-a64d-ba5f4ebce5e0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:23.788101 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9aec772f-1bd1-486d-a64d-ba5f4ebce5e0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:23.852548 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9aec772f-1bd1-486d-a64d-ba5f4ebce5e0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:23.861594 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9aec772f-1bd1-486d-a64d-ba5f4ebce5e0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.086090 Mar 03 03:04:23.862159 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1713/3654] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:23 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:04:24.877949 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-319a57bf-5db5-460d-bfde-e1e8a253d1e6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:24.878561 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-319a57bf-5db5-460d-bfde-e1e8a253d1e6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:24.884695 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-319a57bf-5db5-460d-bfde-e1e8a253d1e6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:24.885140 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-319a57bf-5db5-460d-bfde-e1e8a253d1e6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:24.885935 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-319a57bf-5db5-460d-bfde-e1e8a253d1e6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:24.887039 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-319a57bf-5db5-460d-bfde-e1e8a253d1e6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:24.944488 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-319a57bf-5db5-460d-bfde-e1e8a253d1e6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:24.952923 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-319a57bf-5db5-460d-bfde-e1e8a253d1e6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078769 Mar 03 03:04:24.953478 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1942/3655] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:24 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:04:25.969726 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-573f1319-cff4-413f-927a-44cfcf641cb2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:25.970340 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-573f1319-cff4-413f-927a-44cfcf641cb2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:25.976980 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-573f1319-cff4-413f-927a-44cfcf641cb2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:25.977440 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-573f1319-cff4-413f-927a-44cfcf641cb2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:25.978222 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-573f1319-cff4-413f-927a-44cfcf641cb2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:25.978663 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-573f1319-cff4-413f-927a-44cfcf641cb2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:26.038949 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-573f1319-cff4-413f-927a-44cfcf641cb2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:26.047093 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-573f1319-cff4-413f-927a-44cfcf641cb2 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.081302 Mar 03 03:04:26.047672 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1714/3656] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:25 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:04:27.064027 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-74c872b5-9bab-4736-9b3a-39f40b490f15 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:27.064638 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-74c872b5-9bab-4736-9b3a-39f40b490f15 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:27.070806 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-74c872b5-9bab-4736-9b3a-39f40b490f15 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:27.071253 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-74c872b5-9bab-4736-9b3a-39f40b490f15 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:27.072049 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-74c872b5-9bab-4736-9b3a-39f40b490f15 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:27.072483 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-74c872b5-9bab-4736-9b3a-39f40b490f15 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:27.130460 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-74c872b5-9bab-4736-9b3a-39f40b490f15 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:27.138421 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-74c872b5-9bab-4736-9b3a-39f40b490f15 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078395 Mar 03 03:04:27.138980 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1943/3657] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:27 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:04:28.154776 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b03defee-8f32-4b42-a581-159176d10f00 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:28.155384 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b03defee-8f32-4b42-a581-159176d10f00 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:28.161654 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b03defee-8f32-4b42-a581-159176d10f00 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:28.162110 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b03defee-8f32-4b42-a581-159176d10f00 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:28.162882 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b03defee-8f32-4b42-a581-159176d10f00 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:28.163330 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b03defee-8f32-4b42-a581-159176d10f00 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:28.223410 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b03defee-8f32-4b42-a581-159176d10f00 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:28.231410 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b03defee-8f32-4b42-a581-159176d10f00 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.081131 Mar 03 03:04:28.231989 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1715/3658] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:28 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:04:29.247799 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-85c353eb-14ac-4c88-818e-c5a296e202b6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:29.248385 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-85c353eb-14ac-4c88-818e-c5a296e202b6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:29.254355 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-85c353eb-14ac-4c88-818e-c5a296e202b6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:29.254833 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-85c353eb-14ac-4c88-818e-c5a296e202b6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:29.255634 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-85c353eb-14ac-4c88-818e-c5a296e202b6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:29.256065 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-85c353eb-14ac-4c88-818e-c5a296e202b6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:29.315780 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-85c353eb-14ac-4c88-818e-c5a296e202b6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:29.323426 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-85c353eb-14ac-4c88-818e-c5a296e202b6 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.079751 Mar 03 03:04:29.324299 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1944/3659] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:29 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:04:30.340494 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-17a190c4-273c-4a96-b648-2bfaec9b11fb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:30.341100 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-17a190c4-273c-4a96-b648-2bfaec9b11fb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:30.347236 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-17a190c4-273c-4a96-b648-2bfaec9b11fb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:30.347713 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-17a190c4-273c-4a96-b648-2bfaec9b11fb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:30.348485 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-17a190c4-273c-4a96-b648-2bfaec9b11fb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:30.348918 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-17a190c4-273c-4a96-b648-2bfaec9b11fb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:30.407795 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-17a190c4-273c-4a96-b648-2bfaec9b11fb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:30.415427 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-17a190c4-273c-4a96-b648-2bfaec9b11fb tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078867 Mar 03 03:04:30.416023 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1716/3660] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:30 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:04:31.433963 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3296dd98-aeb5-47fc-bbca-c3ebd309295f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:31.434565 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3296dd98-aeb5-47fc-bbca-c3ebd309295f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:31.440755 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3296dd98-aeb5-47fc-bbca-c3ebd309295f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:31.441205 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3296dd98-aeb5-47fc-bbca-c3ebd309295f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:31.441983 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3296dd98-aeb5-47fc-bbca-c3ebd309295f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:31.442412 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3296dd98-aeb5-47fc-bbca-c3ebd309295f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:31.506276 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-3296dd98-aeb5-47fc-bbca-c3ebd309295f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:31.514387 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3296dd98-aeb5-47fc-bbca-c3ebd309295f tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.084983 Mar 03 03:04:31.514953 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1945/3661] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:31 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:04:32.531494 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-821562a5-9b18-4af6-b185-ae820bfdee22 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:32.532100 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-821562a5-9b18-4af6-b185-ae820bfdee22 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:32.538491 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-821562a5-9b18-4af6-b185-ae820bfdee22 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:32.538941 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-821562a5-9b18-4af6-b185-ae820bfdee22 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:32.539742 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-821562a5-9b18-4af6-b185-ae820bfdee22 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:32.540178 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-821562a5-9b18-4af6-b185-ae820bfdee22 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:32.599277 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-821562a5-9b18-4af6-b185-ae820bfdee22 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:32.607212 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-821562a5-9b18-4af6-b185-ae820bfdee22 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080088 Mar 03 03:04:32.607785 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1717/3662] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:32 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:04:33.625170 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e80d4282-d63f-4c43-bb4c-522282ab46c0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:33.625782 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e80d4282-d63f-4c43-bb4c-522282ab46c0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:33.632083 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e80d4282-d63f-4c43-bb4c-522282ab46c0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:33.632534 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e80d4282-d63f-4c43-bb4c-522282ab46c0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:33.633311 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e80d4282-d63f-4c43-bb4c-522282ab46c0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:33.633743 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e80d4282-d63f-4c43-bb4c-522282ab46c0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:33.693230 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e80d4282-d63f-4c43-bb4c-522282ab46c0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:33.701398 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e80d4282-d63f-4c43-bb4c-522282ab46c0 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.080996 Mar 03 03:04:33.701959 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1946/3663] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:33 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:04:34.228452 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 03:04:34.228983 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: Thu Mar 3 03:04:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 03 03:04:34.718326 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-fd27043d-73a5-4ce1-9098-013a92ff4f14 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:34.718927 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-fd27043d-73a5-4ce1-9098-013a92ff4f14 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:34.725201 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fd27043d-73a5-4ce1-9098-013a92ff4f14 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:34.725650 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fd27043d-73a5-4ce1-9098-013a92ff4f14 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:34.726422 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fd27043d-73a5-4ce1-9098-013a92ff4f14 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:34.727110 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-fd27043d-73a5-4ce1-9098-013a92ff4f14 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:34.785044 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-fd27043d-73a5-4ce1-9098-013a92ff4f14 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:34.792602 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-fd27043d-73a5-4ce1-9098-013a92ff4f14 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.078280 Mar 03 03:04:34.793159 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1718/3664] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:34 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:04:35.809787 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-da30faf6-78d8-45b9-841f-b0ff2ae3b41a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:35.810379 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-da30faf6-78d8-45b9-841f-b0ff2ae3b41a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:35.816292 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-da30faf6-78d8-45b9-841f-b0ff2ae3b41a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:35.816738 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-da30faf6-78d8-45b9-841f-b0ff2ae3b41a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:35.817505 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-da30faf6-78d8-45b9-841f-b0ff2ae3b41a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:35.817936 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-da30faf6-78d8-45b9-841f-b0ff2ae3b41a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:35.879770 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-da30faf6-78d8-45b9-841f-b0ff2ae3b41a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:35.888124 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-da30faf6-78d8-45b9-841f-b0ff2ae3b41a tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.082797 Mar 03 03:04:35.888692 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1947/3665] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:35 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:04:36.829612 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2f486410-2ae4-4bb8-a2f9-db292df71e72 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:36.830170 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2f486410-2ae4-4bb8-a2f9-db292df71e72 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 530afc76-5f4b-470c-a4fe-6ecb6f5dbb97] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:36.836594 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f486410-2ae4-4bb8-a2f9-db292df71e72 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:36.837055 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f486410-2ae4-4bb8-a2f9-db292df71e72 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:36.837852 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f486410-2ae4-4bb8-a2f9-db292df71e72 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:36.838296 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2f486410-2ae4-4bb8-a2f9-db292df71e72 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:36.863729 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2f486410-2ae4-4bb8-a2f9-db292df71e72 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 530afc76-5f4b-470c-a4fe-6ecb6f5dbb97] Going to try to terminate instance {{(pid=116859) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 03 03:04:36.905762 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-450ed699-ff1c-4f53-b8fb-6a4765d6927e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:36.906450 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-450ed699-ff1c-4f53-b8fb-6a4765d6927e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:36.912856 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-450ed699-ff1c-4f53-b8fb-6a4765d6927e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:36.913305 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-450ed699-ff1c-4f53-b8fb-6a4765d6927e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:36.914085 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-450ed699-ff1c-4f53-b8fb-6a4765d6927e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:36.914638 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-450ed699-ff1c-4f53-b8fb-6a4765d6927e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:36.941429 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2f486410-2ae4-4bb8-a2f9-db292df71e72 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "DELETE /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97" status: 204 len: 0 microversion: 2.1 time: 0.115258 Mar 03 03:04:36.944838 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1719/3666] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Mar 3 03:04:36 2022] DELETE /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 03 03:04:36.950251 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3b77f189-b4e9-48f9-9499-4bcbb58e67f7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:36.950964 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3b77f189-b4e9-48f9-9499-4bcbb58e67f7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 530afc76-5f4b-470c-a4fe-6ecb6f5dbb97] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:36.956953 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3b77f189-b4e9-48f9-9499-4bcbb58e67f7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:36.957409 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3b77f189-b4e9-48f9-9499-4bcbb58e67f7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:36.958195 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3b77f189-b4e9-48f9-9499-4bcbb58e67f7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:36.958635 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3b77f189-b4e9-48f9-9499-4bcbb58e67f7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:36.983309 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-450ed699-ff1c-4f53-b8fb-6a4765d6927e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:36.991078 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-450ed699-ff1c-4f53-b8fb-6a4765d6927e tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.089837 Mar 03 03:04:36.991661 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1948/3667] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:36 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 03:04:37.096773 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3b77f189-b4e9-48f9-9499-4bcbb58e67f7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:37.104187 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3b77f189-b4e9-48f9-9499-4bcbb58e67f7 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97" status: 200 len: 1513 microversion: 2.1 time: 0.158094 Mar 03 03:04:37.104789 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1720/3668] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:36 2022] GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 03:04:38.004606 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [req-30ac5194-350e-4cac-a9a4-31356b2be576 req-607740ae-d88c-4473-a919-cf88a006dddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "530afc76-5f4b-470c-a4fe-6ecb6f5dbb97", "name": "network-vif-deleted", "tag": "1828ce31-b2f8-47d4-8193-c1c71a8d2361"}]} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 03:04:38.008221 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-860ef5fc-e980-4185-80d3-b6ed0cf2c62d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:38.009427 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-860ef5fc-e980-4185-80d3-b6ed0cf2c62d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:38.015209 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-30ac5194-350e-4cac-a9a4-31356b2be576 req-607740ae-d88c-4473-a919-cf88a006dddf service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:38.015891 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-30ac5194-350e-4cac-a9a4-31356b2be576 req-607740ae-d88c-4473-a919-cf88a006dddf service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:38.017655 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-860ef5fc-e980-4185-80d3-b6ed0cf2c62d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:38.018411 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-860ef5fc-e980-4185-80d3-b6ed0cf2c62d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:38.019661 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-860ef5fc-e980-4185-80d3-b6ed0cf2c62d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:38.021285 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-860ef5fc-e980-4185-80d3-b6ed0cf2c62d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:38.029019 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.compute.server_external_events [req-30ac5194-350e-4cac-a9a4-31356b2be576 req-607740ae-d88c-4473-a919-cf88a006dddf service nova] Creating event network-vif-deleted:1828ce31-b2f8-47d4-8193-c1c71a8d2361 for instance 530afc76-5f4b-470c-a4fe-6ecb6f5dbb97 on hv-cinder-81977 Mar 03 03:04:38.034150 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [req-30ac5194-350e-4cac-a9a4-31356b2be576 req-607740ae-d88c-4473-a919-cf88a006dddf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106802 Mar 03 03:04:38.034962 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1949/3669] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 03:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 03:04:38.095446 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-860ef5fc-e980-4185-80d3-b6ed0cf2c62d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:38.103489 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-860ef5fc-e980-4185-80d3-b6ed0cf2c62d tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.099586 Mar 03 03:04:38.104076 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1721/3670] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:38 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 03:04:38.121801 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-462cb9a8-ef12-436a-993b-dd7783b6030f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:38.122494 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-462cb9a8-ef12-436a-993b-dd7783b6030f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 530afc76-5f4b-470c-a4fe-6ecb6f5dbb97] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:38.128612 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-462cb9a8-ef12-436a-993b-dd7783b6030f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:38.129064 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-462cb9a8-ef12-436a-993b-dd7783b6030f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:38.129844 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-462cb9a8-ef12-436a-993b-dd7783b6030f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:38.130279 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-462cb9a8-ef12-436a-993b-dd7783b6030f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:38.159700 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-462cb9a8-ef12-436a-993b-dd7783b6030f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:38.160158 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-462cb9a8-ef12-436a-993b-dd7783b6030f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:38.160601 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.objects.instance [None req-462cb9a8-ef12-436a-993b-dd7783b6030f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lazy-loading 'fault' on Instance uuid 530afc76-5f4b-470c-a4fe-6ecb6f5dbb97 {{(pid=116858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 03 03:04:38.201460 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-462cb9a8-ef12-436a-993b-dd7783b6030f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:38.208609 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-462cb9a8-ef12-436a-993b-dd7783b6030f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97" status: 200 len: 1308 microversion: 2.1 time: 0.091090 Mar 03 03:04:38.209165 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1950/3671] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:38 2022] GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97 => generated 1308 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:04:39.120128 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e89aed32-de96-4f40-bddc-407532877f91 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:39.120941 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e89aed32-de96-4f40-bddc-407532877f91 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] [instance: 0b9116d7-0099-4dfe-b678-192ce74500eb] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:39.127163 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e89aed32-de96-4f40-bddc-407532877f91 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:39.127643 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e89aed32-de96-4f40-bddc-407532877f91 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:39.128434 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e89aed32-de96-4f40-bddc-407532877f91 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:39.128909 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e89aed32-de96-4f40-bddc-407532877f91 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:39.189703 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e89aed32-de96-4f40-bddc-407532877f91 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a361064e2d3041e1aee265c55537a5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7cef8f5ec6400c9fa6ebbacdb82241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:39.197345 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e89aed32-de96-4f40-bddc-407532877f91 tempest-ServerRescueNegativeTestJSON-1271988099 tempest-ServerRescueNegativeTestJSON-1271988099-project] 10.222.0.30 "GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb" status: 200 len: 1352 microversion: 2.1 time: 0.081086 Mar 03 03:04:39.197907 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1722/3672] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:39 2022] GET /compute/v2.1/servers/0b9116d7-0099-4dfe-b678-192ce74500eb => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:04:39.225571 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f5a23056-50fa-46cc-b7df-69416bd1552d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:39.226261 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-f5a23056-50fa-46cc-b7df-69416bd1552d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 530afc76-5f4b-470c-a4fe-6ecb6f5dbb97] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:39.233606 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f5a23056-50fa-46cc-b7df-69416bd1552d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:39.234060 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f5a23056-50fa-46cc-b7df-69416bd1552d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:39.234841 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f5a23056-50fa-46cc-b7df-69416bd1552d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:39.235280 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-f5a23056-50fa-46cc-b7df-69416bd1552d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:39.248196 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.wsgi [None req-f5a23056-50fa-46cc-b7df-69416bd1552d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] HTTP exception thrown: Instance 530afc76-5f4b-470c-a4fe-6ecb6f5dbb97 could not be found. Mar 03 03:04:39.248783 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-f5a23056-50fa-46cc-b7df-69416bd1552d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Returning 404 to user: Instance 530afc76-5f4b-470c-a4fe-6ecb6f5dbb97 could not be found. {{(pid=116858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 03:04:39.249604 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-f5a23056-50fa-46cc-b7df-69416bd1552d tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97" status: 404 len: 111 microversion: 2.1 time: 0.027888 Mar 03 03:04:39.250140 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1951/3673] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:39 2022] GET /compute/v2.1/servers/530afc76-5f4b-470c-a4fe-6ecb6f5dbb97 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 03 03:04:39.258045 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8d622e2e-b797-402f-94a7-bdfe4c04b525 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:39.258545 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8d622e2e-b797-402f-94a7-bdfe4c04b525 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 0a347353-a177-432c-82bf-df27655c432b] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:39.264859 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8d622e2e-b797-402f-94a7-bdfe4c04b525 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:39.265317 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8d622e2e-b797-402f-94a7-bdfe4c04b525 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:39.266098 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8d622e2e-b797-402f-94a7-bdfe4c04b525 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:39.266537 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8d622e2e-b797-402f-94a7-bdfe4c04b525 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:39.291466 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8d622e2e-b797-402f-94a7-bdfe4c04b525 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 0a347353-a177-432c-82bf-df27655c432b] Going to try to terminate instance {{(pid=116859) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 03 03:04:39.368151 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8d622e2e-b797-402f-94a7-bdfe4c04b525 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b" status: 204 len: 0 microversion: 2.1 time: 0.113502 Mar 03 03:04:39.368978 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1723/3674] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Mar 3 03:04:39 2022] DELETE /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 03 03:04:39.376880 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-1705fd1a-7eed-4658-b49a-8eafd66b9ac9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:39.377496 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-1705fd1a-7eed-4658-b49a-8eafd66b9ac9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 0a347353-a177-432c-82bf-df27655c432b] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:39.383246 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1705fd1a-7eed-4658-b49a-8eafd66b9ac9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:39.383734 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1705fd1a-7eed-4658-b49a-8eafd66b9ac9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:39.384521 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1705fd1a-7eed-4658-b49a-8eafd66b9ac9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:39.384968 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-1705fd1a-7eed-4658-b49a-8eafd66b9ac9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:39.633385 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-1705fd1a-7eed-4658-b49a-8eafd66b9ac9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:39.641205 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-1705fd1a-7eed-4658-b49a-8eafd66b9ac9 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b" status: 200 len: 1514 microversion: 2.1 time: 0.268176 Mar 03 03:04:39.642002 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1952/3675] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:39 2022] GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b => generated 1514 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:04:40.587525 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [req-edd74d36-13ab-438e-bf15-1a5aa723614a req-4831a361-cfe2-42c7-89e5-357f8db4ab56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a347353-a177-432c-82bf-df27655c432b", "name": "network-vif-deleted", "tag": "f951e911-a3ec-4460-9442-5bd41e0e1976"}]} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 03:04:40.600839 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-edd74d36-13ab-438e-bf15-1a5aa723614a req-4831a361-cfe2-42c7-89e5-357f8db4ab56 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:40.601896 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-edd74d36-13ab-438e-bf15-1a5aa723614a req-4831a361-cfe2-42c7-89e5-357f8db4ab56 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:40.618680 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.compute.server_external_events [req-edd74d36-13ab-438e-bf15-1a5aa723614a req-4831a361-cfe2-42c7-89e5-357f8db4ab56 service nova] Creating event network-vif-deleted:f951e911-a3ec-4460-9442-5bd41e0e1976 for instance 0a347353-a177-432c-82bf-df27655c432b on hv-cinder-81977 Mar 03 03:04:40.625965 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [req-edd74d36-13ab-438e-bf15-1a5aa723614a req-4831a361-cfe2-42c7-89e5-357f8db4ab56 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042889 Mar 03 03:04:40.627709 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1724/3676] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 03:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 03:04:40.658540 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0b84622b-243b-4c07-ab62-e4943691ce0f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:40.659173 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0b84622b-243b-4c07-ab62-e4943691ce0f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 0a347353-a177-432c-82bf-df27655c432b] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:40.665687 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0b84622b-243b-4c07-ab62-e4943691ce0f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:40.665989 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0b84622b-243b-4c07-ab62-e4943691ce0f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:40.666771 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0b84622b-243b-4c07-ab62-e4943691ce0f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:40.667248 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0b84622b-243b-4c07-ab62-e4943691ce0f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:40.700029 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0b84622b-243b-4c07-ab62-e4943691ce0f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:40.700483 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0b84622b-243b-4c07-ab62-e4943691ce0f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:40.700936 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.objects.instance [None req-0b84622b-243b-4c07-ab62-e4943691ce0f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lazy-loading 'fault' on Instance uuid 0a347353-a177-432c-82bf-df27655c432b {{(pid=116858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 03 03:04:40.767875 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0b84622b-243b-4c07-ab62-e4943691ce0f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:40.774973 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0b84622b-243b-4c07-ab62-e4943691ce0f tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b" status: 200 len: 1308 microversion: 2.1 time: 0.120441 Mar 03 03:04:40.775539 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1953/3677] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:40 2022] GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b => generated 1308 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:04:41.794211 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-272406c6-190a-49f0-b03c-028d7b810044 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:41.795683 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-272406c6-190a-49f0-b03c-028d7b810044 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: 0a347353-a177-432c-82bf-df27655c432b] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:41.802249 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-272406c6-190a-49f0-b03c-028d7b810044 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:41.802707 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-272406c6-190a-49f0-b03c-028d7b810044 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:41.803502 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-272406c6-190a-49f0-b03c-028d7b810044 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:41.803967 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-272406c6-190a-49f0-b03c-028d7b810044 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:41.818012 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.wsgi [None req-272406c6-190a-49f0-b03c-028d7b810044 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] HTTP exception thrown: Instance 0a347353-a177-432c-82bf-df27655c432b could not be found. Mar 03 03:04:41.818862 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-272406c6-190a-49f0-b03c-028d7b810044 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Returning 404 to user: Instance 0a347353-a177-432c-82bf-df27655c432b could not be found. {{(pid=116859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 03:04:41.819939 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-272406c6-190a-49f0-b03c-028d7b810044 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b" status: 404 len: 111 microversion: 2.1 time: 0.031151 Mar 03 03:04:41.820495 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1725/3678] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:41 2022] GET /compute/v2.1/servers/0a347353-a177-432c-82bf-df27655c432b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 03 03:04:54.280868 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e6879d76-9f71-4658-a0fc-b6f94f81d053 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:54.281424 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e6879d76-9f71-4658-a0fc-b6f94f81d053 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: dd292525-cb8e-4520-a771-d22e2d3d6619] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:54.288244 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e6879d76-9f71-4658-a0fc-b6f94f81d053 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:54.288841 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e6879d76-9f71-4658-a0fc-b6f94f81d053 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:54.289994 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e6879d76-9f71-4658-a0fc-b6f94f81d053 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:54.290557 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e6879d76-9f71-4658-a0fc-b6f94f81d053 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:54.330731 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e6879d76-9f71-4658-a0fc-b6f94f81d053 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: dd292525-cb8e-4520-a771-d22e2d3d6619] Going to try to terminate instance {{(pid=116858) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 03 03:04:54.426455 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e6879d76-9f71-4658-a0fc-b6f94f81d053 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "DELETE /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619" status: 204 len: 0 microversion: 2.1 time: 0.149898 Mar 03 03:04:54.427132 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1954/3679] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Mar 3 03:04:54 2022] DELETE /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 03 03:04:54.436078 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1822a417-3e44-44fc-8181-3c0d182a9692 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:54.436691 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1822a417-3e44-44fc-8181-3c0d182a9692 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: dd292525-cb8e-4520-a771-d22e2d3d6619] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:54.443708 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1822a417-3e44-44fc-8181-3c0d182a9692 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:54.444155 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1822a417-3e44-44fc-8181-3c0d182a9692 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:54.445116 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1822a417-3e44-44fc-8181-3c0d182a9692 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:54.445729 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1822a417-3e44-44fc-8181-3c0d182a9692 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:54.607200 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1822a417-3e44-44fc-8181-3c0d182a9692 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:54.615209 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1822a417-3e44-44fc-8181-3c0d182a9692 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619" status: 200 len: 1513 microversion: 2.1 time: 0.183463 Mar 03 03:04:54.616778 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1726/3680] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:54 2022] GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619 => generated 1513 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:04:54.799269 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [req-18c420a7-cd84-4c26-b39e-ee2cfba7160e req-b117eca1-33fc-4c12-b613-ad329fbe4350 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df03ab77-ba2a-4603-b517-8e7b435882f2", "name": "network-vif-deleted", "tag": "efc411a0-4951-463f-9b9e-b0b169a4a793"}]} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 03:04:54.811987 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-18c420a7-cd84-4c26-b39e-ee2cfba7160e req-b117eca1-33fc-4c12-b613-ad329fbe4350 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:54.812871 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-18c420a7-cd84-4c26-b39e-ee2cfba7160e req-b117eca1-33fc-4c12-b613-ad329fbe4350 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:54.829035 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.compute.server_external_events [req-18c420a7-cd84-4c26-b39e-ee2cfba7160e req-b117eca1-33fc-4c12-b613-ad329fbe4350 service nova] Creating event network-vif-deleted:efc411a0-4951-463f-9b9e-b0b169a4a793 for instance df03ab77-ba2a-4603-b517-8e7b435882f2 on hv-cinder-81977 Mar 03 03:04:54.837004 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [req-18c420a7-cd84-4c26-b39e-ee2cfba7160e req-b117eca1-33fc-4c12-b613-ad329fbe4350 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042410 Mar 03 03:04:54.837830 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1955/3681] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 03:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 03:04:55.633308 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-583b36bd-0037-4049-a2f5-8fdcb462daeb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:55.633912 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-583b36bd-0037-4049-a2f5-8fdcb462daeb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: dd292525-cb8e-4520-a771-d22e2d3d6619] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:55.640300 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-583b36bd-0037-4049-a2f5-8fdcb462daeb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:55.640754 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-583b36bd-0037-4049-a2f5-8fdcb462daeb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:55.641538 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-583b36bd-0037-4049-a2f5-8fdcb462daeb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:55.641980 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-583b36bd-0037-4049-a2f5-8fdcb462daeb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:55.705248 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-583b36bd-0037-4049-a2f5-8fdcb462daeb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:55.712886 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-583b36bd-0037-4049-a2f5-8fdcb462daeb tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619" status: 200 len: 1471 microversion: 2.1 time: 0.083347 Mar 03 03:04:55.713458 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1727/3682] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:55 2022] GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619 => generated 1471 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:04:56.382052 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [req-732925c2-032b-47ce-bf83-ae99d31ab4de req-4ca8c751-5d34-4346-b7cc-6a6a2002b204 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0df5e3af-dfd2-431d-83af-1a2a02019651", "name": "network-vif-deleted", "tag": "92ff8971-ee17-4845-81d7-3a348747a57d"}]} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 03:04:56.390479 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-732925c2-032b-47ce-bf83-ae99d31ab4de req-4ca8c751-5d34-4346-b7cc-6a6a2002b204 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:56.390932 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-732925c2-032b-47ce-bf83-ae99d31ab4de req-4ca8c751-5d34-4346-b7cc-6a6a2002b204 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:56.401770 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.compute.server_external_events [req-732925c2-032b-47ce-bf83-ae99d31ab4de req-4ca8c751-5d34-4346-b7cc-6a6a2002b204 service nova] Creating event network-vif-deleted:92ff8971-ee17-4845-81d7-3a348747a57d for instance 0df5e3af-dfd2-431d-83af-1a2a02019651 on hv-cinder-81977 Mar 03 03:04:56.406487 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [req-732925c2-032b-47ce-bf83-ae99d31ab4de req-4ca8c751-5d34-4346-b7cc-6a6a2002b204 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139624 Mar 03 03:04:56.407093 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1956/3683] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 03:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 03:04:56.730461 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f137bbf7-a639-4c51-9bb4-aaa8b0aad5d2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:56.731086 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f137bbf7-a639-4c51-9bb4-aaa8b0aad5d2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: dd292525-cb8e-4520-a771-d22e2d3d6619] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:56.737266 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f137bbf7-a639-4c51-9bb4-aaa8b0aad5d2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:56.737719 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f137bbf7-a639-4c51-9bb4-aaa8b0aad5d2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:56.738493 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f137bbf7-a639-4c51-9bb4-aaa8b0aad5d2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:56.738927 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f137bbf7-a639-4c51-9bb4-aaa8b0aad5d2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:56.798540 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f137bbf7-a639-4c51-9bb4-aaa8b0aad5d2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76da7e26281640968c429d04efb3dd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e235fd949e6494eb47967914074be06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:56.805747 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f137bbf7-a639-4c51-9bb4-aaa8b0aad5d2 tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619" status: 200 len: 1303 microversion: 2.1 time: 0.079475 Mar 03 03:04:56.806293 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1728/3684] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:56 2022] GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619 => generated 1303 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:04:56.855696 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [req-cd931fcd-d28e-49c1-a01a-2991ff19e74e req-5d2df04b-566c-426b-a6e8-a344a410a212 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd292525-cb8e-4520-a771-d22e2d3d6619", "name": "network-vif-deleted", "tag": "5424b4bf-994a-4ee5-b949-44d34e8975fc"}]} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 03:04:56.863927 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-cd931fcd-d28e-49c1-a01a-2991ff19e74e req-5d2df04b-566c-426b-a6e8-a344a410a212 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:56.864373 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-cd931fcd-d28e-49c1-a01a-2991ff19e74e req-5d2df04b-566c-426b-a6e8-a344a410a212 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:56.876414 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.compute.server_external_events [req-cd931fcd-d28e-49c1-a01a-2991ff19e74e req-5d2df04b-566c-426b-a6e8-a344a410a212 service nova] Creating event network-vif-deleted:5424b4bf-994a-4ee5-b949-44d34e8975fc for instance dd292525-cb8e-4520-a771-d22e2d3d6619 on hv-cinder-81977 Mar 03 03:04:56.881485 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [req-cd931fcd-d28e-49c1-a01a-2991ff19e74e req-5d2df04b-566c-426b-a6e8-a344a410a212 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030210 Mar 03 03:04:56.882057 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1957/3685] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 03:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 03:04:57.822440 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-258a0f0e-78fd-4c9f-ad88-7dd17c9ff85b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:57.823701 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-258a0f0e-78fd-4c9f-ad88-7dd17c9ff85b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] [instance: dd292525-cb8e-4520-a771-d22e2d3d6619] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:57.830634 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-258a0f0e-78fd-4c9f-ad88-7dd17c9ff85b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:57.831082 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-258a0f0e-78fd-4c9f-ad88-7dd17c9ff85b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:57.832170 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-258a0f0e-78fd-4c9f-ad88-7dd17c9ff85b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:57.832596 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-258a0f0e-78fd-4c9f-ad88-7dd17c9ff85b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:57.846594 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.wsgi [None req-258a0f0e-78fd-4c9f-ad88-7dd17c9ff85b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] HTTP exception thrown: Instance dd292525-cb8e-4520-a771-d22e2d3d6619 could not be found. Mar 03 03:04:57.847188 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-258a0f0e-78fd-4c9f-ad88-7dd17c9ff85b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] Returning 404 to user: Instance dd292525-cb8e-4520-a771-d22e2d3d6619 could not be found. {{(pid=116859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 03:04:57.848053 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-258a0f0e-78fd-4c9f-ad88-7dd17c9ff85b tempest-AttachVolumeNegativeTest-271412979 tempest-AttachVolumeNegativeTest-271412979-project] 10.222.0.30 "GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619" status: 404 len: 111 microversion: 2.1 time: 0.029677 Mar 03 03:04:57.848590 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1729/3686] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:57 2022] GET /compute/v2.1/servers/dd292525-cb8e-4520-a771-d22e2d3d6619 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 03 03:04:58.102869 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5e0f27c3-4bf4-4f76-becc-4804cf80fafb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1515531484", "imageRef": "1fe11a1a-b4d0-46f5-89cd-501ceff49317", "flavorRef": "452", "networks": [{"uuid": "f1291070-b169-4a89-81cc-b9cf7087c831"}]}} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 03:04:58.168752 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.network.neutron [None req-5e0f27c3-4bf4-4f76-becc-4804cf80fafb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] validate_networks() for [('f1291070-b169-4a89-81cc-b9cf7087c831', None, None, None, None, None)] {{(pid=116858) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 03 03:04:58.588622 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-5e0f27c3-4bf4-4f76-becc-4804cf80fafb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Flavor limits 0:0:0 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 03 03:04:58.589048 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-5e0f27c3-4bf4-4f76-becc-4804cf80fafb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Image limits 0:0:0 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 03 03:04:58.589524 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-5e0f27c3-4bf4-4f76-becc-4804cf80fafb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Flavor pref 0:0:0 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 03 03:04:58.589935 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-5e0f27c3-4bf4-4f76-becc-4804cf80fafb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Image pref 0:0:0 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 03 03:04:58.592787 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.virt.hardware [None req-5e0f27c3-4bf4-4f76-becc-4804cf80fafb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 03 03:04:58.601933 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5e0f27c3-4bf4-4f76-becc-4804cf80fafb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:58.602383 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5e0f27c3-4bf4-4f76-becc-4804cf80fafb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:58.603567 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5e0f27c3-4bf4-4f76-becc-4804cf80fafb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:58.604021 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-5e0f27c3-4bf4-4f76-becc-4804cf80fafb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:58.633228 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.quota [None req-5e0f27c3-4bf4-4f76-becc-4804cf80fafb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Getting quotas for project 23d0b9beb23448d1885663a1fda84ed4. Resources: {'instances', 'ram', 'cores'} {{(pid=116858) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 03 03:04:58.638180 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.quota [None req-5e0f27c3-4bf4-4f76-becc-4804cf80fafb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Getting quotas for user 12c0d786575641a596781a434502b220 and project 23d0b9beb23448d1885663a1fda84ed4. Resources: {'instances', 'ram', 'cores'} {{(pid=116858) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 03 03:04:58.655877 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5e0f27c3-4bf4-4f76-becc-4804cf80fafb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Going to run 1 instances... {{(pid=116858) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 03 03:04:58.658619 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-5e0f27c3-4bf4-4f76-becc-4804cf80fafb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 79948f55-9a87-416d-b288-4afc45c2ac0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1fe11a1a-b4d0-46f5-89cd-501ceff49317',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116858) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 03 03:04:58.717926 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5e0f27c3-4bf4-4f76-becc-4804cf80fafb tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.619782 Mar 03 03:04:58.723390 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1958/3687] 10.222.0.30 () {60 vars in 1146 bytes} [Thu Mar 3 03:04:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 03 03:04:58.730260 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-620d6307-9b4f-42cb-9902-64c62e4f1938 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:58.730710 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-620d6307-9b4f-42cb-9902-64c62e4f1938 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 79948f55-9a87-416d-b288-4afc45c2ac0d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:58.862126 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-620d6307-9b4f-42cb-9902-64c62e4f1938 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:04:58.869423 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-620d6307-9b4f-42cb-9902-64c62e4f1938 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d" status: 200 len: 1219 microversion: 2.1 time: 0.144226 Mar 03 03:04:58.870078 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1730/3688] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:58 2022] GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d => generated 1219 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:04:58.884652 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [req-398c9b3f-d51b-4b2f-a1c9-c71130109942 req-0abef223-2a77-4e3e-b9f4-74def8f87a8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26ff8756-bd0b-464a-9c28-75b4ee57f99d", "name": "network-vif-deleted", "tag": "0d56e3ed-0aa9-416f-96fa-02638da911ee"}]} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 03:04:58.895217 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-398c9b3f-d51b-4b2f-a1c9-c71130109942 req-0abef223-2a77-4e3e-b9f4-74def8f87a8a service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:58.895961 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-398c9b3f-d51b-4b2f-a1c9-c71130109942 req-0abef223-2a77-4e3e-b9f4-74def8f87a8a service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:58.907838 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.compute.server_external_events [req-398c9b3f-d51b-4b2f-a1c9-c71130109942 req-0abef223-2a77-4e3e-b9f4-74def8f87a8a service nova] Creating event network-vif-deleted:0d56e3ed-0aa9-416f-96fa-02638da911ee for instance 26ff8756-bd0b-464a-9c28-75b4ee57f99d on hv-cinder-81977 Mar 03 03:04:58.912724 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [req-398c9b3f-d51b-4b2f-a1c9-c71130109942 req-0abef223-2a77-4e3e-b9f4-74def8f87a8a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032150 Mar 03 03:04:58.913318 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1959/3689] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 03:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 03:04:59.891846 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-08b90ab6-f17d-47d1-8dc9-2c0dbd522aff tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:04:59.891846 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-08b90ab6-f17d-47d1-8dc9-2c0dbd522aff tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 79948f55-9a87-416d-b288-4afc45c2ac0d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:04:59.917840 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-08b90ab6-f17d-47d1-8dc9-2c0dbd522aff tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:59.918307 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-08b90ab6-f17d-47d1-8dc9-2c0dbd522aff tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:59.919159 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-08b90ab6-f17d-47d1-8dc9-2c0dbd522aff tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:04:59.919817 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-08b90ab6-f17d-47d1-8dc9-2c0dbd522aff tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:04:59.993938 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-08b90ab6-f17d-47d1-8dc9-2c0dbd522aff tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:05:00.003514 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-08b90ab6-f17d-47d1-8dc9-2c0dbd522aff tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d" status: 200 len: 1223 microversion: 2.1 time: 0.120828 Mar 03 03:05:00.010391 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1731/3690] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:04:59 2022] GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d => generated 1223 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:05:00.210114 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e09b0644-bd3d-4f6b-aa0a-c99a75021e60 tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] Action: 'create', calling method: .version_select at 0x7fb3c84bedc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1802845431"}} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 03:05:00.476322 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e09b0644-bd3d-4f6b-aa0a-c99a75021e60 tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.375074 Mar 03 03:05:00.477557 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1960/3691] 10.222.0.30 () {60 vars in 1154 bytes} [Thu Mar 3 03:05:00 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 377 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Mar 03 03:05:00.489019 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-826c2ffb-cbd6-4b49-87fe-27e9b282b056 tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] Calling method '.version_select at 0x7fb3c29fbdc0>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:05:00.538391 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-826c2ffb-cbd6-4b49-87fe-27e9b282b056 tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/4d46d299-bc42-4513-bc3d-44a01f718d50" status: 200 len: 345 microversion: 2.1 time: 0.053336 Mar 03 03:05:00.538955 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1732/3692] 10.222.0.30 () {58 vars in 1244 bytes} [Thu Mar 3 03:05:00 2022] GET /compute/v2.1/os-volumes/4d46d299-bc42-4513-bc3d-44a01f718d50 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 03:05:01.019791 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-574d4818-6b27-430a-b416-a6c1e50e7647 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:05:01.020550 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-574d4818-6b27-430a-b416-a6c1e50e7647 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 79948f55-9a87-416d-b288-4afc45c2ac0d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:05:01.027066 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-574d4818-6b27-430a-b416-a6c1e50e7647 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:01.027518 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-574d4818-6b27-430a-b416-a6c1e50e7647 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:01.028342 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-574d4818-6b27-430a-b416-a6c1e50e7647 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:01.028778 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-574d4818-6b27-430a-b416-a6c1e50e7647 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:01.095567 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-574d4818-6b27-430a-b416-a6c1e50e7647 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:05:01.103062 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-574d4818-6b27-430a-b416-a6c1e50e7647 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d" status: 200 len: 1271 microversion: 2.1 time: 0.087207 Mar 03 03:05:01.103636 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1961/3693] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:05:01 2022] GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:05:01.551689 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-75bf9228-d487-46e8-894c-2ec9154bd158 tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] Calling method '.version_select at 0x7fb3c2f091f0>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:05:01.608174 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-75bf9228-d487-46e8-894c-2ec9154bd158 tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/4d46d299-bc42-4513-bc3d-44a01f718d50" status: 200 len: 346 microversion: 2.1 time: 0.060875 Mar 03 03:05:01.608804 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1733/3694] 10.222.0.30 () {58 vars in 1244 bytes} [Thu Mar 3 03:05:01 2022] GET /compute/v2.1/os-volumes/4d46d299-bc42-4513-bc3d-44a01f718d50 => generated 346 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 03:05:01.619976 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-5b6d1b9b-1ff7-441d-b4bc-b6b4aea5c265 tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] Action: 'create', calling method: .version_select at 0x7fb3cbbc8f70>, body: {"snapshot": {"volume_id": "4d46d299-bc42-4513-bc3d-44a01f718d50", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-781270843"}} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 03:05:01.778049 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-5b6d1b9b-1ff7-441d-b4bc-b6b4aea5c265 tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] 10.222.0.30 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.162060 Mar 03 03:05:01.779571 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1962/3695] 10.222.0.30 () {60 vars in 1161 bytes} [Thu Mar 3 03:05:01 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 03:05:01.790992 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-873e312d-070b-48a7-9919-4769f2053ddc tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] Calling method '.version_select at 0x7fb3c8042b80>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:05:01.830098 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-873e312d-070b-48a7-9919-4769f2053ddc tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/4e777c07-86af-4d28-81d1-a315ce2c173f" status: 200 len: 286 microversion: 2.1 time: 0.044265 Mar 03 03:05:01.831815 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1734/3696] 10.222.0.30 () {58 vars in 1250 bytes} [Thu Mar 3 03:05:01 2022] GET /compute/v2.1/os-snapshots/4e777c07-86af-4d28-81d1-a315ce2c173f => generated 286 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 03:05:01.841979 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-35dabb0d-b138-4b4f-aa94-6aabfc3c8eb3 tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] Calling method '.version_select at 0x7fb3c8090160>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:05:01.873884 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-35dabb0d-b138-4b4f-aa94-6aabfc3c8eb3 tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.037171 Mar 03 03:05:01.874450 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1963/3697] 10.222.0.30 () {58 vars in 1139 bytes} [Thu Mar 3 03:05:01 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 03:05:01.885406 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-edb25ba8-fb7f-4366-8120-9de661e43fe3 tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] Calling method '.version_select at 0x7fb3c82b44c0>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:05:01.914785 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-edb25ba8-fb7f-4366-8120-9de661e43fe3 tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/4e777c07-86af-4d28-81d1-a315ce2c173f" status: 200 len: 286 microversion: 2.1 time: 0.033195 Mar 03 03:05:01.915529 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1735/3698] 10.222.0.30 () {58 vars in 1250 bytes} [Thu Mar 3 03:05:01 2022] GET /compute/v2.1/os-snapshots/4e777c07-86af-4d28-81d1-a315ce2c173f => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 03:05:02.120583 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d96cf38b-22af-4a97-ad12-b393292abb50 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:05:02.121192 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d96cf38b-22af-4a97-ad12-b393292abb50 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 79948f55-9a87-416d-b288-4afc45c2ac0d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:05:02.128315 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d96cf38b-22af-4a97-ad12-b393292abb50 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:02.128990 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d96cf38b-22af-4a97-ad12-b393292abb50 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:02.129784 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d96cf38b-22af-4a97-ad12-b393292abb50 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:02.130226 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d96cf38b-22af-4a97-ad12-b393292abb50 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:02.267347 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d96cf38b-22af-4a97-ad12-b393292abb50 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:05:02.274670 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d96cf38b-22af-4a97-ad12-b393292abb50 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d" status: 200 len: 1319 microversion: 2.1 time: 0.157985 Mar 03 03:05:02.275229 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1964/3699] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:05:02 2022] GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:05:02.627467 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [req-75249fce-5d5f-4882-823e-62582119a298 req-ceebb18e-be6d-4695-908a-67b1d37c80d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79948f55-9a87-416d-b288-4afc45c2ac0d", "tag": "770985e2-d40f-4bb2-8bc5-fc5ab63e254d"}]} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 03:05:02.635775 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-75249fce-5d5f-4882-823e-62582119a298 req-ceebb18e-be6d-4695-908a-67b1d37c80d5 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:02.636225 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-75249fce-5d5f-4882-823e-62582119a298 req-ceebb18e-be6d-4695-908a-67b1d37c80d5 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:02.647033 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.compute.server_external_events [req-75249fce-5d5f-4882-823e-62582119a298 req-ceebb18e-be6d-4695-908a-67b1d37c80d5 service nova] Creating event network-changed:770985e2-d40f-4bb2-8bc5-fc5ab63e254d for instance 79948f55-9a87-416d-b288-4afc45c2ac0d on hv-cinder-81977 Mar 03 03:05:02.651771 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [req-75249fce-5d5f-4882-823e-62582119a298 req-ceebb18e-be6d-4695-908a-67b1d37c80d5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028620 Mar 03 03:05:02.652358 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1736/3700] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 03:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 03:05:02.927505 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6129a564-6815-4bd0-bb73-61645c636ea3 tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] Calling method '.version_select at 0x7fb3cbbc8550>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:05:02.957622 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6129a564-6815-4bd0-bb73-61645c636ea3 tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/4e777c07-86af-4d28-81d1-a315ce2c173f" status: 200 len: 286 microversion: 2.1 time: 0.033933 Mar 03 03:05:02.958220 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1965/3701] 10.222.0.30 () {58 vars in 1250 bytes} [Thu Mar 3 03:05:02 2022] GET /compute/v2.1/os-snapshots/4e777c07-86af-4d28-81d1-a315ce2c173f => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 03:05:03.292593 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-01d3ead8-1599-4f82-89f7-b3e8e23db7a6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:05:03.293290 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-01d3ead8-1599-4f82-89f7-b3e8e23db7a6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 79948f55-9a87-416d-b288-4afc45c2ac0d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:05:03.299798 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-01d3ead8-1599-4f82-89f7-b3e8e23db7a6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:03.300253 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-01d3ead8-1599-4f82-89f7-b3e8e23db7a6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:03.301043 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-01d3ead8-1599-4f82-89f7-b3e8e23db7a6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:03.301481 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-01d3ead8-1599-4f82-89f7-b3e8e23db7a6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:03.437053 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-01d3ead8-1599-4f82-89f7-b3e8e23db7a6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:05:03.444983 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-01d3ead8-1599-4f82-89f7-b3e8e23db7a6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d" status: 200 len: 1319 microversion: 2.1 time: 0.156399 Mar 03 03:05:03.445430 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1737/3702] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:05:03 2022] GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:05:03.969522 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6ec07b02-81c6-44ce-9afe-71ac63ee70e6 tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] Calling method '.version_select at 0x7fb3c8090f70>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:05:03.998969 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6ec07b02-81c6-44ce-9afe-71ac63ee70e6 tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/4e777c07-86af-4d28-81d1-a315ce2c173f" status: 200 len: 286 microversion: 2.1 time: 0.033671 Mar 03 03:05:03.999538 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1966/3703] 10.222.0.30 () {58 vars in 1250 bytes} [Thu Mar 3 03:05:03 2022] GET /compute/v2.1/os-snapshots/4e777c07-86af-4d28-81d1-a315ce2c173f => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 03:05:04.461185 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-7ab991b2-dc1e-46a5-9753-e7051a046720 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:05:04.462000 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-7ab991b2-dc1e-46a5-9753-e7051a046720 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 79948f55-9a87-416d-b288-4afc45c2ac0d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:05:04.469286 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7ab991b2-dc1e-46a5-9753-e7051a046720 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:04.469420 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7ab991b2-dc1e-46a5-9753-e7051a046720 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:04.470243 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7ab991b2-dc1e-46a5-9753-e7051a046720 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:04.470548 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-7ab991b2-dc1e-46a5-9753-e7051a046720 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:04.721150 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-7ab991b2-dc1e-46a5-9753-e7051a046720 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:05:04.728856 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-7ab991b2-dc1e-46a5-9753-e7051a046720 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d" status: 200 len: 1319 microversion: 2.1 time: 0.271469 Mar 03 03:05:04.729438 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1738/3704] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:05:04 2022] GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d => generated 1319 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:05:05.011240 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b712106a-891e-4848-a35c-08872f36106d tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] Calling method '.version_select at 0x7fb3c8090ca0>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:05:05.039341 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b712106a-891e-4848-a35c-08872f36106d tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/4e777c07-86af-4d28-81d1-a315ce2c173f" status: 200 len: 287 microversion: 2.1 time: 0.032917 Mar 03 03:05:05.039923 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1967/3705] 10.222.0.30 () {58 vars in 1250 bytes} [Thu Mar 3 03:05:05 2022] GET /compute/v2.1/os-snapshots/4e777c07-86af-4d28-81d1-a315ce2c173f => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 03:05:05.049839 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e7c8a590-4b37-48ba-8529-08460ae76ca8 tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] Calling method '.version_select at 0x7fb3c298d4c0>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:05:05.104642 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e7c8a590-4b37-48ba-8529-08460ae76ca8 tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] 10.222.0.30 "DELETE /compute/v2.1/os-snapshots/4e777c07-86af-4d28-81d1-a315ce2c173f" status: 202 len: 0 microversion: 2.1 time: 0.058536 Mar 03 03:05:05.105236 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1739/3706] 10.222.0.30 () {58 vars in 1253 bytes} [Thu Mar 3 03:05:05 2022] DELETE /compute/v2.1/os-snapshots/4e777c07-86af-4d28-81d1-a315ce2c173f => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 03 03:05:05.114367 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-41191b50-dad8-4e30-b8bd-5f7ced946853 tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] Calling method '.version_select at 0x7fb3c8135e50>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:05:05.143450 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-41191b50-dad8-4e30-b8bd-5f7ced946853 tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/4e777c07-86af-4d28-81d1-a315ce2c173f" status: 200 len: 286 microversion: 2.1 time: 0.033017 Mar 03 03:05:05.144094 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1968/3707] 10.222.0.30 () {58 vars in 1250 bytes} [Thu Mar 3 03:05:05 2022] GET /compute/v2.1/os-snapshots/4e777c07-86af-4d28-81d1-a315ce2c173f => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 03:05:05.746756 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-40089851-86aa-4d76-be77-92f008255048 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:05:05.747764 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-40089851-86aa-4d76-be77-92f008255048 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 79948f55-9a87-416d-b288-4afc45c2ac0d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:05:05.753649 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-40089851-86aa-4d76-be77-92f008255048 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:05.754098 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-40089851-86aa-4d76-be77-92f008255048 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:05.754869 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-40089851-86aa-4d76-be77-92f008255048 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:05.755308 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-40089851-86aa-4d76-be77-92f008255048 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:05.886347 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-40089851-86aa-4d76-be77-92f008255048 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:05:05.893730 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-40089851-86aa-4d76-be77-92f008255048 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d" status: 200 len: 1319 microversion: 2.1 time: 0.151374 Mar 03 03:05:05.894286 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1740/3708] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:05:05 2022] GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:05:06.155148 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6749c7f0-93f0-4a0c-b12c-1c6b28de6504 tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] Calling method '.version_select at 0x7fb3cbbc84c0>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:05:06.183579 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6749c7f0-93f0-4a0c-b12c-1c6b28de6504 tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/4e777c07-86af-4d28-81d1-a315ce2c173f" status: 200 len: 286 microversion: 2.1 time: 0.033228 Mar 03 03:05:06.184167 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1969/3709] 10.222.0.30 () {58 vars in 1250 bytes} [Thu Mar 3 03:05:06 2022] GET /compute/v2.1/os-snapshots/4e777c07-86af-4d28-81d1-a315ce2c173f => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 03:05:06.910434 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9fe23006-25eb-490c-a3e9-ac4743fcf6ae tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:05:06.911050 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9fe23006-25eb-490c-a3e9-ac4743fcf6ae tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 79948f55-9a87-416d-b288-4afc45c2ac0d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:05:06.917241 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9fe23006-25eb-490c-a3e9-ac4743fcf6ae tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:06.917898 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9fe23006-25eb-490c-a3e9-ac4743fcf6ae tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:06.918467 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9fe23006-25eb-490c-a3e9-ac4743fcf6ae tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:06.920156 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9fe23006-25eb-490c-a3e9-ac4743fcf6ae tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:07.175996 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9fe23006-25eb-490c-a3e9-ac4743fcf6ae tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:05:07.183333 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9fe23006-25eb-490c-a3e9-ac4743fcf6ae tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d" status: 200 len: 1319 microversion: 2.1 time: 0.277031 Mar 03 03:05:07.183935 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1741/3710] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:05:06 2022] GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d => generated 1319 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:05:07.196129 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-94479f01-6ad6-45e6-a061-6f943feaa20d tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] Calling method '.version_select at 0x7fb3cbc05700>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:05:07.226113 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-94479f01-6ad6-45e6-a061-6f943feaa20d tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/4e777c07-86af-4d28-81d1-a315ce2c173f" status: 200 len: 286 microversion: 2.1 time: 0.034895 Mar 03 03:05:07.227679 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1970/3711] 10.222.0.30 () {58 vars in 1250 bytes} [Thu Mar 3 03:05:07 2022] GET /compute/v2.1/os-snapshots/4e777c07-86af-4d28-81d1-a315ce2c173f => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 03:05:08.199647 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1f59188e-3b28-4374-af1a-06b1b6eff4e2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:05:08.201315 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1f59188e-3b28-4374-af1a-06b1b6eff4e2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 79948f55-9a87-416d-b288-4afc45c2ac0d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:05:08.206910 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1f59188e-3b28-4374-af1a-06b1b6eff4e2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:08.207361 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1f59188e-3b28-4374-af1a-06b1b6eff4e2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:08.208177 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1f59188e-3b28-4374-af1a-06b1b6eff4e2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:08.208612 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1f59188e-3b28-4374-af1a-06b1b6eff4e2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:08.239512 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9c871638-1e66-4d0e-adf3-a1b8003a6ea4 tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] Calling method '.version_select at 0x7fb3c82d8550>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:05:08.266566 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.wsgi [None req-9c871638-1e66-4d0e-adf3-a1b8003a6ea4 tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] HTTP exception thrown: Snapshot 4e777c07-86af-4d28-81d1-a315ce2c173f could not be found. Mar 03 03:05:08.267341 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9c871638-1e66-4d0e-adf3-a1b8003a6ea4 tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] Returning 404 to user: Snapshot 4e777c07-86af-4d28-81d1-a315ce2c173f could not be found. {{(pid=116858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 03:05:08.268550 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9c871638-1e66-4d0e-adf3-a1b8003a6ea4 tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/4e777c07-86af-4d28-81d1-a315ce2c173f" status: 404 len: 111 microversion: 2.1 time: 0.033470 Mar 03 03:05:08.269258 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1971/3712] 10.222.0.30 () {58 vars in 1250 bytes} [Thu Mar 3 03:05:08 2022] GET /compute/v2.1/os-snapshots/4e777c07-86af-4d28-81d1-a315ce2c173f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 03 03:05:08.277205 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e4e43f8e-b17d-4dd1-aa3b-a923a7740391 tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] Calling method '.version_select at 0x7fb3c8135ca0>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:05:08.346103 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e4e43f8e-b17d-4dd1-aa3b-a923a7740391 tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/4d46d299-bc42-4513-bc3d-44a01f718d50" status: 202 len: 0 microversion: 2.1 time: 0.072533 Mar 03 03:05:08.346740 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1972/3713] 10.222.0.30 () {58 vars in 1247 bytes} [Thu Mar 3 03:05:08 2022] DELETE /compute/v2.1/os-volumes/4d46d299-bc42-4513-bc3d-44a01f718d50 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 03 03:05:08.355222 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e5eb1030-2b09-4fd0-b097-85efcdc6cc5f tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] Calling method '.version_select at 0x7fb3c8135310>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:05:08.359997 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1f59188e-3b28-4374-af1a-06b1b6eff4e2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:05:08.367171 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1f59188e-3b28-4374-af1a-06b1b6eff4e2 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d" status: 200 len: 1319 microversion: 2.1 time: 0.171335 Mar 03 03:05:08.367763 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1742/3714] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:05:08 2022] GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:05:08.417284 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e5eb1030-2b09-4fd0-b097-85efcdc6cc5f tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/4d46d299-bc42-4513-bc3d-44a01f718d50" status: 200 len: 345 microversion: 2.1 time: 0.066081 Mar 03 03:05:08.417849 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1973/3715] 10.222.0.30 () {58 vars in 1244 bytes} [Thu Mar 3 03:05:08 2022] GET /compute/v2.1/os-volumes/4d46d299-bc42-4513-bc3d-44a01f718d50 => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 03:05:09.384275 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-bc2d383c-ef08-418b-a265-f5be75fcf218 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:05:09.385109 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-bc2d383c-ef08-418b-a265-f5be75fcf218 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 79948f55-9a87-416d-b288-4afc45c2ac0d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:05:09.391641 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bc2d383c-ef08-418b-a265-f5be75fcf218 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:09.392318 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bc2d383c-ef08-418b-a265-f5be75fcf218 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:09.393307 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bc2d383c-ef08-418b-a265-f5be75fcf218 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:09.393744 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bc2d383c-ef08-418b-a265-f5be75fcf218 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:09.430032 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e19e056c-e6f6-42ad-a6c1-6e4873cbfee9 tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] Calling method '.version_select at 0x7fb3c82d8550>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:05:09.478060 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e19e056c-e6f6-42ad-a6c1-6e4873cbfee9 tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/4d46d299-bc42-4513-bc3d-44a01f718d50" status: 200 len: 345 microversion: 2.1 time: 0.051855 Mar 03 03:05:09.478628 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1974/3716] 10.222.0.30 () {58 vars in 1244 bytes} [Thu Mar 3 03:05:09 2022] GET /compute/v2.1/os-volumes/4d46d299-bc42-4513-bc3d-44a01f718d50 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 03:05:09.534895 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-bc2d383c-ef08-418b-a265-f5be75fcf218 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:05:09.542110 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-bc2d383c-ef08-418b-a265-f5be75fcf218 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d" status: 200 len: 1319 microversion: 2.1 time: 0.161994 Mar 03 03:05:09.542678 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1743/3717] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:05:09 2022] GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:05:10.491404 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e927af58-1b67-43f7-837d-a495e2423193 tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] Calling method '.version_select at 0x7fb3c85620d0>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:05:10.523502 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.wsgi [None req-e927af58-1b67-43f7-837d-a495e2423193 tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] HTTP exception thrown: Volume 4d46d299-bc42-4513-bc3d-44a01f718d50 could not be found. Mar 03 03:05:10.524166 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e927af58-1b67-43f7-837d-a495e2423193 tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] Returning 404 to user: Volume 4d46d299-bc42-4513-bc3d-44a01f718d50 could not be found. {{(pid=116858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 03:05:10.525003 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e927af58-1b67-43f7-837d-a495e2423193 tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/4d46d299-bc42-4513-bc3d-44a01f718d50" status: 404 len: 109 microversion: 2.1 time: 0.037960 Mar 03 03:05:10.525567 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1975/3718] 10.222.0.30 () {58 vars in 1244 bytes} [Thu Mar 3 03:05:10 2022] GET /compute/v2.1/os-volumes/4d46d299-bc42-4513-bc3d-44a01f718d50 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 03 03:05:10.539251 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-557acba9-df19-429a-baed-a224efe403ee tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] Calling method '.version_select at 0x7fb3c29fb550>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:05:10.560384 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-40361f7d-403c-466d-8bb8-19f1b37720b9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:05:10.561154 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-40361f7d-403c-466d-8bb8-19f1b37720b9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 79948f55-9a87-416d-b288-4afc45c2ac0d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:05:10.567457 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-40361f7d-403c-466d-8bb8-19f1b37720b9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:10.567946 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-40361f7d-403c-466d-8bb8-19f1b37720b9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:10.568749 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-40361f7d-403c-466d-8bb8-19f1b37720b9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:10.569188 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-40361f7d-403c-466d-8bb8-19f1b37720b9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:10.720551 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-40361f7d-403c-466d-8bb8-19f1b37720b9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:05:10.728269 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-40361f7d-403c-466d-8bb8-19f1b37720b9 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d" status: 200 len: 1319 microversion: 2.1 time: 0.172767 Mar 03 03:05:10.729063 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1976/3719] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:05:10 2022] GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:05:10.739845 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.wsgi [None req-557acba9-df19-429a-baed-a224efe403ee tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] HTTP exception thrown: Volume 4d46d299-bc42-4513-bc3d-44a01f718d50 could not be found. Mar 03 03:05:10.739845 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-557acba9-df19-429a-baed-a224efe403ee tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] Returning 404 to user: Volume 4d46d299-bc42-4513-bc3d-44a01f718d50 could not be found. {{(pid=116859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 03:05:10.739845 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-557acba9-df19-429a-baed-a224efe403ee tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/4d46d299-bc42-4513-bc3d-44a01f718d50" status: 404 len: 109 microversion: 2.1 time: 0.196324 Mar 03 03:05:10.739845 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1744/3720] 10.222.0.30 () {58 vars in 1247 bytes} [Thu Mar 3 03:05:10 2022] DELETE /compute/v2.1/os-volumes/4d46d299-bc42-4513-bc3d-44a01f718d50 => generated 109 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 03 03:05:10.748558 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-dc5c2883-5984-4527-97c3-91e7d12e0a1b tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] Calling method '.version_select at 0x7fb3c801c550>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:05:10.794321 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.wsgi [None req-dc5c2883-5984-4527-97c3-91e7d12e0a1b tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] HTTP exception thrown: Volume 4d46d299-bc42-4513-bc3d-44a01f718d50 could not be found. Mar 03 03:05:10.795324 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-dc5c2883-5984-4527-97c3-91e7d12e0a1b tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] Returning 404 to user: Volume 4d46d299-bc42-4513-bc3d-44a01f718d50 could not be found. {{(pid=116859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 03:05:10.796181 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-dc5c2883-5984-4527-97c3-91e7d12e0a1b tempest-VolumesSnapshotsTestJSON-1790370403 tempest-VolumesSnapshotsTestJSON-1790370403-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/4d46d299-bc42-4513-bc3d-44a01f718d50" status: 404 len: 109 microversion: 2.1 time: 0.053099 Mar 03 03:05:10.796721 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1745/3721] 10.222.0.30 () {58 vars in 1244 bytes} [Thu Mar 3 03:05:10 2022] GET /compute/v2.1/os-volumes/4d46d299-bc42-4513-bc3d-44a01f718d50 => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 03 03:05:11.744636 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-33996db5-bdb9-41d4-ae58-c09ac68204f0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:05:11.745257 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-33996db5-bdb9-41d4-ae58-c09ac68204f0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 79948f55-9a87-416d-b288-4afc45c2ac0d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:05:11.751568 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-33996db5-bdb9-41d4-ae58-c09ac68204f0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:11.752057 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-33996db5-bdb9-41d4-ae58-c09ac68204f0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:11.752834 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-33996db5-bdb9-41d4-ae58-c09ac68204f0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:11.753271 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-33996db5-bdb9-41d4-ae58-c09ac68204f0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:11.890182 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-33996db5-bdb9-41d4-ae58-c09ac68204f0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:05:11.897815 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-33996db5-bdb9-41d4-ae58-c09ac68204f0 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d" status: 200 len: 1319 microversion: 2.1 time: 0.156935 Mar 03 03:05:11.898381 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1977/3722] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:05:11 2022] GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:05:12.914112 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a316d0e9-2626-443e-bf67-87563ada4332 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:05:12.914716 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a316d0e9-2626-443e-bf67-87563ada4332 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 79948f55-9a87-416d-b288-4afc45c2ac0d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:05:12.921812 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a316d0e9-2626-443e-bf67-87563ada4332 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:12.922265 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a316d0e9-2626-443e-bf67-87563ada4332 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:12.923331 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a316d0e9-2626-443e-bf67-87563ada4332 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:12.923796 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a316d0e9-2626-443e-bf67-87563ada4332 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:13.069776 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a316d0e9-2626-443e-bf67-87563ada4332 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:05:13.078599 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a316d0e9-2626-443e-bf67-87563ada4332 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d" status: 200 len: 1319 microversion: 2.1 time: 0.168232 Mar 03 03:05:13.079182 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1746/3723] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:05:12 2022] GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:05:14.097214 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a3abb115-85b5-45dd-89ff-676bfa665d4a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:05:14.097950 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a3abb115-85b5-45dd-89ff-676bfa665d4a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 79948f55-9a87-416d-b288-4afc45c2ac0d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:05:14.104681 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a3abb115-85b5-45dd-89ff-676bfa665d4a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:14.105144 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a3abb115-85b5-45dd-89ff-676bfa665d4a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:14.105959 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a3abb115-85b5-45dd-89ff-676bfa665d4a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:14.107285 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a3abb115-85b5-45dd-89ff-676bfa665d4a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:14.270243 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a3abb115-85b5-45dd-89ff-676bfa665d4a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:05:14.290799 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a3abb115-85b5-45dd-89ff-676bfa665d4a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d" status: 200 len: 1319 microversion: 2.1 time: 0.197797 Mar 03 03:05:14.291389 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1978/3724] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:05:14 2022] GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:05:14.358931 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [req-dec0e8a3-40d3-48cc-b451-f3e2bad11b25 req-3dd2011a-8dce-4388-bc55-3097d2e332f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79948f55-9a87-416d-b288-4afc45c2ac0d", "name": "network-vif-plugged", "status": "completed", "tag": "770985e2-d40f-4bb2-8bc5-fc5ab63e254d"}]} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 03:05:14.366876 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-dec0e8a3-40d3-48cc-b451-f3e2bad11b25 req-3dd2011a-8dce-4388-bc55-3097d2e332f6 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:14.367534 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-dec0e8a3-40d3-48cc-b451-f3e2bad11b25 req-3dd2011a-8dce-4388-bc55-3097d2e332f6 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:14.378483 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.compute.server_external_events [req-dec0e8a3-40d3-48cc-b451-f3e2bad11b25 req-3dd2011a-8dce-4388-bc55-3097d2e332f6 service nova] Creating event network-vif-plugged:770985e2-d40f-4bb2-8bc5-fc5ab63e254d for instance 79948f55-9a87-416d-b288-4afc45c2ac0d on hv-cinder-81977 Mar 03 03:05:14.383388 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [req-dec0e8a3-40d3-48cc-b451-f3e2bad11b25 req-3dd2011a-8dce-4388-bc55-3097d2e332f6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191034 Mar 03 03:05:14.383987 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1747/3725] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 03:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 03:05:15.309884 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-769b8817-034d-4e96-a354-9d3911398881 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:05:15.311296 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-769b8817-034d-4e96-a354-9d3911398881 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 79948f55-9a87-416d-b288-4afc45c2ac0d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:05:15.324638 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-769b8817-034d-4e96-a354-9d3911398881 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:15.325310 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-769b8817-034d-4e96-a354-9d3911398881 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:15.326298 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-769b8817-034d-4e96-a354-9d3911398881 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:15.326749 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-769b8817-034d-4e96-a354-9d3911398881 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:15.536312 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-769b8817-034d-4e96-a354-9d3911398881 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:05:15.551277 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-769b8817-034d-4e96-a354-9d3911398881 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d" status: 200 len: 1319 microversion: 2.1 time: 0.246317 Mar 03 03:05:15.551902 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1979/3726] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:05:15 2022] GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:05:16.573508 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1c438be5-8c0d-4b05-81d9-a185ed5d2d58 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:05:16.574788 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1c438be5-8c0d-4b05-81d9-a185ed5d2d58 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 79948f55-9a87-416d-b288-4afc45c2ac0d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:05:16.584284 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1c438be5-8c0d-4b05-81d9-a185ed5d2d58 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:16.585304 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1c438be5-8c0d-4b05-81d9-a185ed5d2d58 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:16.587775 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1c438be5-8c0d-4b05-81d9-a185ed5d2d58 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:16.588437 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1c438be5-8c0d-4b05-81d9-a185ed5d2d58 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:16.766385 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1c438be5-8c0d-4b05-81d9-a185ed5d2d58 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:05:16.773800 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1c438be5-8c0d-4b05-81d9-a185ed5d2d58 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d" status: 200 len: 1507 microversion: 2.1 time: 0.208724 Mar 03 03:05:16.774464 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1748/3727] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:05:16 2022] GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d => generated 1507 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:05:16.790591 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-668938df-d2d3-44c5-91e0-bd872a078d37 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43dbdb77-3db0-4856-aa36-ca7819c84c58", "device": "/dev/sdb"}} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 03:05:16.792540 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-668938df-d2d3-44c5-91e0-bd872a078d37 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 79948f55-9a87-416d-b288-4afc45c2ac0d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:05:16.801181 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-668938df-d2d3-44c5-91e0-bd872a078d37 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:16.801631 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-668938df-d2d3-44c5-91e0-bd872a078d37 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:16.802420 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-668938df-d2d3-44c5-91e0-bd872a078d37 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:16.802871 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-668938df-d2d3-44c5-91e0-bd872a078d37 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:17.059780 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-668938df-d2d3-44c5-91e0-bd872a078d37 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "POST /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273291 Mar 03 03:05:17.063678 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1980/3728] 10.222.0.30 () {60 vars in 1322 bytes} [Thu Mar 3 03:05:16 2022] POST /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 03:05:49.853662 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-20cc0427-6a8a-43a3-92df-858f40cc2263 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:05:49.854198 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-20cc0427-6a8a-43a3-92df-858f40cc2263 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 79948f55-9a87-416d-b288-4afc45c2ac0d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:05:49.860510 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-20cc0427-6a8a-43a3-92df-858f40cc2263 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:49.860966 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-20cc0427-6a8a-43a3-92df-858f40cc2263 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:49.861751 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-20cc0427-6a8a-43a3-92df-858f40cc2263 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:49.862194 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-20cc0427-6a8a-43a3-92df-858f40cc2263 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:49.940208 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.objects.instance [None req-20cc0427-6a8a-43a3-92df-858f40cc2263 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lazy-loading 'services' on Instance uuid 79948f55-9a87-416d-b288-4afc45c2ac0d {{(pid=116859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 03 03:05:50.012449 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-20cc0427-6a8a-43a3-92df-858f40cc2263 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "DELETE /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d/os-volume_attachments/43dbdb77-3db0-4856-aa36-ca7819c84c58" status: 202 len: 0 microversion: 2.1 time: 0.162932 Mar 03 03:05:50.013073 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1749/3729] 10.222.0.30 () {58 vars in 1415 bytes} [Thu Mar 3 03:05:49 2022] DELETE /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d/os-volume_attachments/43dbdb77-3db0-4856-aa36-ca7819c84c58 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 03 03:05:51.209896 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-74d692ac-1944-4170-9c47-c6b73012096a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:05:51.210475 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-74d692ac-1944-4170-9c47-c6b73012096a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 79948f55-9a87-416d-b288-4afc45c2ac0d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:05:51.216854 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-74d692ac-1944-4170-9c47-c6b73012096a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:51.217299 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-74d692ac-1944-4170-9c47-c6b73012096a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:51.218068 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-74d692ac-1944-4170-9c47-c6b73012096a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:51.218502 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-74d692ac-1944-4170-9c47-c6b73012096a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:51.242622 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-74d692ac-1944-4170-9c47-c6b73012096a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 79948f55-9a87-416d-b288-4afc45c2ac0d] Going to try to terminate instance {{(pid=116858) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 03 03:05:51.322032 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-74d692ac-1944-4170-9c47-c6b73012096a tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "DELETE /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d" status: 204 len: 0 microversion: 2.1 time: 0.116011 Mar 03 03:05:51.322665 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1981/3730] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Mar 3 03:05:51 2022] DELETE /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 03 03:05:51.332229 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-56daed7a-dcd8-401d-8664-0684b63703e6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:05:51.332925 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-56daed7a-dcd8-401d-8664-0684b63703e6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 79948f55-9a87-416d-b288-4afc45c2ac0d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:05:51.339413 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-56daed7a-dcd8-401d-8664-0684b63703e6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:51.339907 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-56daed7a-dcd8-401d-8664-0684b63703e6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:51.340690 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-56daed7a-dcd8-401d-8664-0684b63703e6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:51.341133 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-56daed7a-dcd8-401d-8664-0684b63703e6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:51.476325 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-56daed7a-dcd8-401d-8664-0684b63703e6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:05:51.483508 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-56daed7a-dcd8-401d-8664-0684b63703e6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d" status: 200 len: 1513 microversion: 2.1 time: 0.156323 Mar 03 03:05:51.484104 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1750/3731] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:05:51 2022] GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 03:05:52.501829 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6a711896-b4f0-4b67-b5f4-487c5029638e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:05:52.502513 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6a711896-b4f0-4b67-b5f4-487c5029638e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 79948f55-9a87-416d-b288-4afc45c2ac0d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:05:52.508677 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6a711896-b4f0-4b67-b5f4-487c5029638e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:52.509123 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6a711896-b4f0-4b67-b5f4-487c5029638e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:52.509888 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6a711896-b4f0-4b67-b5f4-487c5029638e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:52.510318 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6a711896-b4f0-4b67-b5f4-487c5029638e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:52.641508 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6a711896-b4f0-4b67-b5f4-487c5029638e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:05:52.648717 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6a711896-b4f0-4b67-b5f4-487c5029638e tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d" status: 200 len: 1513 microversion: 2.1 time: 0.151318 Mar 03 03:05:52.649275 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1982/3732] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:05:52 2022] GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:05:52.704332 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 03:05:52.704850 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: Thu Mar 3 03:05:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 03 03:05:53.666025 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a0f88fd1-36c9-43f9-8892-84b1b4c33340 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:05:53.666635 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a0f88fd1-36c9-43f9-8892-84b1b4c33340 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 79948f55-9a87-416d-b288-4afc45c2ac0d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:05:53.673746 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a0f88fd1-36c9-43f9-8892-84b1b4c33340 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:53.674202 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a0f88fd1-36c9-43f9-8892-84b1b4c33340 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:53.674989 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a0f88fd1-36c9-43f9-8892-84b1b4c33340 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:53.675434 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a0f88fd1-36c9-43f9-8892-84b1b4c33340 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:53.805458 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a0f88fd1-36c9-43f9-8892-84b1b4c33340 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:05:53.812886 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a0f88fd1-36c9-43f9-8892-84b1b4c33340 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d" status: 200 len: 1513 microversion: 2.1 time: 0.150713 Mar 03 03:05:53.813470 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1751/3733] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:05:53 2022] GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:05:54.830208 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2eeb87f0-fd4a-4584-baa4-28ff624e9eb6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:05:54.830793 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2eeb87f0-fd4a-4584-baa4-28ff624e9eb6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 79948f55-9a87-416d-b288-4afc45c2ac0d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:05:54.836930 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2eeb87f0-fd4a-4584-baa4-28ff624e9eb6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:54.837999 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2eeb87f0-fd4a-4584-baa4-28ff624e9eb6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:54.838817 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2eeb87f0-fd4a-4584-baa4-28ff624e9eb6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:54.839264 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2eeb87f0-fd4a-4584-baa4-28ff624e9eb6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:54.996551 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2eeb87f0-fd4a-4584-baa4-28ff624e9eb6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:05:55.004408 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2eeb87f0-fd4a-4584-baa4-28ff624e9eb6 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d" status: 200 len: 1513 microversion: 2.1 time: 0.178605 Mar 03 03:05:55.007948 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1983/3734] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:05:54 2022] GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d => generated 1513 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:05:56.021910 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1dc03ad1-a2b8-444f-b8d1-bca863b00b33 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:05:56.023056 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1dc03ad1-a2b8-444f-b8d1-bca863b00b33 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 79948f55-9a87-416d-b288-4afc45c2ac0d] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:05:56.031536 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1dc03ad1-a2b8-444f-b8d1-bca863b00b33 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:56.032348 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1dc03ad1-a2b8-444f-b8d1-bca863b00b33 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:56.033396 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1dc03ad1-a2b8-444f-b8d1-bca863b00b33 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:56.034082 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1dc03ad1-a2b8-444f-b8d1-bca863b00b33 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:56.065985 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [req-1acedcbb-4232-4c96-b257-d133f5ff999a req-a72e9303-8d84-436c-908e-b35cb10d6a90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79948f55-9a87-416d-b288-4afc45c2ac0d", "name": "network-vif-deleted", "tag": "770985e2-d40f-4bb2-8bc5-fc5ab63e254d"}]} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 03:05:56.080171 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-1acedcbb-4232-4c96-b257-d133f5ff999a req-a72e9303-8d84-436c-908e-b35cb10d6a90 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:56.082252 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-1acedcbb-4232-4c96-b257-d133f5ff999a req-a72e9303-8d84-436c-908e-b35cb10d6a90 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:56.108739 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.compute.server_external_events [req-1acedcbb-4232-4c96-b257-d133f5ff999a req-a72e9303-8d84-436c-908e-b35cb10d6a90 service nova] Creating event network-vif-deleted:770985e2-d40f-4bb2-8bc5-fc5ab63e254d for instance 79948f55-9a87-416d-b288-4afc45c2ac0d on hv-cinder-81977 Mar 03 03:05:56.118443 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [req-1acedcbb-4232-4c96-b257-d133f5ff999a req-a72e9303-8d84-436c-908e-b35cb10d6a90 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057297 Mar 03 03:05:56.121944 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1984/3735] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 03:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 03:05:56.131577 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1dc03ad1-a2b8-444f-b8d1-bca863b00b33 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c0d786575641a596781a434502b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d0b9beb23448d1885663a1fda84ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:05:56.147385 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1dc03ad1-a2b8-444f-b8d1-bca863b00b33 tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d" status: 200 len: 1471 microversion: 2.1 time: 0.129254 Mar 03 03:05:56.148681 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1752/3736] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:05:56 2022] GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d => generated 1471 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 03:05:57.166783 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0648ced8-7696-40a5-89fa-878ac8596eaa tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:05:57.168167 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0648ced8-7696-40a5-89fa-878ac8596eaa tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] [instance: 79948f55-9a87-416d-b288-4afc45c2ac0d] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:05:57.178489 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0648ced8-7696-40a5-89fa-878ac8596eaa tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:57.178947 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0648ced8-7696-40a5-89fa-878ac8596eaa tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:57.179772 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0648ced8-7696-40a5-89fa-878ac8596eaa tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:05:57.180214 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0648ced8-7696-40a5-89fa-878ac8596eaa tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:05:57.194404 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.wsgi [None req-0648ced8-7696-40a5-89fa-878ac8596eaa tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] HTTP exception thrown: Instance 79948f55-9a87-416d-b288-4afc45c2ac0d could not be found. Mar 03 03:05:57.195221 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0648ced8-7696-40a5-89fa-878ac8596eaa tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] Returning 404 to user: Instance 79948f55-9a87-416d-b288-4afc45c2ac0d could not be found. {{(pid=116858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 03:05:57.196081 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0648ced8-7696-40a5-89fa-878ac8596eaa tempest-VolumesSnapshotTestJSON-655516408 tempest-VolumesSnapshotTestJSON-655516408-project] 10.222.0.30 "GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d" status: 404 len: 111 microversion: 2.1 time: 0.033847 Mar 03 03:05:57.196619 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1985/3737] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:05:57 2022] GET /compute/v2.1/servers/79948f55-9a87-416d-b288-4afc45c2ac0d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 03 03:06:20.686585 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-94260206-8107-4350-ae70-765693b695a3 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1186366078", "imageRef": "1fe11a1a-b4d0-46f5-89cd-501ceff49317", "flavorRef": "452"}} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 03:06:20.743924 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.network.neutron [None req-94260206-8107-4350-ae70-765693b695a3 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] validate_networks() for None {{(pid=116859) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 03 03:06:21.029873 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-94260206-8107-4350-ae70-765693b695a3 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Flavor limits 0:0:0 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 03 03:06:21.029873 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-94260206-8107-4350-ae70-765693b695a3 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Image limits 0:0:0 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 03 03:06:21.029873 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-94260206-8107-4350-ae70-765693b695a3 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Flavor pref 0:0:0 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 03 03:06:21.030391 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-94260206-8107-4350-ae70-765693b695a3 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Image pref 0:0:0 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 03 03:06:21.030705 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-94260206-8107-4350-ae70-765693b695a3 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 03 03:06:21.042743 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-94260206-8107-4350-ae70-765693b695a3 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:21.043577 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-94260206-8107-4350-ae70-765693b695a3 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:21.044846 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-94260206-8107-4350-ae70-765693b695a3 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:21.045544 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-94260206-8107-4350-ae70-765693b695a3 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:21.068244 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.quota [None req-94260206-8107-4350-ae70-765693b695a3 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Getting quotas for project dfbee0008be3429ab9808a16f64e867b. Resources: {'instances', 'ram', 'cores'} {{(pid=116859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 03 03:06:21.072199 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.quota [None req-94260206-8107-4350-ae70-765693b695a3 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Getting quotas for user 71ee8e9dcaf6471a859caacf3e36b361 and project dfbee0008be3429ab9808a16f64e867b. Resources: {'instances', 'ram', 'cores'} {{(pid=116859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 03 03:06:21.085468 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-94260206-8107-4350-ae70-765693b695a3 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Going to run 1 instances... {{(pid=116859) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 03 03:06:21.087747 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-94260206-8107-4350-ae70-765693b695a3 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] [instance: cc549c9b-fc77-4f5b-bb62-db4127cd7f81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1fe11a1a-b4d0-46f5-89cd-501ceff49317',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 03 03:06:21.135458 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-94260206-8107-4350-ae70-765693b695a3 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.453124 Mar 03 03:06:21.139757 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1753/3738] 10.222.0.30 () {60 vars in 1146 bytes} [Thu Mar 3 03:06:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 458 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 03 03:06:21.147184 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-31d3e22c-e8c7-4f42-a593-d7885f0151bf tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:21.148359 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-31d3e22c-e8c7-4f42-a593-d7885f0151bf tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] [instance: cc549c9b-fc77-4f5b-bb62-db4127cd7f81] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:21.220575 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-31d3e22c-e8c7-4f42-a593-d7885f0151bf tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee8e9dcaf6471a859caacf3e36b361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfbee0008be3429ab9808a16f64e867b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:06:21.227771 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-31d3e22c-e8c7-4f42-a593-d7885f0151bf tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] 10.222.0.30 "GET /compute/v2.1/servers/cc549c9b-fc77-4f5b-bb62-db4127cd7f81" status: 200 len: 1215 microversion: 2.1 time: 0.084599 Mar 03 03:06:21.228524 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1986/3739] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:06:21 2022] GET /compute/v2.1/servers/cc549c9b-fc77-4f5b-bb62-db4127cd7f81 => generated 1215 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:06:22.129007 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ebc09b98-fff5-4d49-b044-d2e635500059 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-42660974", "imageRef": "1fe11a1a-b4d0-46f5-89cd-501ceff49317", "flavorRef": "452", "networks": [{"uuid": "109c674a-9b17-4dd5-9863-c5113273cae9"}]}} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 03:06:22.182222 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.network.neutron [None req-ebc09b98-fff5-4d49-b044-d2e635500059 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] validate_networks() for [('109c674a-9b17-4dd5-9863-c5113273cae9', None, None, None, None, None)] {{(pid=116859) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 03 03:06:22.245938 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c3cff5e3-f8bf-45ec-b143-dbce923a8e2e tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:22.246637 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c3cff5e3-f8bf-45ec-b143-dbce923a8e2e tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] [instance: cc549c9b-fc77-4f5b-bb62-db4127cd7f81] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:22.257549 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c3cff5e3-f8bf-45ec-b143-dbce923a8e2e tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:22.258014 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c3cff5e3-f8bf-45ec-b143-dbce923a8e2e tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:22.258818 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c3cff5e3-f8bf-45ec-b143-dbce923a8e2e tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:22.259293 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c3cff5e3-f8bf-45ec-b143-dbce923a8e2e tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:22.318178 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c3cff5e3-f8bf-45ec-b143-dbce923a8e2e tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee8e9dcaf6471a859caacf3e36b361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfbee0008be3429ab9808a16f64e867b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:06:22.325497 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c3cff5e3-f8bf-45ec-b143-dbce923a8e2e tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] 10.222.0.30 "GET /compute/v2.1/servers/cc549c9b-fc77-4f5b-bb62-db4127cd7f81" status: 200 len: 1273 microversion: 2.1 time: 0.083652 Mar 03 03:06:22.326060 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1987/3740] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:06:22 2022] GET /compute/v2.1/servers/cc549c9b-fc77-4f5b-bb62-db4127cd7f81 => generated 1273 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:06:22.833270 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-ebc09b98-fff5-4d49-b044-d2e635500059 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Flavor limits 0:0:0 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 03 03:06:22.833770 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-ebc09b98-fff5-4d49-b044-d2e635500059 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Image limits 0:0:0 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 03 03:06:22.834341 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-ebc09b98-fff5-4d49-b044-d2e635500059 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Flavor pref 0:0:0 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 03 03:06:22.834839 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-ebc09b98-fff5-4d49-b044-d2e635500059 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Image pref 0:0:0 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 03 03:06:22.835258 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-ebc09b98-fff5-4d49-b044-d2e635500059 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 03 03:06:22.844540 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ebc09b98-fff5-4d49-b044-d2e635500059 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:22.844966 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ebc09b98-fff5-4d49-b044-d2e635500059 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:22.845988 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ebc09b98-fff5-4d49-b044-d2e635500059 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:22.846428 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ebc09b98-fff5-4d49-b044-d2e635500059 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:22.864898 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.quota [None req-ebc09b98-fff5-4d49-b044-d2e635500059 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Getting quotas for project 561a7b87ea564e8984ae824687987d61. Resources: {'instances', 'ram', 'cores'} {{(pid=116859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 03 03:06:22.869889 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.quota [None req-ebc09b98-fff5-4d49-b044-d2e635500059 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Getting quotas for user 735cf2ebda0c4825b7db39f960d86352 and project 561a7b87ea564e8984ae824687987d61. Resources: {'instances', 'ram', 'cores'} {{(pid=116859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 03 03:06:22.881809 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ebc09b98-fff5-4d49-b044-d2e635500059 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Going to run 1 instances... {{(pid=116859) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 03 03:06:22.883934 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ebc09b98-fff5-4d49-b044-d2e635500059 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] [instance: 03abfefa-f519-4497-8991-954fd0ea7f64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1fe11a1a-b4d0-46f5-89cd-501ceff49317',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 03 03:06:22.947588 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ebc09b98-fff5-4d49-b044-d2e635500059 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.823259 Mar 03 03:06:22.948660 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1754/3741] 10.222.0.30 () {60 vars in 1146 bytes} [Thu Mar 3 03:06:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 03 03:06:22.961223 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9044abbe-9a0c-4c60-b594-66e537eaca81 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:22.967319 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9044abbe-9a0c-4c60-b594-66e537eaca81 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] [instance: 03abfefa-f519-4497-8991-954fd0ea7f64] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:23.041696 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9044abbe-9a0c-4c60-b594-66e537eaca81 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cf2ebda0c4825b7db39f960d86352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a7b87ea564e8984ae824687987d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:06:23.054673 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9044abbe-9a0c-4c60-b594-66e537eaca81 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] 10.222.0.30 "GET /compute/v2.1/servers/03abfefa-f519-4497-8991-954fd0ea7f64" status: 200 len: 1212 microversion: 2.1 time: 0.097263 Mar 03 03:06:23.055920 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1988/3742] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:06:22 2022] GET /compute/v2.1/servers/03abfefa-f519-4497-8991-954fd0ea7f64 => generated 1212 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:06:23.342729 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e4b4a403-183e-4df0-99e9-3759e5da0292 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:23.343348 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e4b4a403-183e-4df0-99e9-3759e5da0292 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] [instance: cc549c9b-fc77-4f5b-bb62-db4127cd7f81] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:23.350754 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e4b4a403-183e-4df0-99e9-3759e5da0292 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:23.351437 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e4b4a403-183e-4df0-99e9-3759e5da0292 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:23.352257 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e4b4a403-183e-4df0-99e9-3759e5da0292 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:23.352707 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e4b4a403-183e-4df0-99e9-3759e5da0292 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:23.970230 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e4b4a403-183e-4df0-99e9-3759e5da0292 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee8e9dcaf6471a859caacf3e36b361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfbee0008be3429ab9808a16f64e867b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:06:23.978744 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e4b4a403-183e-4df0-99e9-3759e5da0292 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] 10.222.0.30 "GET /compute/v2.1/servers/cc549c9b-fc77-4f5b-bb62-db4127cd7f81" status: 200 len: 1315 microversion: 2.1 time: 0.640298 Mar 03 03:06:23.979922 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1755/3743] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:06:23 2022] GET /compute/v2.1/servers/cc549c9b-fc77-4f5b-bb62-db4127cd7f81 => generated 1315 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:06:24.072068 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-dae493e0-2b83-4c15-b02a-2b482a7fc58a tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:24.073329 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-dae493e0-2b83-4c15-b02a-2b482a7fc58a tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] [instance: 03abfefa-f519-4497-8991-954fd0ea7f64] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:24.083486 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dae493e0-2b83-4c15-b02a-2b482a7fc58a tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:24.084319 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dae493e0-2b83-4c15-b02a-2b482a7fc58a tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:24.085811 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dae493e0-2b83-4c15-b02a-2b482a7fc58a tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:24.086480 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dae493e0-2b83-4c15-b02a-2b482a7fc58a tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:24.306238 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-dae493e0-2b83-4c15-b02a-2b482a7fc58a tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cf2ebda0c4825b7db39f960d86352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a7b87ea564e8984ae824687987d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:06:24.314037 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-dae493e0-2b83-4c15-b02a-2b482a7fc58a tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] 10.222.0.30 "GET /compute/v2.1/servers/03abfefa-f519-4497-8991-954fd0ea7f64" status: 200 len: 1272 microversion: 2.1 time: 0.245908 Mar 03 03:06:24.318255 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1989/3744] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:06:24 2022] GET /compute/v2.1/servers/03abfefa-f519-4497-8991-954fd0ea7f64 => generated 1272 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 03:06:24.504120 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [req-a13e7aca-1ffb-48e4-99d3-990670cb1f70 req-d15a2fd6-8f3f-49d3-b7eb-e45beb1d7fff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc549c9b-fc77-4f5b-bb62-db4127cd7f81", "tag": "36eef584-c216-4248-b3c5-76f06260ab16"}]} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 03:06:24.515022 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-a13e7aca-1ffb-48e4-99d3-990670cb1f70 req-d15a2fd6-8f3f-49d3-b7eb-e45beb1d7fff service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:24.516419 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-a13e7aca-1ffb-48e4-99d3-990670cb1f70 req-d15a2fd6-8f3f-49d3-b7eb-e45beb1d7fff service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:24.540502 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.compute.server_external_events [req-a13e7aca-1ffb-48e4-99d3-990670cb1f70 req-d15a2fd6-8f3f-49d3-b7eb-e45beb1d7fff service nova] Creating event network-changed:36eef584-c216-4248-b3c5-76f06260ab16 for instance cc549c9b-fc77-4f5b-bb62-db4127cd7f81 on hv-cinder-81977 Mar 03 03:06:24.547488 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [req-a13e7aca-1ffb-48e4-99d3-990670cb1f70 req-d15a2fd6-8f3f-49d3-b7eb-e45beb1d7fff service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046724 Mar 03 03:06:24.548767 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1756/3745] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 03:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 03:06:25.005701 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e082b4f7-aba2-430d-8bab-f785d81143d2 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:25.006563 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e082b4f7-aba2-430d-8bab-f785d81143d2 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] [instance: cc549c9b-fc77-4f5b-bb62-db4127cd7f81] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:25.013704 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e082b4f7-aba2-430d-8bab-f785d81143d2 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:25.014343 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e082b4f7-aba2-430d-8bab-f785d81143d2 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:25.015295 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e082b4f7-aba2-430d-8bab-f785d81143d2 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:25.016730 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-e082b4f7-aba2-430d-8bab-f785d81143d2 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:25.331837 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-21d11e2c-2886-4208-9177-fa48944b3bbd tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:25.332538 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-21d11e2c-2886-4208-9177-fa48944b3bbd tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] [instance: 03abfefa-f519-4497-8991-954fd0ea7f64] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:25.338806 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-21d11e2c-2886-4208-9177-fa48944b3bbd tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:25.339257 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-21d11e2c-2886-4208-9177-fa48944b3bbd tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:25.340274 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-21d11e2c-2886-4208-9177-fa48944b3bbd tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:25.340710 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-21d11e2c-2886-4208-9177-fa48944b3bbd tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:25.581673 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e082b4f7-aba2-430d-8bab-f785d81143d2 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee8e9dcaf6471a859caacf3e36b361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfbee0008be3429ab9808a16f64e867b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:06:25.589210 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-21d11e2c-2886-4208-9177-fa48944b3bbd tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cf2ebda0c4825b7db39f960d86352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a7b87ea564e8984ae824687987d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:06:25.597311 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e082b4f7-aba2-430d-8bab-f785d81143d2 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] 10.222.0.30 "GET /compute/v2.1/servers/cc549c9b-fc77-4f5b-bb62-db4127cd7f81" status: 200 len: 1315 microversion: 2.1 time: 0.604409 Mar 03 03:06:25.597905 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1990/3746] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:06:24 2022] GET /compute/v2.1/servers/cc549c9b-fc77-4f5b-bb62-db4127cd7f81 => generated 1315 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:06:25.604684 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-21d11e2c-2886-4208-9177-fa48944b3bbd tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] 10.222.0.30 "GET /compute/v2.1/servers/03abfefa-f519-4497-8991-954fd0ea7f64" status: 200 len: 1312 microversion: 2.1 time: 0.277919 Mar 03 03:06:25.605431 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1757/3747] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:06:25 2022] GET /compute/v2.1/servers/03abfefa-f519-4497-8991-954fd0ea7f64 => generated 1312 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 03:06:25.901361 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [req-62230c4f-4a3e-4c2f-a9ca-0b5d36bc6ba6 req-c73a3358-4e12-4783-8b5a-581fbc47f307 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03abfefa-f519-4497-8991-954fd0ea7f64", "tag": "48ba6420-a14e-4537-8e79-a2d2949d728d"}]} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 03:06:25.911649 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-62230c4f-4a3e-4c2f-a9ca-0b5d36bc6ba6 req-c73a3358-4e12-4783-8b5a-581fbc47f307 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:25.912457 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-62230c4f-4a3e-4c2f-a9ca-0b5d36bc6ba6 req-c73a3358-4e12-4783-8b5a-581fbc47f307 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:25.926634 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.compute.server_external_events [req-62230c4f-4a3e-4c2f-a9ca-0b5d36bc6ba6 req-c73a3358-4e12-4783-8b5a-581fbc47f307 service nova] Creating event network-changed:48ba6420-a14e-4537-8e79-a2d2949d728d for instance 03abfefa-f519-4497-8991-954fd0ea7f64 on hv-cinder-81977 Mar 03 03:06:25.931985 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [req-62230c4f-4a3e-4c2f-a9ca-0b5d36bc6ba6 req-c73a3358-4e12-4783-8b5a-581fbc47f307 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034317 Mar 03 03:06:25.932925 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1991/3748] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 03:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 03:06:26.616751 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-60d26eb4-0916-4db5-a6ae-123343ad4b4a tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:26.625830 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-48137071-d5bb-49f8-992e-7cdd1abc6064 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:26.626594 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-48137071-d5bb-49f8-992e-7cdd1abc6064 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] [instance: 03abfefa-f519-4497-8991-954fd0ea7f64] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:26.628864 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-60d26eb4-0916-4db5-a6ae-123343ad4b4a tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] [instance: cc549c9b-fc77-4f5b-bb62-db4127cd7f81] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:26.640627 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-60d26eb4-0916-4db5-a6ae-123343ad4b4a tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:26.644160 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-60d26eb4-0916-4db5-a6ae-123343ad4b4a tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:26.647657 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-60d26eb4-0916-4db5-a6ae-123343ad4b4a tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:26.648355 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-60d26eb4-0916-4db5-a6ae-123343ad4b4a tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:26.649584 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-48137071-d5bb-49f8-992e-7cdd1abc6064 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:26.655988 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-48137071-d5bb-49f8-992e-7cdd1abc6064 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:26.661489 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-48137071-d5bb-49f8-992e-7cdd1abc6064 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:26.661918 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-48137071-d5bb-49f8-992e-7cdd1abc6064 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:26.901788 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-60d26eb4-0916-4db5-a6ae-123343ad4b4a tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee8e9dcaf6471a859caacf3e36b361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfbee0008be3429ab9808a16f64e867b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:06:26.912347 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-60d26eb4-0916-4db5-a6ae-123343ad4b4a tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] 10.222.0.30 "GET /compute/v2.1/servers/cc549c9b-fc77-4f5b-bb62-db4127cd7f81" status: 200 len: 1315 microversion: 2.1 time: 0.299401 Mar 03 03:06:26.913233 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1758/3749] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:06:26 2022] GET /compute/v2.1/servers/cc549c9b-fc77-4f5b-bb62-db4127cd7f81 => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:06:27.019950 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-48137071-d5bb-49f8-992e-7cdd1abc6064 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cf2ebda0c4825b7db39f960d86352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a7b87ea564e8984ae824687987d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:06:27.027847 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-48137071-d5bb-49f8-992e-7cdd1abc6064 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] 10.222.0.30 "GET /compute/v2.1/servers/03abfefa-f519-4497-8991-954fd0ea7f64" status: 200 len: 1312 microversion: 2.1 time: 0.409066 Mar 03 03:06:27.028434 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1992/3750] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:06:26 2022] GET /compute/v2.1/servers/03abfefa-f519-4497-8991-954fd0ea7f64 => generated 1312 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:06:27.929571 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e91ccc8a-3098-4cb9-b463-1073e72b45c9 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:27.930323 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e91ccc8a-3098-4cb9-b463-1073e72b45c9 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] [instance: cc549c9b-fc77-4f5b-bb62-db4127cd7f81] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:27.936845 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e91ccc8a-3098-4cb9-b463-1073e72b45c9 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:27.937300 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e91ccc8a-3098-4cb9-b463-1073e72b45c9 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:27.938325 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e91ccc8a-3098-4cb9-b463-1073e72b45c9 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:27.938772 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e91ccc8a-3098-4cb9-b463-1073e72b45c9 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:28.044802 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2f138b36-74b8-4c6c-95ca-168be6a942c3 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:28.045409 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2f138b36-74b8-4c6c-95ca-168be6a942c3 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] [instance: 03abfefa-f519-4497-8991-954fd0ea7f64] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:28.055179 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2f138b36-74b8-4c6c-95ca-168be6a942c3 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:28.055664 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2f138b36-74b8-4c6c-95ca-168be6a942c3 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:28.056458 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2f138b36-74b8-4c6c-95ca-168be6a942c3 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:28.056902 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2f138b36-74b8-4c6c-95ca-168be6a942c3 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:28.076195 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e91ccc8a-3098-4cb9-b463-1073e72b45c9 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee8e9dcaf6471a859caacf3e36b361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfbee0008be3429ab9808a16f64e867b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:06:28.084830 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e91ccc8a-3098-4cb9-b463-1073e72b45c9 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] 10.222.0.30 "GET /compute/v2.1/servers/cc549c9b-fc77-4f5b-bb62-db4127cd7f81" status: 200 len: 1315 microversion: 2.1 time: 0.159383 Mar 03 03:06:28.085398 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1759/3751] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:06:27 2022] GET /compute/v2.1/servers/cc549c9b-fc77-4f5b-bb62-db4127cd7f81 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:06:28.202702 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2f138b36-74b8-4c6c-95ca-168be6a942c3 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cf2ebda0c4825b7db39f960d86352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a7b87ea564e8984ae824687987d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:06:28.210631 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2f138b36-74b8-4c6c-95ca-168be6a942c3 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] 10.222.0.30 "GET /compute/v2.1/servers/03abfefa-f519-4497-8991-954fd0ea7f64" status: 200 len: 1312 microversion: 2.1 time: 0.169792 Mar 03 03:06:28.211194 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1993/3752] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:06:28 2022] GET /compute/v2.1/servers/03abfefa-f519-4497-8991-954fd0ea7f64 => generated 1312 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 03:06:28.821427 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [req-889c6731-cd12-49dd-a45c-473d83d40ca5 req-5952a844-98b4-4737-9d7c-5c08414ae6c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc549c9b-fc77-4f5b-bb62-db4127cd7f81", "name": "network-vif-plugged", "status": "completed", "tag": "36eef584-c216-4248-b3c5-76f06260ab16"}]} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 03:06:28.830086 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-889c6731-cd12-49dd-a45c-473d83d40ca5 req-5952a844-98b4-4737-9d7c-5c08414ae6c1 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:28.830541 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-889c6731-cd12-49dd-a45c-473d83d40ca5 req-5952a844-98b4-4737-9d7c-5c08414ae6c1 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:28.842127 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.compute.server_external_events [req-889c6731-cd12-49dd-a45c-473d83d40ca5 req-5952a844-98b4-4737-9d7c-5c08414ae6c1 service nova] Creating event network-vif-plugged:36eef584-c216-4248-b3c5-76f06260ab16 for instance cc549c9b-fc77-4f5b-bb62-db4127cd7f81 on hv-cinder-81977 Mar 03 03:06:28.848161 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [req-889c6731-cd12-49dd-a45c-473d83d40ca5 req-5952a844-98b4-4737-9d7c-5c08414ae6c1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030438 Mar 03 03:06:28.848766 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1760/3753] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 03:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 03:06:29.102862 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-835df2ba-d91e-44cd-9e65-accfc28225c4 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:29.103588 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-835df2ba-d91e-44cd-9e65-accfc28225c4 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] [instance: cc549c9b-fc77-4f5b-bb62-db4127cd7f81] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:29.110595 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-835df2ba-d91e-44cd-9e65-accfc28225c4 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:29.111134 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-835df2ba-d91e-44cd-9e65-accfc28225c4 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:29.112019 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-835df2ba-d91e-44cd-9e65-accfc28225c4 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:29.112534 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-835df2ba-d91e-44cd-9e65-accfc28225c4 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:29.229519 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8ac343f9-f5d4-4ae7-a5b4-a58b53500f74 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:29.230398 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8ac343f9-f5d4-4ae7-a5b4-a58b53500f74 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] [instance: 03abfefa-f519-4497-8991-954fd0ea7f64] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:29.237777 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8ac343f9-f5d4-4ae7-a5b4-a58b53500f74 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:29.238490 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8ac343f9-f5d4-4ae7-a5b4-a58b53500f74 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:29.239334 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8ac343f9-f5d4-4ae7-a5b4-a58b53500f74 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:29.239951 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8ac343f9-f5d4-4ae7-a5b4-a58b53500f74 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:29.253322 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-835df2ba-d91e-44cd-9e65-accfc28225c4 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee8e9dcaf6471a859caacf3e36b361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfbee0008be3429ab9808a16f64e867b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:06:29.260763 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-835df2ba-d91e-44cd-9e65-accfc28225c4 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] 10.222.0.30 "GET /compute/v2.1/servers/cc549c9b-fc77-4f5b-bb62-db4127cd7f81" status: 200 len: 1315 microversion: 2.1 time: 0.162299 Mar 03 03:06:29.261336 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1994/3754] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:06:29 2022] GET /compute/v2.1/servers/cc549c9b-fc77-4f5b-bb62-db4127cd7f81 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:06:29.380797 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8ac343f9-f5d4-4ae7-a5b4-a58b53500f74 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cf2ebda0c4825b7db39f960d86352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a7b87ea564e8984ae824687987d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:06:29.388047 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8ac343f9-f5d4-4ae7-a5b4-a58b53500f74 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] 10.222.0.30 "GET /compute/v2.1/servers/03abfefa-f519-4497-8991-954fd0ea7f64" status: 200 len: 1312 microversion: 2.1 time: 0.163414 Mar 03 03:06:29.388608 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1761/3755] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:06:29 2022] GET /compute/v2.1/servers/03abfefa-f519-4497-8991-954fd0ea7f64 => generated 1312 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:06:30.278969 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-790e1042-42ba-471d-aa89-0627ce47fce4 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:30.279687 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-790e1042-42ba-471d-aa89-0627ce47fce4 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] [instance: cc549c9b-fc77-4f5b-bb62-db4127cd7f81] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:30.286749 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-790e1042-42ba-471d-aa89-0627ce47fce4 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:30.287238 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-790e1042-42ba-471d-aa89-0627ce47fce4 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:30.288061 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-790e1042-42ba-471d-aa89-0627ce47fce4 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:30.288499 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-790e1042-42ba-471d-aa89-0627ce47fce4 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:30.405978 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-96a4e801-79b2-47f7-9adf-df3c1113896c tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:30.407337 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-96a4e801-79b2-47f7-9adf-df3c1113896c tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] [instance: 03abfefa-f519-4497-8991-954fd0ea7f64] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:30.414388 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-96a4e801-79b2-47f7-9adf-df3c1113896c tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:30.414845 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-96a4e801-79b2-47f7-9adf-df3c1113896c tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:30.415661 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-96a4e801-79b2-47f7-9adf-df3c1113896c tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:30.416103 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-96a4e801-79b2-47f7-9adf-df3c1113896c tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:30.442171 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-790e1042-42ba-471d-aa89-0627ce47fce4 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee8e9dcaf6471a859caacf3e36b361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfbee0008be3429ab9808a16f64e867b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:06:30.450816 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-790e1042-42ba-471d-aa89-0627ce47fce4 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] 10.222.0.30 "GET /compute/v2.1/servers/cc549c9b-fc77-4f5b-bb62-db4127cd7f81" status: 200 len: 1465 microversion: 2.1 time: 0.176449 Mar 03 03:06:30.451979 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1995/3756] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:06:30 2022] GET /compute/v2.1/servers/cc549c9b-fc77-4f5b-bb62-db4127cd7f81 => generated 1465 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:06:30.495403 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-dd6f003e-1925-428c-90ed-01fcc4764016 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:30.496162 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-dd6f003e-1925-428c-90ed-01fcc4764016 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] [instance: cc549c9b-fc77-4f5b-bb62-db4127cd7f81] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:30.502573 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dd6f003e-1925-428c-90ed-01fcc4764016 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:30.505142 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dd6f003e-1925-428c-90ed-01fcc4764016 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:30.505961 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dd6f003e-1925-428c-90ed-01fcc4764016 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:30.506407 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-dd6f003e-1925-428c-90ed-01fcc4764016 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:30.535786 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-dd6f003e-1925-428c-90ed-01fcc4764016 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] [instance: cc549c9b-fc77-4f5b-bb62-db4127cd7f81] Going to try to terminate instance {{(pid=116858) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 03 03:06:30.559478 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-96a4e801-79b2-47f7-9adf-df3c1113896c tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cf2ebda0c4825b7db39f960d86352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a7b87ea564e8984ae824687987d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:06:30.568013 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-96a4e801-79b2-47f7-9adf-df3c1113896c tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] 10.222.0.30 "GET /compute/v2.1/servers/03abfefa-f519-4497-8991-954fd0ea7f64" status: 200 len: 1312 microversion: 2.1 time: 0.165912 Mar 03 03:06:30.568794 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1762/3757] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:06:30 2022] GET /compute/v2.1/servers/03abfefa-f519-4497-8991-954fd0ea7f64 => generated 1312 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:06:30.629895 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-dd6f003e-1925-428c-90ed-01fcc4764016 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] 10.222.0.30 "DELETE /compute/v2.1/servers/cc549c9b-fc77-4f5b-bb62-db4127cd7f81" status: 204 len: 0 microversion: 2.1 time: 0.138537 Mar 03 03:06:30.629895 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1996/3758] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Mar 3 03:06:30 2022] DELETE /compute/v2.1/servers/cc549c9b-fc77-4f5b-bb62-db4127cd7f81 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 03 03:06:30.639395 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c42b2ef6-ff44-4de5-b6ac-bb55db4c744b tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:30.640038 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c42b2ef6-ff44-4de5-b6ac-bb55db4c744b tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] [instance: cc549c9b-fc77-4f5b-bb62-db4127cd7f81] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:30.645865 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c42b2ef6-ff44-4de5-b6ac-bb55db4c744b tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:30.646314 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c42b2ef6-ff44-4de5-b6ac-bb55db4c744b tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:30.647132 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c42b2ef6-ff44-4de5-b6ac-bb55db4c744b tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:30.647567 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c42b2ef6-ff44-4de5-b6ac-bb55db4c744b tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:30.790062 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c42b2ef6-ff44-4de5-b6ac-bb55db4c744b tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee8e9dcaf6471a859caacf3e36b361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfbee0008be3429ab9808a16f64e867b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:06:30.797753 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c42b2ef6-ff44-4de5-b6ac-bb55db4c744b tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] 10.222.0.30 "GET /compute/v2.1/servers/cc549c9b-fc77-4f5b-bb62-db4127cd7f81" status: 200 len: 1471 microversion: 2.1 time: 0.161981 Mar 03 03:06:30.798315 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1763/3759] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:06:30 2022] GET /compute/v2.1/servers/cc549c9b-fc77-4f5b-bb62-db4127cd7f81 => generated 1471 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:06:30.874626 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [req-43a1ddc5-1229-4b8f-8275-5a917ce460ff req-af8b5d98-05c6-490d-b5bb-2b7d8e00e9a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03abfefa-f519-4497-8991-954fd0ea7f64", "name": "network-vif-plugged", "status": "completed", "tag": "48ba6420-a14e-4537-8e79-a2d2949d728d"}]} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 03:06:30.882367 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-43a1ddc5-1229-4b8f-8275-5a917ce460ff req-af8b5d98-05c6-490d-b5bb-2b7d8e00e9a0 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:30.882814 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-43a1ddc5-1229-4b8f-8275-5a917ce460ff req-af8b5d98-05c6-490d-b5bb-2b7d8e00e9a0 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:30.893379 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.compute.server_external_events [req-43a1ddc5-1229-4b8f-8275-5a917ce460ff req-af8b5d98-05c6-490d-b5bb-2b7d8e00e9a0 service nova] Creating event network-vif-plugged:48ba6420-a14e-4537-8e79-a2d2949d728d for instance 03abfefa-f519-4497-8991-954fd0ea7f64 on hv-cinder-81977 Mar 03 03:06:30.898007 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [req-43a1ddc5-1229-4b8f-8275-5a917ce460ff req-af8b5d98-05c6-490d-b5bb-2b7d8e00e9a0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027363 Mar 03 03:06:30.898587 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1997/3760] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 03:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 03:06:31.584943 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-b12b7903-4dc3-4014-aab0-55fa22c40e77 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:31.585643 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-b12b7903-4dc3-4014-aab0-55fa22c40e77 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] [instance: 03abfefa-f519-4497-8991-954fd0ea7f64] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:31.592369 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b12b7903-4dc3-4014-aab0-55fa22c40e77 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:31.592828 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b12b7903-4dc3-4014-aab0-55fa22c40e77 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:31.593605 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b12b7903-4dc3-4014-aab0-55fa22c40e77 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:31.594528 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-b12b7903-4dc3-4014-aab0-55fa22c40e77 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:31.740013 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-b12b7903-4dc3-4014-aab0-55fa22c40e77 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cf2ebda0c4825b7db39f960d86352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a7b87ea564e8984ae824687987d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:06:31.747282 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-b12b7903-4dc3-4014-aab0-55fa22c40e77 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] 10.222.0.30 "GET /compute/v2.1/servers/03abfefa-f519-4497-8991-954fd0ea7f64" status: 200 len: 1312 microversion: 2.1 time: 0.166597 Mar 03 03:06:31.748069 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1764/3761] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:06:31 2022] GET /compute/v2.1/servers/03abfefa-f519-4497-8991-954fd0ea7f64 => generated 1312 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:06:31.816596 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3fbf556c-68dc-446f-ada3-59829b7a9bac tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:31.817289 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3fbf556c-68dc-446f-ada3-59829b7a9bac tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] [instance: cc549c9b-fc77-4f5b-bb62-db4127cd7f81] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:31.823266 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3fbf556c-68dc-446f-ada3-59829b7a9bac tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:31.823765 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3fbf556c-68dc-446f-ada3-59829b7a9bac tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:31.824539 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3fbf556c-68dc-446f-ada3-59829b7a9bac tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:31.824968 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3fbf556c-68dc-446f-ada3-59829b7a9bac tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:31.957643 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-3fbf556c-68dc-446f-ada3-59829b7a9bac tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee8e9dcaf6471a859caacf3e36b361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfbee0008be3429ab9808a16f64e867b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:06:31.964882 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3fbf556c-68dc-446f-ada3-59829b7a9bac tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] 10.222.0.30 "GET /compute/v2.1/servers/cc549c9b-fc77-4f5b-bb62-db4127cd7f81" status: 200 len: 1471 microversion: 2.1 time: 0.153342 Mar 03 03:06:31.965444 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1998/3762] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:06:31 2022] GET /compute/v2.1/servers/cc549c9b-fc77-4f5b-bb62-db4127cd7f81 => generated 1471 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:06:32.763905 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a90967de-2e6a-4b71-93d1-f50e868792b5 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:32.764515 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a90967de-2e6a-4b71-93d1-f50e868792b5 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] [instance: 03abfefa-f519-4497-8991-954fd0ea7f64] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:32.771313 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a90967de-2e6a-4b71-93d1-f50e868792b5 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:32.771804 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a90967de-2e6a-4b71-93d1-f50e868792b5 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:32.772581 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a90967de-2e6a-4b71-93d1-f50e868792b5 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:32.773021 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a90967de-2e6a-4b71-93d1-f50e868792b5 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:32.907840 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a90967de-2e6a-4b71-93d1-f50e868792b5 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cf2ebda0c4825b7db39f960d86352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a7b87ea564e8984ae824687987d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:06:32.914939 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a90967de-2e6a-4b71-93d1-f50e868792b5 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] 10.222.0.30 "GET /compute/v2.1/servers/03abfefa-f519-4497-8991-954fd0ea7f64" status: 200 len: 1312 microversion: 2.1 time: 0.154940 Mar 03 03:06:32.915500 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1765/3763] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:06:32 2022] GET /compute/v2.1/servers/03abfefa-f519-4497-8991-954fd0ea7f64 => generated 1312 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:06:32.982496 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-693b9638-083f-4567-bcc8-c6525341b748 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:32.983052 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-693b9638-083f-4567-bcc8-c6525341b748 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] [instance: cc549c9b-fc77-4f5b-bb62-db4127cd7f81] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:32.990477 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-693b9638-083f-4567-bcc8-c6525341b748 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:32.990930 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-693b9638-083f-4567-bcc8-c6525341b748 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:32.991762 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-693b9638-083f-4567-bcc8-c6525341b748 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:32.992198 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-693b9638-083f-4567-bcc8-c6525341b748 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:33.121624 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-693b9638-083f-4567-bcc8-c6525341b748 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee8e9dcaf6471a859caacf3e36b361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfbee0008be3429ab9808a16f64e867b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:06:33.128833 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-693b9638-083f-4567-bcc8-c6525341b748 tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] 10.222.0.30 "GET /compute/v2.1/servers/cc549c9b-fc77-4f5b-bb62-db4127cd7f81" status: 200 len: 1471 microversion: 2.1 time: 0.150240 Mar 03 03:06:33.129397 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 1999/3764] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:06:32 2022] GET /compute/v2.1/servers/cc549c9b-fc77-4f5b-bb62-db4127cd7f81 => generated 1471 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:06:33.931366 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2a92c3af-f26c-42a2-af09-d5126ef32f7d tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:33.932013 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2a92c3af-f26c-42a2-af09-d5126ef32f7d tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] [instance: 03abfefa-f519-4497-8991-954fd0ea7f64] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:33.938525 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2a92c3af-f26c-42a2-af09-d5126ef32f7d tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:33.938976 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2a92c3af-f26c-42a2-af09-d5126ef32f7d tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:33.939778 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2a92c3af-f26c-42a2-af09-d5126ef32f7d tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:33.940215 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2a92c3af-f26c-42a2-af09-d5126ef32f7d tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:34.069522 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2a92c3af-f26c-42a2-af09-d5126ef32f7d tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cf2ebda0c4825b7db39f960d86352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a7b87ea564e8984ae824687987d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:06:34.076612 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2a92c3af-f26c-42a2-af09-d5126ef32f7d tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] 10.222.0.30 "GET /compute/v2.1/servers/03abfefa-f519-4497-8991-954fd0ea7f64" status: 200 len: 1312 microversion: 2.1 time: 0.149179 Mar 03 03:06:34.077172 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1766/3765] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:06:33 2022] GET /compute/v2.1/servers/03abfefa-f519-4497-8991-954fd0ea7f64 => generated 1312 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:06:34.146003 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-0ff4fdf5-ff36-4dd1-97b8-ef3b1a20e4cf tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:34.146627 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-0ff4fdf5-ff36-4dd1-97b8-ef3b1a20e4cf tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] [instance: cc549c9b-fc77-4f5b-bb62-db4127cd7f81] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:34.153095 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0ff4fdf5-ff36-4dd1-97b8-ef3b1a20e4cf tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:34.153549 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0ff4fdf5-ff36-4dd1-97b8-ef3b1a20e4cf tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:34.154331 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0ff4fdf5-ff36-4dd1-97b8-ef3b1a20e4cf tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:34.154769 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-0ff4fdf5-ff36-4dd1-97b8-ef3b1a20e4cf tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:34.284180 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-0ff4fdf5-ff36-4dd1-97b8-ef3b1a20e4cf tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee8e9dcaf6471a859caacf3e36b361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfbee0008be3429ab9808a16f64e867b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:06:34.291321 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-0ff4fdf5-ff36-4dd1-97b8-ef3b1a20e4cf tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] 10.222.0.30 "GET /compute/v2.1/servers/cc549c9b-fc77-4f5b-bb62-db4127cd7f81" status: 200 len: 1471 microversion: 2.1 time: 0.150342 Mar 03 03:06:34.291929 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 2000/3766] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:06:34 2022] GET /compute/v2.1/servers/cc549c9b-fc77-4f5b-bb62-db4127cd7f81 => generated 1471 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:06:34.919450 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [req-d2bb9162-6378-4985-a262-a3670c943703 req-d0dcc4e1-6893-4c9d-9017-be20f80ce0e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc549c9b-fc77-4f5b-bb62-db4127cd7f81", "name": "network-vif-deleted", "tag": "36eef584-c216-4248-b3c5-76f06260ab16"}]} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 03:06:34.927883 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-d2bb9162-6378-4985-a262-a3670c943703 req-d0dcc4e1-6893-4c9d-9017-be20f80ce0e6 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:34.928330 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-d2bb9162-6378-4985-a262-a3670c943703 req-d0dcc4e1-6893-4c9d-9017-be20f80ce0e6 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:34.940188 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.compute.server_external_events [req-d2bb9162-6378-4985-a262-a3670c943703 req-d0dcc4e1-6893-4c9d-9017-be20f80ce0e6 service nova] Creating event network-vif-deleted:36eef584-c216-4248-b3c5-76f06260ab16 for instance cc549c9b-fc77-4f5b-bb62-db4127cd7f81 on hv-cinder-81977 Mar 03 03:06:34.949972 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [req-d2bb9162-6378-4985-a262-a3670c943703 req-d0dcc4e1-6893-4c9d-9017-be20f80ce0e6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034128 Mar 03 03:06:34.950748 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1767/3767] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 03:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 03:06:35.094589 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-72262d58-ff17-414b-89dc-65a5710b1512 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:35.095232 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-72262d58-ff17-414b-89dc-65a5710b1512 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] [instance: 03abfefa-f519-4497-8991-954fd0ea7f64] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:35.101802 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-72262d58-ff17-414b-89dc-65a5710b1512 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:35.102248 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-72262d58-ff17-414b-89dc-65a5710b1512 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:35.103018 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-72262d58-ff17-414b-89dc-65a5710b1512 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:35.103450 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-72262d58-ff17-414b-89dc-65a5710b1512 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:35.237370 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-72262d58-ff17-414b-89dc-65a5710b1512 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cf2ebda0c4825b7db39f960d86352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a7b87ea564e8984ae824687987d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:06:35.244697 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-72262d58-ff17-414b-89dc-65a5710b1512 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] 10.222.0.30 "GET /compute/v2.1/servers/03abfefa-f519-4497-8991-954fd0ea7f64" status: 200 len: 1495 microversion: 2.1 time: 0.154658 Mar 03 03:06:35.245291 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 2001/3768] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:06:35 2022] GET /compute/v2.1/servers/03abfefa-f519-4497-8991-954fd0ea7f64 => generated 1495 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 03:06:35.309540 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c7096ba3-08c7-4364-9df3-db09f6f1457f tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:35.310328 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c7096ba3-08c7-4364-9df3-db09f6f1457f tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] [instance: cc549c9b-fc77-4f5b-bb62-db4127cd7f81] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:35.316609 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c7096ba3-08c7-4364-9df3-db09f6f1457f tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:35.316972 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c7096ba3-08c7-4364-9df3-db09f6f1457f tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:35.318016 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c7096ba3-08c7-4364-9df3-db09f6f1457f tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:35.318530 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c7096ba3-08c7-4364-9df3-db09f6f1457f tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:35.349923 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c7096ba3-08c7-4364-9df3-db09f6f1457f tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:35.350371 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c7096ba3-08c7-4364-9df3-db09f6f1457f tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:35.351083 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.objects.instance [None req-c7096ba3-08c7-4364-9df3-db09f6f1457f tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lazy-loading 'fault' on Instance uuid cc549c9b-fc77-4f5b-bb62-db4127cd7f81 {{(pid=116859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 03 03:06:35.394071 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c7096ba3-08c7-4364-9df3-db09f6f1457f tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ee8e9dcaf6471a859caacf3e36b361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfbee0008be3429ab9808a16f64e867b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:06:35.403754 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c7096ba3-08c7-4364-9df3-db09f6f1457f tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] 10.222.0.30 "GET /compute/v2.1/servers/cc549c9b-fc77-4f5b-bb62-db4127cd7f81" status: 200 len: 1305 microversion: 2.1 time: 0.099519 Mar 03 03:06:35.415808 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1768/3769] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:06:35 2022] GET /compute/v2.1/servers/cc549c9b-fc77-4f5b-bb62-db4127cd7f81 => generated 1305 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:06:35.644361 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-319c31a4-cc48-48f8-ba09-1dda3d653303 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:35.644926 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-319c31a4-cc48-48f8-ba09-1dda3d653303 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] [instance: 03abfefa-f519-4497-8991-954fd0ea7f64] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:35.650752 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-319c31a4-cc48-48f8-ba09-1dda3d653303 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:35.651195 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-319c31a4-cc48-48f8-ba09-1dda3d653303 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:35.651988 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-319c31a4-cc48-48f8-ba09-1dda3d653303 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:35.652420 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-319c31a4-cc48-48f8-ba09-1dda3d653303 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:35.675413 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-319c31a4-cc48-48f8-ba09-1dda3d653303 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] [instance: 03abfefa-f519-4497-8991-954fd0ea7f64] Going to try to terminate instance {{(pid=116858) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 03 03:06:35.745955 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-319c31a4-cc48-48f8-ba09-1dda3d653303 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] 10.222.0.30 "DELETE /compute/v2.1/servers/03abfefa-f519-4497-8991-954fd0ea7f64" status: 204 len: 0 microversion: 2.1 time: 0.105713 Mar 03 03:06:35.746837 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 2002/3770] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Mar 3 03:06:35 2022] DELETE /compute/v2.1/servers/03abfefa-f519-4497-8991-954fd0ea7f64 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 03 03:06:35.756812 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-34870d66-2dce-465c-be54-d8cc0e4214d8 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:35.757453 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-34870d66-2dce-465c-be54-d8cc0e4214d8 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] [instance: 03abfefa-f519-4497-8991-954fd0ea7f64] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:35.763218 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-34870d66-2dce-465c-be54-d8cc0e4214d8 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:35.763705 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-34870d66-2dce-465c-be54-d8cc0e4214d8 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:35.764493 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-34870d66-2dce-465c-be54-d8cc0e4214d8 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:35.764941 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-34870d66-2dce-465c-be54-d8cc0e4214d8 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:35.902346 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-34870d66-2dce-465c-be54-d8cc0e4214d8 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cf2ebda0c4825b7db39f960d86352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a7b87ea564e8984ae824687987d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:06:35.910334 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-34870d66-2dce-465c-be54-d8cc0e4214d8 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] 10.222.0.30 "GET /compute/v2.1/servers/03abfefa-f519-4497-8991-954fd0ea7f64" status: 200 len: 1501 microversion: 2.1 time: 0.157702 Mar 03 03:06:35.910894 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1769/3771] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:06:35 2022] GET /compute/v2.1/servers/03abfefa-f519-4497-8991-954fd0ea7f64 => generated 1501 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:06:36.423553 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7327fd8e-e1ae-44e2-94f2-981c7121fc9c tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:36.424268 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7327fd8e-e1ae-44e2-94f2-981c7121fc9c tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] [instance: cc549c9b-fc77-4f5b-bb62-db4127cd7f81] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:36.430492 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7327fd8e-e1ae-44e2-94f2-981c7121fc9c tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:36.430942 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7327fd8e-e1ae-44e2-94f2-981c7121fc9c tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:36.431754 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7327fd8e-e1ae-44e2-94f2-981c7121fc9c tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:36.432188 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7327fd8e-e1ae-44e2-94f2-981c7121fc9c tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:36.446528 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.wsgi [None req-7327fd8e-e1ae-44e2-94f2-981c7121fc9c tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] HTTP exception thrown: Instance cc549c9b-fc77-4f5b-bb62-db4127cd7f81 could not be found. Mar 03 03:06:36.447122 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7327fd8e-e1ae-44e2-94f2-981c7121fc9c tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] Returning 404 to user: Instance cc549c9b-fc77-4f5b-bb62-db4127cd7f81 could not be found. {{(pid=116858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 03:06:36.447978 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7327fd8e-e1ae-44e2-94f2-981c7121fc9c tempest-VolumesNegativeTest-89972350 tempest-VolumesNegativeTest-89972350-project] 10.222.0.30 "GET /compute/v2.1/servers/cc549c9b-fc77-4f5b-bb62-db4127cd7f81" status: 404 len: 111 microversion: 2.1 time: 0.029344 Mar 03 03:06:36.448528 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 2003/3772] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:06:36 2022] GET /compute/v2.1/servers/cc549c9b-fc77-4f5b-bb62-db4127cd7f81 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 03 03:06:36.927453 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a5514902-d941-4958-80f5-f6f33ac63141 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:36.928146 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a5514902-d941-4958-80f5-f6f33ac63141 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] [instance: 03abfefa-f519-4497-8991-954fd0ea7f64] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:36.934316 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a5514902-d941-4958-80f5-f6f33ac63141 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:36.934766 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a5514902-d941-4958-80f5-f6f33ac63141 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:36.935682 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a5514902-d941-4958-80f5-f6f33ac63141 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:36.936128 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a5514902-d941-4958-80f5-f6f33ac63141 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:37.084558 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a5514902-d941-4958-80f5-f6f33ac63141 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cf2ebda0c4825b7db39f960d86352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a7b87ea564e8984ae824687987d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:06:37.092023 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a5514902-d941-4958-80f5-f6f33ac63141 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] 10.222.0.30 "GET /compute/v2.1/servers/03abfefa-f519-4497-8991-954fd0ea7f64" status: 200 len: 1501 microversion: 2.1 time: 0.168346 Mar 03 03:06:37.093061 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1770/3773] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:06:36 2022] GET /compute/v2.1/servers/03abfefa-f519-4497-8991-954fd0ea7f64 => generated 1501 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:06:37.646333 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [req-795f6428-e5b7-481a-b3b4-a4926ae588a6 req-ed3198d3-e7ba-4623-a287-c68f8958297b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03abfefa-f519-4497-8991-954fd0ea7f64", "name": "network-vif-deleted", "tag": "48ba6420-a14e-4537-8e79-a2d2949d728d"}]} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 03:06:37.657875 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-795f6428-e5b7-481a-b3b4-a4926ae588a6 req-ed3198d3-e7ba-4623-a287-c68f8958297b service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:37.658571 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-795f6428-e5b7-481a-b3b4-a4926ae588a6 req-ed3198d3-e7ba-4623-a287-c68f8958297b service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:37.682514 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.compute.server_external_events [req-795f6428-e5b7-481a-b3b4-a4926ae588a6 req-ed3198d3-e7ba-4623-a287-c68f8958297b service nova] Creating event network-vif-deleted:48ba6420-a14e-4537-8e79-a2d2949d728d for instance 03abfefa-f519-4497-8991-954fd0ea7f64 on hv-cinder-81977 Mar 03 03:06:37.689667 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [req-795f6428-e5b7-481a-b3b4-a4926ae588a6 req-ed3198d3-e7ba-4623-a287-c68f8958297b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047176 Mar 03 03:06:37.690443 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 2004/3774] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 03:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 03:06:38.111806 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6a1df9be-1f78-44d6-ac2f-3ea3b0ec142d tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:38.112698 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6a1df9be-1f78-44d6-ac2f-3ea3b0ec142d tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] [instance: 03abfefa-f519-4497-8991-954fd0ea7f64] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:38.121464 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6a1df9be-1f78-44d6-ac2f-3ea3b0ec142d tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:38.121929 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6a1df9be-1f78-44d6-ac2f-3ea3b0ec142d tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:38.122940 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6a1df9be-1f78-44d6-ac2f-3ea3b0ec142d tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:38.123356 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6a1df9be-1f78-44d6-ac2f-3ea3b0ec142d tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:38.155638 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6a1df9be-1f78-44d6-ac2f-3ea3b0ec142d tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:38.156292 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6a1df9be-1f78-44d6-ac2f-3ea3b0ec142d tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:38.157588 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.objects.instance [None req-6a1df9be-1f78-44d6-ac2f-3ea3b0ec142d tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lazy-loading 'fault' on Instance uuid 03abfefa-f519-4497-8991-954fd0ea7f64 {{(pid=116859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 03 03:06:38.206828 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-6a1df9be-1f78-44d6-ac2f-3ea3b0ec142d tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cf2ebda0c4825b7db39f960d86352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a7b87ea564e8984ae824687987d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:06:38.214362 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6a1df9be-1f78-44d6-ac2f-3ea3b0ec142d tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] 10.222.0.30 "GET /compute/v2.1/servers/03abfefa-f519-4497-8991-954fd0ea7f64" status: 200 len: 1302 microversion: 2.1 time: 0.108924 Mar 03 03:06:38.214951 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1771/3775] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:06:38 2022] GET /compute/v2.1/servers/03abfefa-f519-4497-8991-954fd0ea7f64 => generated 1302 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:06:39.234183 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-84f025ad-cba1-45bc-b95d-5e392d95bc0a tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:39.235454 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-84f025ad-cba1-45bc-b95d-5e392d95bc0a tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] [instance: 03abfefa-f519-4497-8991-954fd0ea7f64] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:39.241411 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-84f025ad-cba1-45bc-b95d-5e392d95bc0a tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:39.241906 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-84f025ad-cba1-45bc-b95d-5e392d95bc0a tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:39.242699 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-84f025ad-cba1-45bc-b95d-5e392d95bc0a tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:39.243137 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-84f025ad-cba1-45bc-b95d-5e392d95bc0a tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:39.255925 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.wsgi [None req-84f025ad-cba1-45bc-b95d-5e392d95bc0a tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] HTTP exception thrown: Instance 03abfefa-f519-4497-8991-954fd0ea7f64 could not be found. Mar 03 03:06:39.256592 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-84f025ad-cba1-45bc-b95d-5e392d95bc0a tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Returning 404 to user: Instance 03abfefa-f519-4497-8991-954fd0ea7f64 could not be found. {{(pid=116858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 03:06:39.257425 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-84f025ad-cba1-45bc-b95d-5e392d95bc0a tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] 10.222.0.30 "GET /compute/v2.1/servers/03abfefa-f519-4497-8991-954fd0ea7f64" status: 404 len: 111 microversion: 2.1 time: 0.027885 Mar 03 03:06:39.257953 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 2005/3776] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:06:39 2022] GET /compute/v2.1/servers/03abfefa-f519-4497-8991-954fd0ea7f64 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 03 03:06:39.352685 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-65cb709e-c4fe-4ae7-b0ed-016e148ee51d tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-400440303", "imageRef": "1fe11a1a-b4d0-46f5-89cd-501ceff49317", "flavorRef": "452", "networks": [{"uuid": "109c674a-9b17-4dd5-9863-c5113273cae9"}]}} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 03:06:39.404349 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.network.neutron [None req-65cb709e-c4fe-4ae7-b0ed-016e148ee51d tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] validate_networks() for [('109c674a-9b17-4dd5-9863-c5113273cae9', None, None, None, None, None)] {{(pid=116859) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 03 03:06:39.756575 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-65cb709e-c4fe-4ae7-b0ed-016e148ee51d tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Flavor limits 0:0:0 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 03 03:06:39.756999 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-65cb709e-c4fe-4ae7-b0ed-016e148ee51d tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Image limits 0:0:0 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 03 03:06:39.757472 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-65cb709e-c4fe-4ae7-b0ed-016e148ee51d tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Flavor pref 0:0:0 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 03 03:06:39.757938 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-65cb709e-c4fe-4ae7-b0ed-016e148ee51d tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Image pref 0:0:0 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 03 03:06:39.758373 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-65cb709e-c4fe-4ae7-b0ed-016e148ee51d tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 03 03:06:39.766877 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-65cb709e-c4fe-4ae7-b0ed-016e148ee51d tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:39.767317 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-65cb709e-c4fe-4ae7-b0ed-016e148ee51d tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:39.768154 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-65cb709e-c4fe-4ae7-b0ed-016e148ee51d tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:39.768586 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-65cb709e-c4fe-4ae7-b0ed-016e148ee51d tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:39.787314 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.quota [None req-65cb709e-c4fe-4ae7-b0ed-016e148ee51d tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Getting quotas for project 561a7b87ea564e8984ae824687987d61. Resources: {'instances', 'ram', 'cores'} {{(pid=116859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 03 03:06:39.792196 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.quota [None req-65cb709e-c4fe-4ae7-b0ed-016e148ee51d tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Getting quotas for user 735cf2ebda0c4825b7db39f960d86352 and project 561a7b87ea564e8984ae824687987d61. Resources: {'instances', 'ram', 'cores'} {{(pid=116859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 03 03:06:39.806403 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-65cb709e-c4fe-4ae7-b0ed-016e148ee51d tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Going to run 1 instances... {{(pid=116859) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 03 03:06:39.808801 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-65cb709e-c4fe-4ae7-b0ed-016e148ee51d tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] [instance: 0c10255d-7a11-47b0-8e58-fc853768c576] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1fe11a1a-b4d0-46f5-89cd-501ceff49317',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 03 03:06:39.859190 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-65cb709e-c4fe-4ae7-b0ed-016e148ee51d tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.510731 Mar 03 03:06:39.859936 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1772/3777] 10.222.0.30 () {60 vars in 1146 bytes} [Thu Mar 3 03:06:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 03 03:06:39.869446 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b47ddd2f-f904-4164-ba28-0fb690d4a992 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:39.870044 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b47ddd2f-f904-4164-ba28-0fb690d4a992 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] [instance: 0c10255d-7a11-47b0-8e58-fc853768c576] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:39.929298 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b47ddd2f-f904-4164-ba28-0fb690d4a992 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cf2ebda0c4825b7db39f960d86352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a7b87ea564e8984ae824687987d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:06:39.935712 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b47ddd2f-f904-4164-ba28-0fb690d4a992 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] 10.222.0.30 "GET /compute/v2.1/servers/0c10255d-7a11-47b0-8e58-fc853768c576" status: 200 len: 1213 microversion: 2.1 time: 0.069981 Mar 03 03:06:39.936357 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 2006/3778] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:06:39 2022] GET /compute/v2.1/servers/0c10255d-7a11-47b0-8e58-fc853768c576 => generated 1213 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:06:40.952919 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9af02bb7-960a-4500-a043-c3531ec36257 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:40.955305 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9af02bb7-960a-4500-a043-c3531ec36257 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] [instance: 0c10255d-7a11-47b0-8e58-fc853768c576] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:40.966154 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9af02bb7-960a-4500-a043-c3531ec36257 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:40.966829 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9af02bb7-960a-4500-a043-c3531ec36257 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:40.968452 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9af02bb7-960a-4500-a043-c3531ec36257 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:40.969789 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9af02bb7-960a-4500-a043-c3531ec36257 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:41.066571 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9af02bb7-960a-4500-a043-c3531ec36257 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cf2ebda0c4825b7db39f960d86352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a7b87ea564e8984ae824687987d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:06:41.078573 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9af02bb7-960a-4500-a043-c3531ec36257 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] 10.222.0.30 "GET /compute/v2.1/servers/0c10255d-7a11-47b0-8e58-fc853768c576" status: 200 len: 1271 microversion: 2.1 time: 0.129517 Mar 03 03:06:41.079551 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1773/3779] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:06:40 2022] GET /compute/v2.1/servers/0c10255d-7a11-47b0-8e58-fc853768c576 => generated 1271 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:06:42.098556 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-042b268e-099a-4afc-8482-b2db96c836ca tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:42.099164 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-042b268e-099a-4afc-8482-b2db96c836ca tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] [instance: 0c10255d-7a11-47b0-8e58-fc853768c576] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:42.106488 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-042b268e-099a-4afc-8482-b2db96c836ca tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:42.106881 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-042b268e-099a-4afc-8482-b2db96c836ca tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:42.107682 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-042b268e-099a-4afc-8482-b2db96c836ca tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:42.108121 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-042b268e-099a-4afc-8482-b2db96c836ca tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:42.139366 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [req-595a2026-a80e-4dad-aaad-e0fd50900f5a req-26e29672-4b58-4116-82ac-d1b68040d404 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c10255d-7a11-47b0-8e58-fc853768c576", "tag": "69caa56d-77f7-4a17-b9c3-6be5197d067a"}]} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 03:06:42.148267 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-595a2026-a80e-4dad-aaad-e0fd50900f5a req-26e29672-4b58-4116-82ac-d1b68040d404 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:42.148716 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-595a2026-a80e-4dad-aaad-e0fd50900f5a req-26e29672-4b58-4116-82ac-d1b68040d404 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:42.160904 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.compute.server_external_events [req-595a2026-a80e-4dad-aaad-e0fd50900f5a req-26e29672-4b58-4116-82ac-d1b68040d404 service nova] Creating event network-changed:69caa56d-77f7-4a17-b9c3-6be5197d067a for instance 0c10255d-7a11-47b0-8e58-fc853768c576 on hv-cinder-81977 Mar 03 03:06:42.170546 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [req-595a2026-a80e-4dad-aaad-e0fd50900f5a req-26e29672-4b58-4116-82ac-d1b68040d404 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038235 Mar 03 03:06:42.171165 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1774/3780] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 03:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 03:06:42.382414 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-042b268e-099a-4afc-8482-b2db96c836ca tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cf2ebda0c4825b7db39f960d86352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a7b87ea564e8984ae824687987d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:06:42.389495 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-042b268e-099a-4afc-8482-b2db96c836ca tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] 10.222.0.30 "GET /compute/v2.1/servers/0c10255d-7a11-47b0-8e58-fc853768c576" status: 200 len: 1313 microversion: 2.1 time: 0.297133 Mar 03 03:06:42.390052 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 2007/3781] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:06:42 2022] GET /compute/v2.1/servers/0c10255d-7a11-47b0-8e58-fc853768c576 => generated 1313 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:06:43.408192 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-6894ffa8-652d-434d-8798-8a5050f5a7be tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:43.408884 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-6894ffa8-652d-434d-8798-8a5050f5a7be tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] [instance: 0c10255d-7a11-47b0-8e58-fc853768c576] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:43.414959 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6894ffa8-652d-434d-8798-8a5050f5a7be tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:43.415399 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6894ffa8-652d-434d-8798-8a5050f5a7be tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:43.416199 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6894ffa8-652d-434d-8798-8a5050f5a7be tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:43.416630 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-6894ffa8-652d-434d-8798-8a5050f5a7be tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:43.555975 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-6894ffa8-652d-434d-8798-8a5050f5a7be tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cf2ebda0c4825b7db39f960d86352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a7b87ea564e8984ae824687987d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:06:43.564540 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-6894ffa8-652d-434d-8798-8a5050f5a7be tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] 10.222.0.30 "GET /compute/v2.1/servers/0c10255d-7a11-47b0-8e58-fc853768c576" status: 200 len: 1313 microversion: 2.1 time: 0.161672 Mar 03 03:06:43.565130 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1775/3782] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:06:43 2022] GET /compute/v2.1/servers/0c10255d-7a11-47b0-8e58-fc853768c576 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:06:44.581660 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ce580cef-dbfb-435b-b1e5-4b453aa5ccb3 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:44.582253 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ce580cef-dbfb-435b-b1e5-4b453aa5ccb3 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] [instance: 0c10255d-7a11-47b0-8e58-fc853768c576] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:44.588799 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ce580cef-dbfb-435b-b1e5-4b453aa5ccb3 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:44.589249 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ce580cef-dbfb-435b-b1e5-4b453aa5ccb3 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:44.590037 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ce580cef-dbfb-435b-b1e5-4b453aa5ccb3 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:44.590479 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ce580cef-dbfb-435b-b1e5-4b453aa5ccb3 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:44.723644 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ce580cef-dbfb-435b-b1e5-4b453aa5ccb3 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cf2ebda0c4825b7db39f960d86352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a7b87ea564e8984ae824687987d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:06:44.731133 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ce580cef-dbfb-435b-b1e5-4b453aa5ccb3 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] 10.222.0.30 "GET /compute/v2.1/servers/0c10255d-7a11-47b0-8e58-fc853768c576" status: 200 len: 1313 microversion: 2.1 time: 0.153898 Mar 03 03:06:44.731719 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 2008/3783] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:06:44 2022] GET /compute/v2.1/servers/0c10255d-7a11-47b0-8e58-fc853768c576 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:06:45.748282 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-d0b75af5-6d9e-4132-a2bf-2fb661545dfd tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:45.748888 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-d0b75af5-6d9e-4132-a2bf-2fb661545dfd tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] [instance: 0c10255d-7a11-47b0-8e58-fc853768c576] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:45.756388 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d0b75af5-6d9e-4132-a2bf-2fb661545dfd tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:45.756837 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d0b75af5-6d9e-4132-a2bf-2fb661545dfd tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:45.757735 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d0b75af5-6d9e-4132-a2bf-2fb661545dfd tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:45.758170 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-d0b75af5-6d9e-4132-a2bf-2fb661545dfd tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:45.894406 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-d0b75af5-6d9e-4132-a2bf-2fb661545dfd tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cf2ebda0c4825b7db39f960d86352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a7b87ea564e8984ae824687987d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:06:45.901631 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-d0b75af5-6d9e-4132-a2bf-2fb661545dfd tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] 10.222.0.30 "GET /compute/v2.1/servers/0c10255d-7a11-47b0-8e58-fc853768c576" status: 200 len: 1313 microversion: 2.1 time: 0.157189 Mar 03 03:06:45.902191 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1776/3784] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:06:45 2022] GET /compute/v2.1/servers/0c10255d-7a11-47b0-8e58-fc853768c576 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:06:46.918492 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-79ac75f7-c00b-4540-819b-11611ad9e12c tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:46.919101 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-79ac75f7-c00b-4540-819b-11611ad9e12c tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] [instance: 0c10255d-7a11-47b0-8e58-fc853768c576] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:46.926347 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-79ac75f7-c00b-4540-819b-11611ad9e12c tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:46.926853 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-79ac75f7-c00b-4540-819b-11611ad9e12c tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:46.927801 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-79ac75f7-c00b-4540-819b-11611ad9e12c tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:46.928250 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-79ac75f7-c00b-4540-819b-11611ad9e12c tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:47.065457 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-79ac75f7-c00b-4540-819b-11611ad9e12c tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cf2ebda0c4825b7db39f960d86352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a7b87ea564e8984ae824687987d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:06:47.072694 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-79ac75f7-c00b-4540-819b-11611ad9e12c tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] 10.222.0.30 "GET /compute/v2.1/servers/0c10255d-7a11-47b0-8e58-fc853768c576" status: 200 len: 1313 microversion: 2.1 time: 0.158046 Mar 03 03:06:47.073261 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 2009/3785] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:06:46 2022] GET /compute/v2.1/servers/0c10255d-7a11-47b0-8e58-fc853768c576 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:06:47.241758 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [req-dc987a92-e6ff-436a-82fd-e24d22df0646 req-bbe2ef36-27ce-4f9e-9822-f15063129b1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c10255d-7a11-47b0-8e58-fc853768c576", "name": "network-vif-plugged", "status": "completed", "tag": "69caa56d-77f7-4a17-b9c3-6be5197d067a"}]} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 03:06:47.251579 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-dc987a92-e6ff-436a-82fd-e24d22df0646 req-bbe2ef36-27ce-4f9e-9822-f15063129b1c service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:47.252290 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-dc987a92-e6ff-436a-82fd-e24d22df0646 req-bbe2ef36-27ce-4f9e-9822-f15063129b1c service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:47.263268 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.compute.server_external_events [req-dc987a92-e6ff-436a-82fd-e24d22df0646 req-bbe2ef36-27ce-4f9e-9822-f15063129b1c service nova] Creating event network-vif-plugged:69caa56d-77f7-4a17-b9c3-6be5197d067a for instance 0c10255d-7a11-47b0-8e58-fc853768c576 on hv-cinder-81977 Mar 03 03:06:47.268589 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [req-dc987a92-e6ff-436a-82fd-e24d22df0646 req-bbe2ef36-27ce-4f9e-9822-f15063129b1c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030522 Mar 03 03:06:47.269178 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1777/3786] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 03:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 03:06:48.088293 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6bb3237b-bd7a-4f9f-8bf1-4973f97b4c5b tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:48.088901 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6bb3237b-bd7a-4f9f-8bf1-4973f97b4c5b tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] [instance: 0c10255d-7a11-47b0-8e58-fc853768c576] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:48.095790 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6bb3237b-bd7a-4f9f-8bf1-4973f97b4c5b tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:48.096239 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6bb3237b-bd7a-4f9f-8bf1-4973f97b4c5b tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:48.097014 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6bb3237b-bd7a-4f9f-8bf1-4973f97b4c5b tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:48.097452 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6bb3237b-bd7a-4f9f-8bf1-4973f97b4c5b tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:48.233895 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6bb3237b-bd7a-4f9f-8bf1-4973f97b4c5b tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cf2ebda0c4825b7db39f960d86352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a7b87ea564e8984ae824687987d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:06:48.241507 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6bb3237b-bd7a-4f9f-8bf1-4973f97b4c5b tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] 10.222.0.30 "GET /compute/v2.1/servers/0c10255d-7a11-47b0-8e58-fc853768c576" status: 200 len: 1313 microversion: 2.1 time: 0.157055 Mar 03 03:06:48.242068 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 2010/3787] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:06:48 2022] GET /compute/v2.1/servers/0c10255d-7a11-47b0-8e58-fc853768c576 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:06:49.260410 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-e6d49318-d487-4a58-bff5-ad702d81b83b tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:49.261214 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-e6d49318-d487-4a58-bff5-ad702d81b83b tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] [instance: 0c10255d-7a11-47b0-8e58-fc853768c576] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:49.267241 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e6d49318-d487-4a58-bff5-ad702d81b83b tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:49.267858 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e6d49318-d487-4a58-bff5-ad702d81b83b tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:49.268616 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e6d49318-d487-4a58-bff5-ad702d81b83b tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:49.269060 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-e6d49318-d487-4a58-bff5-ad702d81b83b tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:49.402213 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-e6d49318-d487-4a58-bff5-ad702d81b83b tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cf2ebda0c4825b7db39f960d86352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a7b87ea564e8984ae824687987d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:06:49.410775 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-e6d49318-d487-4a58-bff5-ad702d81b83b tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] 10.222.0.30 "GET /compute/v2.1/servers/0c10255d-7a11-47b0-8e58-fc853768c576" status: 200 len: 1497 microversion: 2.1 time: 0.154982 Mar 03 03:06:49.411415 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1778/3788] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:06:49 2022] GET /compute/v2.1/servers/0c10255d-7a11-47b0-8e58-fc853768c576 => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:06:50.027565 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-95ce8dd7-27d1-49b1-9213-f02c1341e8b0 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:50.028072 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-95ce8dd7-27d1-49b1-9213-f02c1341e8b0 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] [instance: 0c10255d-7a11-47b0-8e58-fc853768c576] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:50.034313 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-95ce8dd7-27d1-49b1-9213-f02c1341e8b0 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:50.034768 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-95ce8dd7-27d1-49b1-9213-f02c1341e8b0 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:50.035579 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-95ce8dd7-27d1-49b1-9213-f02c1341e8b0 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:50.036044 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-95ce8dd7-27d1-49b1-9213-f02c1341e8b0 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:50.060498 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-95ce8dd7-27d1-49b1-9213-f02c1341e8b0 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] [instance: 0c10255d-7a11-47b0-8e58-fc853768c576] Going to try to terminate instance {{(pid=116858) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 03 03:06:50.134487 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-95ce8dd7-27d1-49b1-9213-f02c1341e8b0 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0c10255d-7a11-47b0-8e58-fc853768c576" status: 204 len: 0 microversion: 2.1 time: 0.110451 Mar 03 03:06:50.135339 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 2011/3789] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Mar 3 03:06:50 2022] DELETE /compute/v2.1/servers/0c10255d-7a11-47b0-8e58-fc853768c576 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 03 03:06:50.144444 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2142a0bc-ec03-44ae-9f3f-a9610b9c1e70 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:50.145049 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2142a0bc-ec03-44ae-9f3f-a9610b9c1e70 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] [instance: 0c10255d-7a11-47b0-8e58-fc853768c576] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:50.150707 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2142a0bc-ec03-44ae-9f3f-a9610b9c1e70 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:50.151161 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2142a0bc-ec03-44ae-9f3f-a9610b9c1e70 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:50.151954 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2142a0bc-ec03-44ae-9f3f-a9610b9c1e70 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:50.152387 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2142a0bc-ec03-44ae-9f3f-a9610b9c1e70 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:50.285613 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2142a0bc-ec03-44ae-9f3f-a9610b9c1e70 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cf2ebda0c4825b7db39f960d86352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a7b87ea564e8984ae824687987d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:06:50.292880 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2142a0bc-ec03-44ae-9f3f-a9610b9c1e70 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] 10.222.0.30 "GET /compute/v2.1/servers/0c10255d-7a11-47b0-8e58-fc853768c576" status: 200 len: 1503 microversion: 2.1 time: 0.152551 Mar 03 03:06:50.293449 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1779/3790] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:06:50 2022] GET /compute/v2.1/servers/0c10255d-7a11-47b0-8e58-fc853768c576 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:06:51.310711 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4bb4deac-d2e0-4a39-ba84-844a1e947b46 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:51.311320 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-4bb4deac-d2e0-4a39-ba84-844a1e947b46 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] [instance: 0c10255d-7a11-47b0-8e58-fc853768c576] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:51.318444 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4bb4deac-d2e0-4a39-ba84-844a1e947b46 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:51.318894 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4bb4deac-d2e0-4a39-ba84-844a1e947b46 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:51.319691 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4bb4deac-d2e0-4a39-ba84-844a1e947b46 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:51.320126 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-4bb4deac-d2e0-4a39-ba84-844a1e947b46 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:51.417809 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-cac44016-f748-4b26-b7bc-7a48d10dac04 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:51.418321 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-cac44016-f748-4b26-b7bc-7a48d10dac04 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:51.425289 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cac44016-f748-4b26-b7bc-7a48d10dac04 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:51.425676 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cac44016-f748-4b26-b7bc-7a48d10dac04 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:51.426466 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cac44016-f748-4b26-b7bc-7a48d10dac04 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:51.426908 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-cac44016-f748-4b26-b7bc-7a48d10dac04 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:51.442305 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.wsgi [None req-cac44016-f748-4b26-b7bc-7a48d10dac04 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] HTTP exception thrown: Instance df03ab77-ba2a-4603-b517-8e7b435882f2 could not be found. Mar 03 03:06:51.442898 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-cac44016-f748-4b26-b7bc-7a48d10dac04 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Returning 404 to user: Instance df03ab77-ba2a-4603-b517-8e7b435882f2 could not be found. {{(pid=116859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 03:06:51.443772 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-cac44016-f748-4b26-b7bc-7a48d10dac04 tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "DELETE /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 404 len: 111 microversion: 2.1 time: 0.030050 Mar 03 03:06:51.444516 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1780/3791] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Mar 3 03:06:51 2022] DELETE /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 03 03:06:51.452401 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-dbef8136-45de-4af4-873b-0c2893ac6e6d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:51.452876 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-dbef8136-45de-4af4-873b-0c2893ac6e6d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] [instance: df03ab77-ba2a-4603-b517-8e7b435882f2] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:51.453144 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-4bb4deac-d2e0-4a39-ba84-844a1e947b46 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cf2ebda0c4825b7db39f960d86352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a7b87ea564e8984ae824687987d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:06:51.459052 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dbef8136-45de-4af4-873b-0c2893ac6e6d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:51.459590 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dbef8136-45de-4af4-873b-0c2893ac6e6d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:51.460436 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dbef8136-45de-4af4-873b-0c2893ac6e6d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:51.460833 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4bb4deac-d2e0-4a39-ba84-844a1e947b46 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] 10.222.0.30 "GET /compute/v2.1/servers/0c10255d-7a11-47b0-8e58-fc853768c576" status: 200 len: 1503 microversion: 2.1 time: 0.154324 Mar 03 03:06:51.460959 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-dbef8136-45de-4af4-873b-0c2893ac6e6d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:51.461416 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 2012/3792] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:06:51 2022] GET /compute/v2.1/servers/0c10255d-7a11-47b0-8e58-fc853768c576 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:06:51.474176 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.wsgi [None req-dbef8136-45de-4af4-873b-0c2893ac6e6d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] HTTP exception thrown: Instance df03ab77-ba2a-4603-b517-8e7b435882f2 could not be found. Mar 03 03:06:51.474773 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-dbef8136-45de-4af4-873b-0c2893ac6e6d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] Returning 404 to user: Instance df03ab77-ba2a-4603-b517-8e7b435882f2 could not be found. {{(pid=116859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 03:06:51.475594 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-dbef8136-45de-4af4-873b-0c2893ac6e6d tempest-AttachVolumeTestJSON-805232432 tempest-AttachVolumeTestJSON-805232432-project] 10.222.0.30 "GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2" status: 404 len: 111 microversion: 2.1 time: 0.027199 Mar 03 03:06:51.476401 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1781/3793] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:06:51 2022] GET /compute/v2.1/servers/df03ab77-ba2a-4603-b517-8e7b435882f2 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 03 03:06:52.478478 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ee71c644-7bf3-43e3-afef-d3e5b3bb2876 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:52.479082 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ee71c644-7bf3-43e3-afef-d3e5b3bb2876 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] [instance: 0c10255d-7a11-47b0-8e58-fc853768c576] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:52.485516 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ee71c644-7bf3-43e3-afef-d3e5b3bb2876 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:52.485671 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ee71c644-7bf3-43e3-afef-d3e5b3bb2876 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:52.486524 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ee71c644-7bf3-43e3-afef-d3e5b3bb2876 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:52.487261 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ee71c644-7bf3-43e3-afef-d3e5b3bb2876 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:52.766748 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [req-0af9a39f-cf25-4e62-ad16-361dcad9a46c req-ffb37052-8d4f-44bc-8007-d96e94281757 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c10255d-7a11-47b0-8e58-fc853768c576", "name": "network-vif-deleted", "tag": "69caa56d-77f7-4a17-b9c3-6be5197d067a"}]} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 03:06:52.775978 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-0af9a39f-cf25-4e62-ad16-361dcad9a46c req-ffb37052-8d4f-44bc-8007-d96e94281757 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:52.776502 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-0af9a39f-cf25-4e62-ad16-361dcad9a46c req-ffb37052-8d4f-44bc-8007-d96e94281757 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:52.788765 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.compute.server_external_events [req-0af9a39f-cf25-4e62-ad16-361dcad9a46c req-ffb37052-8d4f-44bc-8007-d96e94281757 service nova] Creating event network-vif-deleted:69caa56d-77f7-4a17-b9c3-6be5197d067a for instance 0c10255d-7a11-47b0-8e58-fc853768c576 on hv-cinder-81977 Mar 03 03:06:52.793773 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [req-0af9a39f-cf25-4e62-ad16-361dcad9a46c req-ffb37052-8d4f-44bc-8007-d96e94281757 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031487 Mar 03 03:06:52.794959 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1782/3794] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 03:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 03:06:52.833382 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ee71c644-7bf3-43e3-afef-d3e5b3bb2876 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cf2ebda0c4825b7db39f960d86352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561a7b87ea564e8984ae824687987d61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:06:52.843236 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ee71c644-7bf3-43e3-afef-d3e5b3bb2876 tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] 10.222.0.30 "GET /compute/v2.1/servers/0c10255d-7a11-47b0-8e58-fc853768c576" status: 200 len: 1503 microversion: 2.1 time: 0.368732 Mar 03 03:06:52.843859 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 2013/3795] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:06:52 2022] GET /compute/v2.1/servers/0c10255d-7a11-47b0-8e58-fc853768c576 => generated 1503 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 03:06:53.863547 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-bdb1be2c-ab44-48b8-b553-5ab8ba9407ec tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:06:53.864843 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-bdb1be2c-ab44-48b8-b553-5ab8ba9407ec tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] [instance: 0c10255d-7a11-47b0-8e58-fc853768c576] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:06:53.871168 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bdb1be2c-ab44-48b8-b553-5ab8ba9407ec tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:53.871627 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bdb1be2c-ab44-48b8-b553-5ab8ba9407ec tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:53.872439 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bdb1be2c-ab44-48b8-b553-5ab8ba9407ec tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:06:53.873064 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-bdb1be2c-ab44-48b8-b553-5ab8ba9407ec tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:06:53.887164 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.wsgi [None req-bdb1be2c-ab44-48b8-b553-5ab8ba9407ec tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] HTTP exception thrown: Instance 0c10255d-7a11-47b0-8e58-fc853768c576 could not be found. Mar 03 03:06:53.887795 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-bdb1be2c-ab44-48b8-b553-5ab8ba9407ec tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] Returning 404 to user: Instance 0c10255d-7a11-47b0-8e58-fc853768c576 could not be found. {{(pid=116859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 03:06:53.888639 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-bdb1be2c-ab44-48b8-b553-5ab8ba9407ec tempest-VolumesActionsTest-231735028 tempest-VolumesActionsTest-231735028-project] 10.222.0.30 "GET /compute/v2.1/servers/0c10255d-7a11-47b0-8e58-fc853768c576" status: 404 len: 111 microversion: 2.1 time: 0.030048 Mar 03 03:06:53.889189 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1783/3796] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:06:53 2022] GET /compute/v2.1/servers/0c10255d-7a11-47b0-8e58-fc853768c576 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 03 03:07:23.032303 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 03:07:23.033339 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: Thu Mar 3 03:07:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 03 03:07:34.123051 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 03:07:34.124119 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: Thu Mar 3 03:07:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 03 03:07:36.334733 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-4f5a11d9-6d1e-4497-a5a1-211f7153e565 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Action: 'create', calling method: .version_select at 0x7fb3c8090ee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-640207044"}} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 03:07:36.349391 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.quota [None req-4f5a11d9-6d1e-4497-a5a1-211f7153e565 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Getting quotas for project a016f393012042f79a55fca33f325a41. Resources: {'key_pairs'} {{(pid=116858) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 03 03:07:36.353474 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.quota [None req-4f5a11d9-6d1e-4497-a5a1-211f7153e565 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Getting quotas for user 23161ecc90114aff912265fc2e1f5fa6 and project a016f393012042f79a55fca33f325a41. Resources: {'key_pairs'} {{(pid=116858) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 03 03:07:36.605932 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.quota [None req-4f5a11d9-6d1e-4497-a5a1-211f7153e565 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Getting quotas for project a016f393012042f79a55fca33f325a41. Resources: {'key_pairs'} {{(pid=116858) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 03 03:07:36.609602 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.quota [None req-4f5a11d9-6d1e-4497-a5a1-211f7153e565 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Getting quotas for user 23161ecc90114aff912265fc2e1f5fa6 and project a016f393012042f79a55fca33f325a41. Resources: {'key_pairs'} {{(pid=116858) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 03 03:07:36.623244 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-4f5a11d9-6d1e-4497-a5a1-211f7153e565 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.502736 Mar 03 03:07:36.623803 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 2014/3797] 10.222.0.30 () {60 vars in 1157 bytes} [Thu Mar 3 03:07:36 2022] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:07:51.595340 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f50bcd8e-d87e-4f5e-ba20-15ab94c5c439 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-866530435", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-640207044", "security_groups": [{"name": "tempest-secgroup-smoke-200007924"}], "networks": [{"uuid": "0fe0795b-086d-42b7-8a24-a0423217b17a"}], "block_device_mapping_v2": [{"uuid": "8f8f99f2-a283-4ccc-98db-bc0d2ca7e426", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 03:07:51.797023 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.network.neutron [None req-f50bcd8e-d87e-4f5e-ba20-15ab94c5c439 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] validate_networks() for [('0fe0795b-086d-42b7-8a24-a0423217b17a', None, None, None, None, None)] {{(pid=116859) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 03 03:07:52.163090 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-f50bcd8e-d87e-4f5e-ba20-15ab94c5c439 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Flavor limits 0:0:0 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 03 03:07:52.163510 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-f50bcd8e-d87e-4f5e-ba20-15ab94c5c439 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Image limits 0:0:0 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 03 03:07:52.164007 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-f50bcd8e-d87e-4f5e-ba20-15ab94c5c439 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Flavor pref 0:0:0 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 03 03:07:52.164417 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-f50bcd8e-d87e-4f5e-ba20-15ab94c5c439 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Image pref 0:0:0 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 03 03:07:52.164822 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.virt.hardware [None req-f50bcd8e-d87e-4f5e-ba20-15ab94c5c439 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 03 03:07:52.173201 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f50bcd8e-d87e-4f5e-ba20-15ab94c5c439 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:07:52.173679 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f50bcd8e-d87e-4f5e-ba20-15ab94c5c439 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:07:52.174501 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f50bcd8e-d87e-4f5e-ba20-15ab94c5c439 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:07:52.174939 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f50bcd8e-d87e-4f5e-ba20-15ab94c5c439 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:07:52.191240 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.quota [None req-f50bcd8e-d87e-4f5e-ba20-15ab94c5c439 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Getting quotas for project a016f393012042f79a55fca33f325a41. Resources: {'instances', 'ram', 'cores'} {{(pid=116859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 03 03:07:52.195057 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.quota [None req-f50bcd8e-d87e-4f5e-ba20-15ab94c5c439 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Getting quotas for user 23161ecc90114aff912265fc2e1f5fa6 and project a016f393012042f79a55fca33f325a41. Resources: {'instances', 'ram', 'cores'} {{(pid=116859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 03 03:07:52.250727 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f50bcd8e-d87e-4f5e-ba20-15ab94c5c439 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Going to run 1 instances... {{(pid=116859) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 03 03:07:52.253394 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f50bcd8e-d87e-4f5e-ba20-15ab94c5c439 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8f8f99f2-a283-4ccc-98db-bc0d2ca7e426',volume_size=None,volume_type=None)] {{(pid=116859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 03 03:07:52.388521 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f50bcd8e-d87e-4f5e-ba20-15ab94c5c439 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.797115 Mar 03 03:07:52.389150 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1784/3798] 10.222.0.30 () {60 vars in 1146 bytes} [Thu Mar 3 03:07:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 03 03:07:52.400150 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-e1c272db-7c65-4fb2-bb75-fa86c83f54c8 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:07:52.400757 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-e1c272db-7c65-4fb2-bb75-fa86c83f54c8 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:07:52.552698 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-e1c272db-7c65-4fb2-bb75-fa86c83f54c8 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23161ecc90114aff912265fc2e1f5fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a016f393012042f79a55fca33f325a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:07:52.559317 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-e1c272db-7c65-4fb2-bb75-fa86c83f54c8 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f" status: 200 len: 1087 microversion: 2.1 time: 0.163564 Mar 03 03:07:52.559948 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 2015/3799] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:07:52 2022] GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f => generated 1087 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:07:53.577115 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c5dbc88a-5140-469b-ab65-6c5946b7950f tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:07:53.577725 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c5dbc88a-5140-469b-ab65-6c5946b7950f tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:07:53.584322 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c5dbc88a-5140-469b-ab65-6c5946b7950f tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:07:53.584763 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c5dbc88a-5140-469b-ab65-6c5946b7950f tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:07:53.585542 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c5dbc88a-5140-469b-ab65-6c5946b7950f tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:07:53.585977 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c5dbc88a-5140-469b-ab65-6c5946b7950f tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:07:53.649684 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-c5dbc88a-5140-469b-ab65-6c5946b7950f tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23161ecc90114aff912265fc2e1f5fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a016f393012042f79a55fca33f325a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:07:53.658370 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c5dbc88a-5140-469b-ab65-6c5946b7950f tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f" status: 200 len: 1203 microversion: 2.1 time: 0.085612 Mar 03 03:07:53.668291 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1785/3800] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:07:53 2022] GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f => generated 1203 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:07:54.676247 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-def09a43-9a1b-4521-882c-8b423fcf3392 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:07:54.676765 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-def09a43-9a1b-4521-882c-8b423fcf3392 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:07:54.683270 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-def09a43-9a1b-4521-882c-8b423fcf3392 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:07:54.683748 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-def09a43-9a1b-4521-882c-8b423fcf3392 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:07:54.684540 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-def09a43-9a1b-4521-882c-8b423fcf3392 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:07:54.684971 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-def09a43-9a1b-4521-882c-8b423fcf3392 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:07:54.916526 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [req-5db038d1-253a-41f9-92fd-ea16b908f516 req-e1bc9f64-8df3-445c-acf6-fb92977ef792 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f", "tag": "7cca2cf6-e12d-45c4-b36f-3efe1de02fae"}]} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 03:07:54.927566 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-5db038d1-253a-41f9-92fd-ea16b908f516 req-e1bc9f64-8df3-445c-acf6-fb92977ef792 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:07:54.928522 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-5db038d1-253a-41f9-92fd-ea16b908f516 req-e1bc9f64-8df3-445c-acf6-fb92977ef792 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:07:54.954544 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.compute.server_external_events [req-5db038d1-253a-41f9-92fd-ea16b908f516 req-e1bc9f64-8df3-445c-acf6-fb92977ef792 service nova] Creating event network-changed:7cca2cf6-e12d-45c4-b36f-3efe1de02fae for instance 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f on hv-cinder-81977 Mar 03 03:07:54.962483 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [req-5db038d1-253a-41f9-92fd-ea16b908f516 req-e1bc9f64-8df3-445c-acf6-fb92977ef792 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048765 Mar 03 03:07:54.963672 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1786/3801] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 03:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 03:07:55.010730 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-def09a43-9a1b-4521-882c-8b423fcf3392 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23161ecc90114aff912265fc2e1f5fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a016f393012042f79a55fca33f325a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:07:55.019474 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-def09a43-9a1b-4521-882c-8b423fcf3392 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f" status: 200 len: 1258 microversion: 2.1 time: 0.347139 Mar 03 03:07:55.020171 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 2016/3802] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:07:54 2022] GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f => generated 1258 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:07:56.036297 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-077f0b0d-d7e1-4c24-903e-923b6d3e117a tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:07:56.036905 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-077f0b0d-d7e1-4c24-903e-923b6d3e117a tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:07:56.043331 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-077f0b0d-d7e1-4c24-903e-923b6d3e117a tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:07:56.043826 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-077f0b0d-d7e1-4c24-903e-923b6d3e117a tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:07:56.044599 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-077f0b0d-d7e1-4c24-903e-923b6d3e117a tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:07:56.045035 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-077f0b0d-d7e1-4c24-903e-923b6d3e117a tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:07:56.179449 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-077f0b0d-d7e1-4c24-903e-923b6d3e117a tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23161ecc90114aff912265fc2e1f5fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a016f393012042f79a55fca33f325a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:07:56.186651 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-077f0b0d-d7e1-4c24-903e-923b6d3e117a tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f" status: 200 len: 1258 microversion: 2.1 time: 0.154888 Mar 03 03:07:56.187217 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1787/3803] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:07:56 2022] GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:07:57.203773 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d2e77014-35f5-4901-b215-bff425cb1f44 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:07:57.204379 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d2e77014-35f5-4901-b215-bff425cb1f44 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:07:57.211532 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d2e77014-35f5-4901-b215-bff425cb1f44 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:07:57.212015 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d2e77014-35f5-4901-b215-bff425cb1f44 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:07:57.212794 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d2e77014-35f5-4901-b215-bff425cb1f44 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:07:57.213230 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d2e77014-35f5-4901-b215-bff425cb1f44 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:07:57.344235 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d2e77014-35f5-4901-b215-bff425cb1f44 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23161ecc90114aff912265fc2e1f5fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a016f393012042f79a55fca33f325a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:07:57.351693 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d2e77014-35f5-4901-b215-bff425cb1f44 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f" status: 200 len: 1258 microversion: 2.1 time: 0.151793 Mar 03 03:07:57.352254 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 2017/3804] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:07:57 2022] GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:07:58.368792 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ad92ea4b-38b9-472d-bee0-5901c8081873 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:07:58.369408 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ad92ea4b-38b9-472d-bee0-5901c8081873 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:07:58.375824 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ad92ea4b-38b9-472d-bee0-5901c8081873 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:07:58.376286 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ad92ea4b-38b9-472d-bee0-5901c8081873 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:07:58.377072 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ad92ea4b-38b9-472d-bee0-5901c8081873 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:07:58.378958 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ad92ea4b-38b9-472d-bee0-5901c8081873 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:07:58.516136 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ad92ea4b-38b9-472d-bee0-5901c8081873 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23161ecc90114aff912265fc2e1f5fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a016f393012042f79a55fca33f325a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:07:58.523320 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ad92ea4b-38b9-472d-bee0-5901c8081873 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f" status: 200 len: 1258 microversion: 2.1 time: 0.158417 Mar 03 03:07:58.523911 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1788/3805] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:07:58 2022] GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:07:59.540136 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-cba6bb34-b779-4595-929d-d2fea46538a6 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:07:59.540735 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-cba6bb34-b779-4595-929d-d2fea46538a6 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:07:59.546997 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cba6bb34-b779-4595-929d-d2fea46538a6 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:07:59.547443 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cba6bb34-b779-4595-929d-d2fea46538a6 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:07:59.548240 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cba6bb34-b779-4595-929d-d2fea46538a6 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:07:59.548673 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-cba6bb34-b779-4595-929d-d2fea46538a6 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:07:59.681675 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-cba6bb34-b779-4595-929d-d2fea46538a6 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23161ecc90114aff912265fc2e1f5fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a016f393012042f79a55fca33f325a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:07:59.688912 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-cba6bb34-b779-4595-929d-d2fea46538a6 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f" status: 200 len: 1258 microversion: 2.1 time: 0.152664 Mar 03 03:07:59.689478 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 2018/3806] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:07:59 2022] GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:08:00.705693 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-1815fb32-f485-4d48-96ac-43d201dcaa75 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:08:00.706339 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-1815fb32-f485-4d48-96ac-43d201dcaa75 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:08:00.712621 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1815fb32-f485-4d48-96ac-43d201dcaa75 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:08:00.713071 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1815fb32-f485-4d48-96ac-43d201dcaa75 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:08:00.713848 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1815fb32-f485-4d48-96ac-43d201dcaa75 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:08:00.714286 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-1815fb32-f485-4d48-96ac-43d201dcaa75 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:08:00.846812 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-1815fb32-f485-4d48-96ac-43d201dcaa75 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23161ecc90114aff912265fc2e1f5fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a016f393012042f79a55fca33f325a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:08:00.854288 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-1815fb32-f485-4d48-96ac-43d201dcaa75 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f" status: 200 len: 1258 microversion: 2.1 time: 0.152653 Mar 03 03:08:00.854855 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1789/3807] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:08:00 2022] GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:08:01.871550 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-9fa0fadb-f861-4f89-8355-53504783ccdd tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:08:01.872187 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-9fa0fadb-f861-4f89-8355-53504783ccdd tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:08:01.878631 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9fa0fadb-f861-4f89-8355-53504783ccdd tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:08:01.879090 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9fa0fadb-f861-4f89-8355-53504783ccdd tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:08:01.879914 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9fa0fadb-f861-4f89-8355-53504783ccdd tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:08:01.880366 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-9fa0fadb-f861-4f89-8355-53504783ccdd tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:08:02.017233 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-9fa0fadb-f861-4f89-8355-53504783ccdd tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23161ecc90114aff912265fc2e1f5fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a016f393012042f79a55fca33f325a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:08:02.025208 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-9fa0fadb-f861-4f89-8355-53504783ccdd tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f" status: 200 len: 1258 microversion: 2.1 time: 0.157573 Mar 03 03:08:02.025762 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 2019/3808] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:08:01 2022] GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:08:03.042292 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-03551926-f0ee-4fbe-9886-403932ada0ab tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:08:03.042897 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-03551926-f0ee-4fbe-9886-403932ada0ab tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:08:03.049225 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-03551926-f0ee-4fbe-9886-403932ada0ab tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:08:03.049705 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-03551926-f0ee-4fbe-9886-403932ada0ab tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:08:03.050581 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-03551926-f0ee-4fbe-9886-403932ada0ab tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:08:03.051023 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-03551926-f0ee-4fbe-9886-403932ada0ab tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:08:03.187510 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-03551926-f0ee-4fbe-9886-403932ada0ab tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23161ecc90114aff912265fc2e1f5fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a016f393012042f79a55fca33f325a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:08:03.195440 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-03551926-f0ee-4fbe-9886-403932ada0ab tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f" status: 200 len: 1258 microversion: 2.1 time: 0.157161 Mar 03 03:08:03.196032 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1790/3809] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:08:03 2022] GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:08:04.211832 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-6b83bf06-3d91-4952-a061-2013975cb430 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:08:04.212432 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-6b83bf06-3d91-4952-a061-2013975cb430 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:08:04.218612 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6b83bf06-3d91-4952-a061-2013975cb430 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:08:04.219052 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6b83bf06-3d91-4952-a061-2013975cb430 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:08:04.219845 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6b83bf06-3d91-4952-a061-2013975cb430 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:08:04.220280 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-6b83bf06-3d91-4952-a061-2013975cb430 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:08:04.353903 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-6b83bf06-3d91-4952-a061-2013975cb430 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23161ecc90114aff912265fc2e1f5fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a016f393012042f79a55fca33f325a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:08:04.361055 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-6b83bf06-3d91-4952-a061-2013975cb430 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f" status: 200 len: 1258 microversion: 2.1 time: 0.153109 Mar 03 03:08:04.361604 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 2020/3810] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:08:04 2022] GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:08:05.376725 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-ef4b9ff8-3de8-4839-b216-d19fc3f791c7 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:08:05.377325 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-ef4b9ff8-3de8-4839-b216-d19fc3f791c7 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:08:05.383348 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ef4b9ff8-3de8-4839-b216-d19fc3f791c7 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:08:05.383837 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ef4b9ff8-3de8-4839-b216-d19fc3f791c7 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:08:05.384610 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ef4b9ff8-3de8-4839-b216-d19fc3f791c7 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:08:05.385043 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-ef4b9ff8-3de8-4839-b216-d19fc3f791c7 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:08:05.522307 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-ef4b9ff8-3de8-4839-b216-d19fc3f791c7 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23161ecc90114aff912265fc2e1f5fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a016f393012042f79a55fca33f325a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:08:05.529497 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-ef4b9ff8-3de8-4839-b216-d19fc3f791c7 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f" status: 200 len: 1258 microversion: 2.1 time: 0.156618 Mar 03 03:08:05.530065 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1791/3811] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:08:05 2022] GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:08:05.626432 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [req-699707c1-ab24-4bc9-bce6-bbecc329d6f5 req-1270b3a9-9d23-4823-8575-abec0a8ab9f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f", "name": "network-vif-plugged", "status": "completed", "tag": "7cca2cf6-e12d-45c4-b36f-3efe1de02fae"}]} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 03:08:05.635093 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-699707c1-ab24-4bc9-bce6-bbecc329d6f5 req-1270b3a9-9d23-4823-8575-abec0a8ab9f7 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:08:05.635687 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-699707c1-ab24-4bc9-bce6-bbecc329d6f5 req-1270b3a9-9d23-4823-8575-abec0a8ab9f7 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:08:05.647344 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.compute.server_external_events [req-699707c1-ab24-4bc9-bce6-bbecc329d6f5 req-1270b3a9-9d23-4823-8575-abec0a8ab9f7 service nova] Creating event network-vif-plugged:7cca2cf6-e12d-45c4-b36f-3efe1de02fae for instance 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f on hv-cinder-81977 Mar 03 03:08:05.652437 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [req-699707c1-ab24-4bc9-bce6-bbecc329d6f5 req-1270b3a9-9d23-4823-8575-abec0a8ab9f7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029881 Mar 03 03:08:05.653029 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 2021/3812] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 03:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 03:08:06.546086 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-84c1ee87-7dc7-4996-85f9-7a991f172600 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:08:06.546699 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-84c1ee87-7dc7-4996-85f9-7a991f172600 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:08:06.553072 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-84c1ee87-7dc7-4996-85f9-7a991f172600 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:08:06.553526 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-84c1ee87-7dc7-4996-85f9-7a991f172600 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:08:06.554340 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-84c1ee87-7dc7-4996-85f9-7a991f172600 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:08:06.554782 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-84c1ee87-7dc7-4996-85f9-7a991f172600 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:08:06.686200 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-84c1ee87-7dc7-4996-85f9-7a991f172600 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23161ecc90114aff912265fc2e1f5fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a016f393012042f79a55fca33f325a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:08:06.693567 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-84c1ee87-7dc7-4996-85f9-7a991f172600 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f" status: 200 len: 1258 microversion: 2.1 time: 0.151299 Mar 03 03:08:06.694124 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1792/3813] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:08:06 2022] GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:08:07.711164 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ba891a58-0243-4ef9-95cc-d8e5cdee405a tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:08:07.711909 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ba891a58-0243-4ef9-95cc-d8e5cdee405a tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:08:07.717906 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ba891a58-0243-4ef9-95cc-d8e5cdee405a tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:08:07.718357 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ba891a58-0243-4ef9-95cc-d8e5cdee405a tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:08:07.719132 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ba891a58-0243-4ef9-95cc-d8e5cdee405a tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:08:07.719569 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ba891a58-0243-4ef9-95cc-d8e5cdee405a tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:08:07.856023 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ba891a58-0243-4ef9-95cc-d8e5cdee405a tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23161ecc90114aff912265fc2e1f5fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a016f393012042f79a55fca33f325a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:08:07.863970 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ba891a58-0243-4ef9-95cc-d8e5cdee405a tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f" status: 200 len: 1442 microversion: 2.1 time: 0.157514 Mar 03 03:08:07.864530 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 2022/3814] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:08:07 2022] GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f => generated 1442 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:08:07.879562 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-4e4d010b-09d8-4b35-8018-cfb3c9b07a09 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:08:07.880191 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-4e4d010b-09d8-4b35-8018-cfb3c9b07a09 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:08:07.886327 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4e4d010b-09d8-4b35-8018-cfb3c9b07a09 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:08:07.886771 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4e4d010b-09d8-4b35-8018-cfb3c9b07a09 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:08:07.887537 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4e4d010b-09d8-4b35-8018-cfb3c9b07a09 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:08:07.887996 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-4e4d010b-09d8-4b35-8018-cfb3c9b07a09 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:08:08.025598 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-4e4d010b-09d8-4b35-8018-cfb3c9b07a09 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23161ecc90114aff912265fc2e1f5fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a016f393012042f79a55fca33f325a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:08:08.032880 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-4e4d010b-09d8-4b35-8018-cfb3c9b07a09 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f" status: 200 len: 1442 microversion: 2.1 time: 0.157205 Mar 03 03:08:08.033437 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1793/3815] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:08:07 2022] GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f => generated 1442 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:08:09.701766 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [req-abfb06b2-8394-4cc4-a7c5-163e633d3d8c req-b92987d6-d410-4ff0-b1bb-8cf4637d6079 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f", "tag": "7cca2cf6-e12d-45c4-b36f-3efe1de02fae"}]} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 03:08:09.710831 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-abfb06b2-8394-4cc4-a7c5-163e633d3d8c req-b92987d6-d410-4ff0-b1bb-8cf4637d6079 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:08:09.711278 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-abfb06b2-8394-4cc4-a7c5-163e633d3d8c req-b92987d6-d410-4ff0-b1bb-8cf4637d6079 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:08:09.722510 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.compute.server_external_events [req-abfb06b2-8394-4cc4-a7c5-163e633d3d8c req-b92987d6-d410-4ff0-b1bb-8cf4637d6079 service nova] Creating event network-changed:7cca2cf6-e12d-45c4-b36f-3efe1de02fae for instance 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f on hv-cinder-81977 Mar 03 03:08:09.728085 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [req-abfb06b2-8394-4cc4-a7c5-163e633d3d8c req-b92987d6-d410-4ff0-b1bb-8cf4637d6079 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030140 Mar 03 03:08:09.728683 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 2023/3816] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 03:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 03:09:12.712667 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 03:09:12.713190 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: Thu Mar 3 03:09:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 03 03:10:03.767855 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-c8dd2367-211b-497f-a425-dbee3f385935 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 03:10:03.768541 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-c8dd2367-211b-497f-a425-dbee3f385935 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:10:03.774741 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c8dd2367-211b-497f-a425-dbee3f385935 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:03.775193 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c8dd2367-211b-497f-a425-dbee3f385935 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:03.776041 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c8dd2367-211b-497f-a425-dbee3f385935 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:03.776477 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-c8dd2367-211b-497f-a425-dbee3f385935 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:03.797689 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.objects.instance [None req-c8dd2367-211b-497f-a425-dbee3f385935 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lazy-loading 'flavor' on Instance uuid 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f {{(pid=116859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 03 03:10:03.867514 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-c8dd2367-211b-497f-a425-dbee3f385935 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "POST /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f/action" status: 202 len: 0 microversion: 2.1 time: 0.104851 Mar 03 03:10:03.868283 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1794/3817] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Mar 3 03:10:03 2022] POST /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 03 03:10:03.877914 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-bc8e594c-313e-44cd-87a5-f6023170decc tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:10:03.879526 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-bc8e594c-313e-44cd-87a5-f6023170decc tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:10:03.886565 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bc8e594c-313e-44cd-87a5-f6023170decc tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:03.887062 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bc8e594c-313e-44cd-87a5-f6023170decc tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:03.888011 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bc8e594c-313e-44cd-87a5-f6023170decc tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:03.888460 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bc8e594c-313e-44cd-87a5-f6023170decc tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:04.028197 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-bc8e594c-313e-44cd-87a5-f6023170decc tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23161ecc90114aff912265fc2e1f5fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a016f393012042f79a55fca33f325a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:10:04.036312 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-bc8e594c-313e-44cd-87a5-f6023170decc tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f" status: 200 len: 1567 microversion: 2.1 time: 0.162928 Mar 03 03:10:04.036886 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 2024/3818] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:10:03 2022] GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:10:05.054427 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9092cf05-56e8-405f-bfb0-a73a152d1e04 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:10:05.055119 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9092cf05-56e8-405f-bfb0-a73a152d1e04 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:10:05.061603 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9092cf05-56e8-405f-bfb0-a73a152d1e04 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:05.062052 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9092cf05-56e8-405f-bfb0-a73a152d1e04 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:05.062822 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9092cf05-56e8-405f-bfb0-a73a152d1e04 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:05.063251 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9092cf05-56e8-405f-bfb0-a73a152d1e04 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:05.196340 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9092cf05-56e8-405f-bfb0-a73a152d1e04 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23161ecc90114aff912265fc2e1f5fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a016f393012042f79a55fca33f325a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:10:05.203532 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9092cf05-56e8-405f-bfb0-a73a152d1e04 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f" status: 200 len: 1567 microversion: 2.1 time: 0.154029 Mar 03 03:10:05.204155 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1795/3819] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:10:05 2022] GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:10:06.221652 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b2b6cd8d-a724-4409-92ab-99e72051fae6 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:10:06.222265 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-b2b6cd8d-a724-4409-92ab-99e72051fae6 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:10:06.228571 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b2b6cd8d-a724-4409-92ab-99e72051fae6 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:06.229029 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b2b6cd8d-a724-4409-92ab-99e72051fae6 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:06.229814 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b2b6cd8d-a724-4409-92ab-99e72051fae6 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:06.230254 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-b2b6cd8d-a724-4409-92ab-99e72051fae6 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:06.360548 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-b2b6cd8d-a724-4409-92ab-99e72051fae6 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23161ecc90114aff912265fc2e1f5fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a016f393012042f79a55fca33f325a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:10:06.367867 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b2b6cd8d-a724-4409-92ab-99e72051fae6 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f" status: 200 len: 1567 microversion: 2.1 time: 0.150226 Mar 03 03:10:06.368426 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 2025/3820] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:10:06 2022] GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:10:07.384188 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-2031ca61-c930-46bd-8eb9-e34a423b09d6 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:10:07.384791 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-2031ca61-c930-46bd-8eb9-e34a423b09d6 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:10:07.391075 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2031ca61-c930-46bd-8eb9-e34a423b09d6 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:07.391521 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2031ca61-c930-46bd-8eb9-e34a423b09d6 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:07.392317 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2031ca61-c930-46bd-8eb9-e34a423b09d6 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:07.392750 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-2031ca61-c930-46bd-8eb9-e34a423b09d6 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:07.524506 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-2031ca61-c930-46bd-8eb9-e34a423b09d6 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23161ecc90114aff912265fc2e1f5fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a016f393012042f79a55fca33f325a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:10:07.531669 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-2031ca61-c930-46bd-8eb9-e34a423b09d6 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f" status: 200 len: 1567 microversion: 2.1 time: 0.151303 Mar 03 03:10:07.532226 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1796/3821] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:10:07 2022] GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:10:08.548210 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-d70b6a12-e573-4085-ad95-9ed2cd0fa1e7 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:10:08.548811 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-d70b6a12-e573-4085-ad95-9ed2cd0fa1e7 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:10:08.555370 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d70b6a12-e573-4085-ad95-9ed2cd0fa1e7 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:08.555851 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d70b6a12-e573-4085-ad95-9ed2cd0fa1e7 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:08.556621 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d70b6a12-e573-4085-ad95-9ed2cd0fa1e7 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:08.557053 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-d70b6a12-e573-4085-ad95-9ed2cd0fa1e7 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:08.689716 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-d70b6a12-e573-4085-ad95-9ed2cd0fa1e7 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23161ecc90114aff912265fc2e1f5fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a016f393012042f79a55fca33f325a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:10:08.697425 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-d70b6a12-e573-4085-ad95-9ed2cd0fa1e7 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f" status: 200 len: 1567 microversion: 2.1 time: 0.153012 Mar 03 03:10:08.697923 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 2026/3822] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:10:08 2022] GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:10:09.714245 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-8d8d93f6-ed39-4578-be81-6ebbcaf7fda7 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:10:09.714847 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-8d8d93f6-ed39-4578-be81-6ebbcaf7fda7 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:10:09.721178 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8d8d93f6-ed39-4578-be81-6ebbcaf7fda7 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:09.721631 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8d8d93f6-ed39-4578-be81-6ebbcaf7fda7 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:09.722403 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8d8d93f6-ed39-4578-be81-6ebbcaf7fda7 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:09.724072 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-8d8d93f6-ed39-4578-be81-6ebbcaf7fda7 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:09.857067 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-8d8d93f6-ed39-4578-be81-6ebbcaf7fda7 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23161ecc90114aff912265fc2e1f5fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a016f393012042f79a55fca33f325a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:10:09.864467 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-8d8d93f6-ed39-4578-be81-6ebbcaf7fda7 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f" status: 200 len: 1567 microversion: 2.1 time: 0.154133 Mar 03 03:10:09.865027 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1797/3823] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:10:09 2022] GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:10:10.880822 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-3fdcd439-5f82-4e2d-a8cc-b202158ef016 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:10:10.881419 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-3fdcd439-5f82-4e2d-a8cc-b202158ef016 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:10:10.887615 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3fdcd439-5f82-4e2d-a8cc-b202158ef016 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:10.888068 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3fdcd439-5f82-4e2d-a8cc-b202158ef016 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:10.888845 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3fdcd439-5f82-4e2d-a8cc-b202158ef016 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:10.889441 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-3fdcd439-5f82-4e2d-a8cc-b202158ef016 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:11.124986 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-3fdcd439-5f82-4e2d-a8cc-b202158ef016 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23161ecc90114aff912265fc2e1f5fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a016f393012042f79a55fca33f325a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:10:11.133705 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-3fdcd439-5f82-4e2d-a8cc-b202158ef016 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f" status: 200 len: 1567 microversion: 2.1 time: 0.256672 Mar 03 03:10:11.134367 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 2027/3824] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:10:10 2022] GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f => generated 1567 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:10:12.151542 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f1d16355-67b9-4f29-b8dc-e1616ccc435f tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:10:12.152286 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f1d16355-67b9-4f29-b8dc-e1616ccc435f tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:10:12.158514 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f1d16355-67b9-4f29-b8dc-e1616ccc435f tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:12.158961 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f1d16355-67b9-4f29-b8dc-e1616ccc435f tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:12.159766 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f1d16355-67b9-4f29-b8dc-e1616ccc435f tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:12.160275 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f1d16355-67b9-4f29-b8dc-e1616ccc435f tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:12.289515 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f1d16355-67b9-4f29-b8dc-e1616ccc435f tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23161ecc90114aff912265fc2e1f5fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a016f393012042f79a55fca33f325a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:10:12.296702 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f1d16355-67b9-4f29-b8dc-e1616ccc435f tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f" status: 200 len: 1567 microversion: 2.1 time: 0.149504 Mar 03 03:10:12.297264 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1798/3825] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:10:12 2022] GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:10:13.314157 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2edca479-049c-4355-b797-fce375f0ed85 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:10:13.314744 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2edca479-049c-4355-b797-fce375f0ed85 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:10:13.320908 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2edca479-049c-4355-b797-fce375f0ed85 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:13.321360 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2edca479-049c-4355-b797-fce375f0ed85 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:13.322133 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2edca479-049c-4355-b797-fce375f0ed85 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:13.322569 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2edca479-049c-4355-b797-fce375f0ed85 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:13.455427 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2edca479-049c-4355-b797-fce375f0ed85 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23161ecc90114aff912265fc2e1f5fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a016f393012042f79a55fca33f325a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:10:13.463250 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2edca479-049c-4355-b797-fce375f0ed85 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f" status: 200 len: 1567 microversion: 2.1 time: 0.153028 Mar 03 03:10:13.463957 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 2028/3826] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:10:13 2022] GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:10:14.480712 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-9bcf8f94-47cf-485e-b53e-4238cd04eace tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:10:14.481443 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-9bcf8f94-47cf-485e-b53e-4238cd04eace tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:10:14.487662 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9bcf8f94-47cf-485e-b53e-4238cd04eace tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:14.488171 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9bcf8f94-47cf-485e-b53e-4238cd04eace tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:14.489711 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9bcf8f94-47cf-485e-b53e-4238cd04eace tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:14.490156 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-9bcf8f94-47cf-485e-b53e-4238cd04eace tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:14.625424 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-9bcf8f94-47cf-485e-b53e-4238cd04eace tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23161ecc90114aff912265fc2e1f5fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a016f393012042f79a55fca33f325a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:10:14.632663 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-9bcf8f94-47cf-485e-b53e-4238cd04eace tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f" status: 200 len: 1567 microversion: 2.1 time: 0.155829 Mar 03 03:10:14.633233 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1799/3827] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:10:14 2022] GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:10:15.650065 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-ca81d197-1d4b-4727-9c0e-201ca93b3bf5 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:10:15.650674 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-ca81d197-1d4b-4727-9c0e-201ca93b3bf5 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:10:15.656925 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ca81d197-1d4b-4727-9c0e-201ca93b3bf5 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:15.657377 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ca81d197-1d4b-4727-9c0e-201ca93b3bf5 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:15.658156 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ca81d197-1d4b-4727-9c0e-201ca93b3bf5 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:15.658593 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-ca81d197-1d4b-4727-9c0e-201ca93b3bf5 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:15.792765 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-ca81d197-1d4b-4727-9c0e-201ca93b3bf5 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23161ecc90114aff912265fc2e1f5fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a016f393012042f79a55fca33f325a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:10:15.800013 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-ca81d197-1d4b-4727-9c0e-201ca93b3bf5 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f" status: 200 len: 1567 microversion: 2.1 time: 0.153829 Mar 03 03:10:15.801069 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 2029/3828] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:10:15 2022] GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:10:16.817884 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-23f64c7f-1a1c-4e10-bbb2-8b7d448cf472 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:10:16.818490 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-23f64c7f-1a1c-4e10-bbb2-8b7d448cf472 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:10:16.824820 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-23f64c7f-1a1c-4e10-bbb2-8b7d448cf472 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:16.825270 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-23f64c7f-1a1c-4e10-bbb2-8b7d448cf472 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:16.826071 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-23f64c7f-1a1c-4e10-bbb2-8b7d448cf472 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:16.826503 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-23f64c7f-1a1c-4e10-bbb2-8b7d448cf472 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:16.960367 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-23f64c7f-1a1c-4e10-bbb2-8b7d448cf472 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23161ecc90114aff912265fc2e1f5fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a016f393012042f79a55fca33f325a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:10:16.967629 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-23f64c7f-1a1c-4e10-bbb2-8b7d448cf472 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f" status: 200 len: 1508 microversion: 2.1 time: 0.154278 Mar 03 03:10:16.968195 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1800/3829] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:10:16 2022] GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:10:16.984384 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-36f22ec3-33a2-4080-b4d1-21862e2ad472 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 03:10:16.984948 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-36f22ec3-33a2-4080-b4d1-21862e2ad472 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:10:16.991630 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-36f22ec3-33a2-4080-b4d1-21862e2ad472 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:16.992104 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-36f22ec3-33a2-4080-b4d1-21862e2ad472 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:16.992875 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-36f22ec3-33a2-4080-b4d1-21862e2ad472 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:16.993305 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-36f22ec3-33a2-4080-b4d1-21862e2ad472 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:17.119855 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-36f22ec3-33a2-4080-b4d1-21862e2ad472 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "POST /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f/action" status: 202 len: 0 microversion: 2.1 time: 0.139391 Mar 03 03:10:17.120471 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 2030/3830] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Mar 3 03:10:16 2022] POST /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 03 03:10:17.128406 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-a2e7a38c-470b-4219-8e56-f24871a4462a tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:10:17.130204 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-a2e7a38c-470b-4219-8e56-f24871a4462a tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:10:17.136165 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a2e7a38c-470b-4219-8e56-f24871a4462a tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:17.136620 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a2e7a38c-470b-4219-8e56-f24871a4462a tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:17.137396 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a2e7a38c-470b-4219-8e56-f24871a4462a tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:17.137870 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-a2e7a38c-470b-4219-8e56-f24871a4462a tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:17.313694 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-a2e7a38c-470b-4219-8e56-f24871a4462a tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23161ecc90114aff912265fc2e1f5fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a016f393012042f79a55fca33f325a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:10:17.321630 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-a2e7a38c-470b-4219-8e56-f24871a4462a tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f" status: 200 len: 1516 microversion: 2.1 time: 0.197070 Mar 03 03:10:17.322202 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1801/3831] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:10:17 2022] GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f => generated 1516 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:10:18.339330 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-47165eec-f6bb-445d-a713-1f5353a18d13 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:10:18.340012 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-47165eec-f6bb-445d-a713-1f5353a18d13 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:10:18.345835 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-47165eec-f6bb-445d-a713-1f5353a18d13 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:18.346289 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-47165eec-f6bb-445d-a713-1f5353a18d13 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:18.347070 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-47165eec-f6bb-445d-a713-1f5353a18d13 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:18.347512 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-47165eec-f6bb-445d-a713-1f5353a18d13 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:18.488062 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-47165eec-f6bb-445d-a713-1f5353a18d13 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23161ecc90114aff912265fc2e1f5fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a016f393012042f79a55fca33f325a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:10:18.495932 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-47165eec-f6bb-445d-a713-1f5353a18d13 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f" status: 200 len: 1574 microversion: 2.1 time: 0.161507 Mar 03 03:10:18.496504 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 2031/3832] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:10:18 2022] GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:10:19.513387 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-29aa9266-2e95-473e-8b96-dffa860ef236 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:10:19.513993 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-29aa9266-2e95-473e-8b96-dffa860ef236 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:10:19.520219 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-29aa9266-2e95-473e-8b96-dffa860ef236 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:19.520671 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-29aa9266-2e95-473e-8b96-dffa860ef236 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:19.521441 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-29aa9266-2e95-473e-8b96-dffa860ef236 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:19.521877 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-29aa9266-2e95-473e-8b96-dffa860ef236 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:19.652061 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-29aa9266-2e95-473e-8b96-dffa860ef236 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23161ecc90114aff912265fc2e1f5fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a016f393012042f79a55fca33f325a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:10:19.659211 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-29aa9266-2e95-473e-8b96-dffa860ef236 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f" status: 200 len: 1574 microversion: 2.1 time: 0.149906 Mar 03 03:10:19.659784 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1802/3833] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:10:19 2022] GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:10:20.182545 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [req-05e9e4b7-b8e7-4941-bab4-b757521ada0b req-a8bc3c49-23f2-4ced-b786-74cadcaf6969 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f", "name": "network-vif-unplugged", "status": "completed", "tag": "7cca2cf6-e12d-45c4-b36f-3efe1de02fae"}]} {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 03:10:20.190366 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-05e9e4b7-b8e7-4941-bab4-b757521ada0b req-a8bc3c49-23f2-4ced-b786-74cadcaf6969 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:20.190878 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [req-05e9e4b7-b8e7-4941-bab4-b757521ada0b req-a8bc3c49-23f2-4ced-b786-74cadcaf6969 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:20.201835 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.compute.server_external_events [req-05e9e4b7-b8e7-4941-bab4-b757521ada0b req-a8bc3c49-23f2-4ced-b786-74cadcaf6969 service nova] Creating event network-vif-unplugged:7cca2cf6-e12d-45c4-b36f-3efe1de02fae for instance 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f on hv-cinder-81977 Mar 03 03:10:20.206681 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [req-05e9e4b7-b8e7-4941-bab4-b757521ada0b req-a8bc3c49-23f2-4ced-b786-74cadcaf6969 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084306 Mar 03 03:10:20.207908 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 2032/3834] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 03:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 03:10:20.676450 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-3cbc2e14-5769-49da-a562-b0a5e20dd888 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:10:20.677055 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-3cbc2e14-5769-49da-a562-b0a5e20dd888 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:10:20.683474 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3cbc2e14-5769-49da-a562-b0a5e20dd888 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:20.683952 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3cbc2e14-5769-49da-a562-b0a5e20dd888 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:20.684720 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3cbc2e14-5769-49da-a562-b0a5e20dd888 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:20.685156 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-3cbc2e14-5769-49da-a562-b0a5e20dd888 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:20.819402 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-3cbc2e14-5769-49da-a562-b0a5e20dd888 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23161ecc90114aff912265fc2e1f5fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a016f393012042f79a55fca33f325a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:10:20.826691 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-3cbc2e14-5769-49da-a562-b0a5e20dd888 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f" status: 200 len: 1574 microversion: 2.1 time: 0.154154 Mar 03 03:10:20.827259 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1803/3835] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:10:20 2022] GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:10:21.844210 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-7ac0d10c-1fae-46c8-bc71-97fef1ac21f9 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:10:21.844912 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-7ac0d10c-1fae-46c8-bc71-97fef1ac21f9 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:10:21.851177 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7ac0d10c-1fae-46c8-bc71-97fef1ac21f9 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:21.851659 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7ac0d10c-1fae-46c8-bc71-97fef1ac21f9 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:21.852436 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7ac0d10c-1fae-46c8-bc71-97fef1ac21f9 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:21.852935 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-7ac0d10c-1fae-46c8-bc71-97fef1ac21f9 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:21.984066 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-7ac0d10c-1fae-46c8-bc71-97fef1ac21f9 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23161ecc90114aff912265fc2e1f5fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a016f393012042f79a55fca33f325a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:10:21.991334 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-7ac0d10c-1fae-46c8-bc71-97fef1ac21f9 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f" status: 200 len: 1574 microversion: 2.1 time: 0.151825 Mar 03 03:10:21.991935 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 2033/3836] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:10:21 2022] GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 03 03:10:23.008496 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-887c5763-8dd7-4a84-9616-24ce50965e14 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:10:23.009666 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-887c5763-8dd7-4a84-9616-24ce50965e14 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:10:23.016071 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-887c5763-8dd7-4a84-9616-24ce50965e14 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:23.016522 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-887c5763-8dd7-4a84-9616-24ce50965e14 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:23.017294 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-887c5763-8dd7-4a84-9616-24ce50965e14 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:23.017727 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-887c5763-8dd7-4a84-9616-24ce50965e14 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:23.148572 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-887c5763-8dd7-4a84-9616-24ce50965e14 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23161ecc90114aff912265fc2e1f5fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a016f393012042f79a55fca33f325a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:10:23.155757 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-887c5763-8dd7-4a84-9616-24ce50965e14 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f" status: 200 len: 1574 microversion: 2.1 time: 0.151145 Mar 03 03:10:23.156325 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1804/3837] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:10:23 2022] GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:10:24.172464 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-c45ea8ab-756b-446a-b8ba-b76b2c9b4e30 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:10:24.173062 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-c45ea8ab-756b-446a-b8ba-b76b2c9b4e30 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:10:24.179181 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c45ea8ab-756b-446a-b8ba-b76b2c9b4e30 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:24.179652 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c45ea8ab-756b-446a-b8ba-b76b2c9b4e30 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:24.180439 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c45ea8ab-756b-446a-b8ba-b76b2c9b4e30 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:24.180919 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-c45ea8ab-756b-446a-b8ba-b76b2c9b4e30 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:24.569930 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-c45ea8ab-756b-446a-b8ba-b76b2c9b4e30 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23161ecc90114aff912265fc2e1f5fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a016f393012042f79a55fca33f325a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:10:24.577922 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-c45ea8ab-756b-446a-b8ba-b76b2c9b4e30 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f" status: 200 len: 1574 microversion: 2.1 time: 0.409304 Mar 03 03:10:24.578483 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 2034/3838] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:10:24 2022] GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f => generated 1574 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:10:25.594726 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f5655629-b6b1-417d-8303-5acbb8400a85 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:10:25.595326 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f5655629-b6b1-417d-8303-5acbb8400a85 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:10:25.601848 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f5655629-b6b1-417d-8303-5acbb8400a85 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:25.602345 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f5655629-b6b1-417d-8303-5acbb8400a85 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:25.603313 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f5655629-b6b1-417d-8303-5acbb8400a85 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:25.603702 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f5655629-b6b1-417d-8303-5acbb8400a85 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:25.733275 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-f5655629-b6b1-417d-8303-5acbb8400a85 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23161ecc90114aff912265fc2e1f5fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a016f393012042f79a55fca33f325a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:10:25.740475 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f5655629-b6b1-417d-8303-5acbb8400a85 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f" status: 200 len: 1574 microversion: 2.1 time: 0.149676 Mar 03 03:10:25.741038 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1805/3839] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:10:25 2022] GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:10:26.757217 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-bbee9c99-4079-44dc-8841-95c25c8ee524 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:10:26.757733 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-bbee9c99-4079-44dc-8841-95c25c8ee524 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:10:26.764015 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bbee9c99-4079-44dc-8841-95c25c8ee524 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:26.764460 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bbee9c99-4079-44dc-8841-95c25c8ee524 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:26.765259 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bbee9c99-4079-44dc-8841-95c25c8ee524 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:26.765694 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-bbee9c99-4079-44dc-8841-95c25c8ee524 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:26.899086 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-bbee9c99-4079-44dc-8841-95c25c8ee524 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23161ecc90114aff912265fc2e1f5fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a016f393012042f79a55fca33f325a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:10:26.907116 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-bbee9c99-4079-44dc-8841-95c25c8ee524 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f" status: 200 len: 1561 microversion: 2.1 time: 0.153841 Mar 03 03:10:26.907714 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 2035/3840] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:10:26 2022] GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:10:28.209424 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [req-c6acee74-5a71-4b96-9c18-6dd56f1d55aa req-01ff8931-6364-4271-a020-b4c5207e41b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f", "name": "network-vif-plugged", "status": "completed", "tag": "7cca2cf6-e12d-45c4-b36f-3efe1de02fae"}]} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 03:10:28.218542 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-c6acee74-5a71-4b96-9c18-6dd56f1d55aa req-01ff8931-6364-4271-a020-b4c5207e41b7 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:10:28.219009 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-c6acee74-5a71-4b96-9c18-6dd56f1d55aa req-01ff8931-6364-4271-a020-b4c5207e41b7 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:10:28.230256 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.compute.server_external_events [req-c6acee74-5a71-4b96-9c18-6dd56f1d55aa req-01ff8931-6364-4271-a020-b4c5207e41b7 service nova] Creating event network-vif-plugged:7cca2cf6-e12d-45c4-b36f-3efe1de02fae for instance 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f on hv-cinder-81977 Mar 03 03:10:28.235203 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [req-c6acee74-5a71-4b96-9c18-6dd56f1d55aa req-01ff8931-6364-4271-a020-b4c5207e41b7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029502 Mar 03 03:10:28.235829 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1806/3841] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 03:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 03:10:44.202145 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 03:10:44.202769 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: Thu Mar 3 03:10:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 03 03:10:54.136685 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 03:10:54.137164 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: Thu Mar 3 03:10:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 03 03:11:38.096125 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-df80a91c-ccb9-4574-815a-9cdb1e2d3a68 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:11:38.096740 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-df80a91c-ccb9-4574-815a-9cdb1e2d3a68 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:11:38.103889 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-df80a91c-ccb9-4574-815a-9cdb1e2d3a68 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:11:38.104344 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-df80a91c-ccb9-4574-815a-9cdb1e2d3a68 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:11:38.105140 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-df80a91c-ccb9-4574-815a-9cdb1e2d3a68 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:11:38.105577 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-df80a91c-ccb9-4574-815a-9cdb1e2d3a68 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:11:38.131558 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-df80a91c-ccb9-4574-815a-9cdb1e2d3a68 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Going to try to terminate instance {{(pid=116858) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 03 03:11:38.167966 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [req-c4e5487d-80f9-4367-bd56-cc4aa10eea6e req-7aa144eb-c3cb-4017-871f-d89034bb4d39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f", "tag": "7cca2cf6-e12d-45c4-b36f-3efe1de02fae"}]} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 03:11:38.176707 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-c4e5487d-80f9-4367-bd56-cc4aa10eea6e req-7aa144eb-c3cb-4017-871f-d89034bb4d39 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:11:38.177151 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-c4e5487d-80f9-4367-bd56-cc4aa10eea6e req-7aa144eb-c3cb-4017-871f-d89034bb4d39 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:11:38.188671 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.compute.server_external_events [req-c4e5487d-80f9-4367-bd56-cc4aa10eea6e req-7aa144eb-c3cb-4017-871f-d89034bb4d39 service nova] Creating event network-changed:7cca2cf6-e12d-45c4-b36f-3efe1de02fae for instance 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f on hv-cinder-81977 Mar 03 03:11:38.194388 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [req-c4e5487d-80f9-4367-bd56-cc4aa10eea6e req-7aa144eb-c3cb-4017-871f-d89034bb4d39 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100448 Mar 03 03:11:38.195494 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1807/3842] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 03:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 03 03:11:38.216838 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-df80a91c-ccb9-4574-815a-9cdb1e2d3a68 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f" status: 204 len: 0 microversion: 2.1 time: 0.125480 Mar 03 03:11:38.217602 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 2036/3843] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Mar 3 03:11:38 2022] DELETE /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 03 03:11:38.227930 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-466b1bd1-dfe6-483a-ac6a-2c4a14ca770e tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:11:38.228626 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-466b1bd1-dfe6-483a-ac6a-2c4a14ca770e tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:11:38.236970 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-466b1bd1-dfe6-483a-ac6a-2c4a14ca770e tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:11:38.237419 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-466b1bd1-dfe6-483a-ac6a-2c4a14ca770e tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:11:38.238201 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-466b1bd1-dfe6-483a-ac6a-2c4a14ca770e tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:11:38.238633 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-466b1bd1-dfe6-483a-ac6a-2c4a14ca770e tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:11:38.385776 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.policy [None req-466b1bd1-dfe6-483a-ac6a-2c4a14ca770e tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23161ecc90114aff912265fc2e1f5fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a016f393012042f79a55fca33f325a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116859) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:11:38.393757 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-466b1bd1-dfe6-483a-ac6a-2c4a14ca770e tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f" status: 200 len: 1567 microversion: 2.1 time: 0.171701 Mar 03 03:11:38.403438 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1808/3844] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:11:38 2022] GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:11:39.410837 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-a9d564f5-e262-4e03-b27a-6facd6e4b2b6 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:11:39.411537 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-a9d564f5-e262-4e03-b27a-6facd6e4b2b6 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:11:39.417993 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a9d564f5-e262-4e03-b27a-6facd6e4b2b6 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:11:39.418449 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a9d564f5-e262-4e03-b27a-6facd6e4b2b6 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:11:39.419232 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a9d564f5-e262-4e03-b27a-6facd6e4b2b6 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:11:39.419709 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-a9d564f5-e262-4e03-b27a-6facd6e4b2b6 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:11:39.553895 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-a9d564f5-e262-4e03-b27a-6facd6e4b2b6 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23161ecc90114aff912265fc2e1f5fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a016f393012042f79a55fca33f325a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:11:39.561856 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-a9d564f5-e262-4e03-b27a-6facd6e4b2b6 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f" status: 200 len: 1448 microversion: 2.1 time: 0.155308 Mar 03 03:11:39.562418 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 2037/3845] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:11:39 2022] GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f => generated 1448 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:11:40.308612 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [req-5ed2777a-bbae-4900-9aec-4140cbdb9998 req-321ebe0e-9559-4bb6-8d1f-1d08f3a2a9a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f", "name": "network-vif-deleted", "tag": "7cca2cf6-e12d-45c4-b36f-3efe1de02fae"}]} {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 03 03:11:40.320974 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-5ed2777a-bbae-4900-9aec-4140cbdb9998 req-321ebe0e-9559-4bb6-8d1f-1d08f3a2a9a3 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:11:40.321418 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [req-5ed2777a-bbae-4900-9aec-4140cbdb9998 req-321ebe0e-9559-4bb6-8d1f-1d08f3a2a9a3 service nova] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:11:40.331710 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.compute.server_external_events [req-5ed2777a-bbae-4900-9aec-4140cbdb9998 req-321ebe0e-9559-4bb6-8d1f-1d08f3a2a9a3 service nova] Creating event network-vif-deleted:7cca2cf6-e12d-45c4-b36f-3efe1de02fae for instance 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f on hv-cinder-81977 Mar 03 03:11:40.337450 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [req-5ed2777a-bbae-4900-9aec-4140cbdb9998 req-321ebe0e-9559-4bb6-8d1f-1d08f3a2a9a3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088551 Mar 03 03:11:40.338059 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1809/3846] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Mar 3 03:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 03 03:11:40.580661 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-2afacb26-3a44-47fb-9cc4-8fbe7ed9eb29 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Calling method '>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:11:40.581469 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.compute.api [None req-2afacb26-3a44-47fb-9cc4-8fbe7ed9eb29 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Fetching instance by UUID {{(pid=116858) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:11:40.590375 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2afacb26-3a44-47fb-9cc4-8fbe7ed9eb29 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:11:40.591234 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2afacb26-3a44-47fb-9cc4-8fbe7ed9eb29 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:11:40.592113 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2afacb26-3a44-47fb-9cc4-8fbe7ed9eb29 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:11:40.592548 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG oslo_concurrency.lockutils [None req-2afacb26-3a44-47fb-9cc4-8fbe7ed9eb29 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:11:40.665687 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.policy [None req-2afacb26-3a44-47fb-9cc4-8fbe7ed9eb29 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23161ecc90114aff912265fc2e1f5fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a016f393012042f79a55fca33f325a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116858) authorize /opt/stack/nova/nova/policy.py:199}} Mar 03 03:11:40.673229 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-2afacb26-3a44-47fb-9cc4-8fbe7ed9eb29 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f" status: 200 len: 1218 microversion: 2.1 time: 0.097735 Mar 03 03:11:40.673803 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 2038/3847] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:11:40 2022] GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 03 03:11:41.691172 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f53d3f39-9f72-49f0-9251-02768f7c3c1f tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Calling method '>' {{(pid=116859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:11:41.691874 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.compute.api [None req-f53d3f39-9f72-49f0-9251-02768f7c3c1f tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] [instance: 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f] Fetching instance by UUID {{(pid=116859) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 03 03:11:41.697984 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f53d3f39-9f72-49f0-9251-02768f7c3c1f tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:11:41.698438 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f53d3f39-9f72-49f0-9251-02768f7c3c1f tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:11:41.699217 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f53d3f39-9f72-49f0-9251-02768f7c3c1f tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 03 03:11:41.699685 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG oslo_concurrency.lockutils [None req-f53d3f39-9f72-49f0-9251-02768f7c3c1f tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Lock "056eea21-8cd3-453b-8bc6-a26b173c51c8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 03 03:11:41.712800 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.wsgi [None req-f53d3f39-9f72-49f0-9251-02768f7c3c1f tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] HTTP exception thrown: Instance 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f could not be found. Mar 03 03:11:41.713375 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: DEBUG nova.api.openstack.wsgi [None req-f53d3f39-9f72-49f0-9251-02768f7c3c1f tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Returning 404 to user: Instance 5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f could not be found. {{(pid=116859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 03 03:11:41.714184 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO nova.api.openstack.requestlog [None req-f53d3f39-9f72-49f0-9251-02768f7c3c1f tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f" status: 404 len: 111 microversion: 2.1 time: 0.027684 Mar 03 03:11:41.714699 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: [pid: 116859|app: 0|req: 1810/3848] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Mar 3 03:11:41 2022] GET /compute/v2.1/servers/5fd1a545-0c6d-43ad-8acb-7aa0153f8d7f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 03 03:11:41.877038 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: DEBUG nova.api.openstack.wsgi [None req-b03615a3-f639-4e65-8003-1c5fb91acd11 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] Calling method '.version_select at 0x7fb3c8409af0>' {{(pid=116858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 03 03:11:41.901956 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO nova.api.openstack.requestlog [None req-b03615a3-f639-4e65-8003-1c5fb91acd11 tempest-TestShelveInstance-492465550 tempest-TestShelveInstance-492465550-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-640207044" status: 202 len: 0 microversion: 2.1 time: 0.028776 Mar 03 03:11:41.902545 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: [pid: 116858|app: 0|req: 2039/3849] 10.222.0.30 () {58 vars in 1250 bytes} [Thu Mar 3 03:11:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-640207044 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 03 03:12:23.045874 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 03:12:23.046594 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: Thu Mar 3 03:12:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 03 03:12:32.722212 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 03:12:32.722671 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: Thu Mar 3 03:12:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 03 03:14:04.209982 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 03:14:04.210574 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: Thu Mar 3 03:14:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 03 03:14:14.144564 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 03:14:14.145028 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: Thu Mar 3 03:14:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 03 03:14:20.581945 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 03:14:20.582512 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: Thu Mar 3 03:14:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 03 03:14:34.245349 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 03:14:34.245900 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: Thu Mar 3 03:14:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 03 03:15:43.053794 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 03:15:43.054261 dv-cinder-819778-7-iscsi devstack@n-api.service[116858]: Thu Mar 3 03:15:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 03 03:15:52.730369 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 03 03:15:52.730852 dv-cinder-819778-7-iscsi devstack@n-api.service[116859]: Thu Mar 3 03:15:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!